Comments (2)
tbg
commented on May 13, 2024
It happens pretty regularly on CircleCI actually, and I managed to get it on my local machine as well. I can't nail it down in to an existing test in the logs. Possibly a teardown problem?
from cockroach.
tbg
commented on May 13, 2024
Here's the same on current master:
Triggering this via while [ $? -eq 0 ]; do make testrace PKG=./storage > repeatrace.txt 2>&1; done usually doesn't take long.
panic: runtime error: invalid memory address or nil pointer dereference
[signal 0xb code=0x1 addr=0x28 pc=0x58a314]
goroutine 1253 [running]:
runtime.panic(0xd7ec00, 0x141b973)
/usr/local/go/src/pkg/runtime/panic.c:279 +0xf5
github.com/cockroachdb/cockroach/storage.(*Store).ProposeRaftCommand(0xc20841cea0, 0xc208433cb0, 0x10, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:846 +0x104
github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd(0xc208193140, 0xdf3a50, 0x3, 0x2b07227ae550, 0xc2080e5500, 0x2b07227ae590, 0xc208152850, 0x1, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:440 +0xd53
github.com/cockroachdb/cockroach/storage.(*Range).AddCmd(0xc208193140, 0xdf3a50, 0x3, 0x2b07227ae550, 0xc2080e5500, 0x2b07227ae590, 0xc208152850, 0xd68001, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:272 +0x33d
github.com/cockroachdb/cockroach/storage.func·018(0xc49200, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:727 +0x151
github.com/cockroachdb/cockroach/util.RetryWithBackoff(0xdf3a50, 0x3, 0xf4240, 0x1e8480, 0x4000000000000000, 0x2, 0x0, 0xc2082b5a30, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/util/retry.go:80 +0x72
github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd(0xc20841cea0, 0xdf3a50, 0x3, 0x2b07227ae550, 0xc2080e5500, 0x2b07227ae590, 0xc208152850, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:758 +0x464
github.com/cockroachdb/cockroach/kv.func·005(0x809cb7, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/local_sender.go:128 +0x361
github.com/cockroachdb/cockroach/util.RetryWithBackoff(0xc208405e40, 0x13, 0x0, 0x0, 0x0, 0x2, 0x0, 0xc2082b5cf8, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/util/retry.go:80 +0x72
github.com/cockroachdb/cockroach/kv.(*LocalSender).Send(0xc208405180, 0xc2081fef30)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/local_sender.go:143 +0x197
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendOne(0xc208411c40, 0xc2081fef30)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:254 +0x2a1
github.com/cockroachdb/cockroach/kv.func·009(0xc2081fef30)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:361 +0x5d
created by github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendBatch
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:363 +0x8ef
goroutine 16 [runnable]:
testing.RunTests(0xf41228, 0x141f8c0, 0x65, 0x65, 0x144dd01)
/usr/local/go/src/pkg/testing/testing.go:505 +0xbb8
testing.Main(0xf41228, 0x141f8c0, 0x65, 0x65, 0x144dd20, 0x0, 0x0, 0x144dd20, 0x0, 0x0)
/usr/local/go/src/pkg/testing/testing.go:435 +0xa3
main.main()
github.com/cockroachdb/cockroach/storage/_test/_testmain.go:249 +0xdd
goroutine 19 [finalizer wait]:
runtime.park(0x5228b0, 0x1445d78, 0x141e6e9)
/usr/local/go/src/pkg/runtime/proc.c:1369 +0x89
runtime.parkunlock(0x1445d78, 0x141e6e9)
/usr/local/go/src/pkg/runtime/proc.c:1385 +0x3b
runfinq()
/usr/local/go/src/pkg/runtime/mgc0.c:2644 +0xcf
runtime.goexit()
/usr/local/go/src/pkg/runtime/proc.c:1445
goroutine 20 [chan receive]:
github.com/golang/glog.(*loggingT).flushDaemon(0x1448900)
/home/tobias/go/src/github.com/golang/glog/glog.go:879 +0x96
created by github.com/golang/glog.init·1
/home/tobias/go/src/github.com/golang/glog/glog.go:410 +0x2d6
goroutine 17 [syscall]:
runtime.goexit()
/usr/local/go/src/pkg/runtime/proc.c:1445
goroutine 97 [IO wait]:
net.runtime_pollWait(0x2b07227a9208, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc2081076b0, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc2081076b0, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).accept(0xc208107650, 0xf41348, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:409 +0x435
net.(*TCPListener).AcceptTCP(0xc20803c118, 0x18, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:234 +0x8b
net.(*TCPListener).Accept(0xc20803c118, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:244 +0x59
github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept(0xc208104c10, 0xc2080fa1c0, 0x2b07227a84f8, 0xc20803c118)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:124 +0x4c
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).Listen
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:118 +0x2b2
goroutine 72 [IO wait]:
net.runtime_pollWait(0x2b07227a9368, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc2080dd5d0, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc2080dd5d0, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc2080dd570, 0xc2080f4000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c378, 0xc2080f4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c378, 0xc2080f4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080ee240)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080ee240, 0xc20807b4c0, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080ee240, 0xc20807b4c0, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080ee240, 0xc20807b4c0, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080ee240, 0xc20807b4c0, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d80f0, 0xc2080d80f0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d80f0, 0xc2080ad400, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d80f0, 0xc353a0, 0xc2080ad460, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d80f0, 0xc353a0, 0xc2080ad460, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobServerCodec).ReadRequestHeader(0xc2080d76b0, 0xc2080ad460, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:401 +0x86
net/rpc.(*Server).readRequestHeader(0xc20809f600, 0x2b07227a9e30, 0xc2080d76b0, 0x0, 0x0, 0xc2080ad460, 0x539000, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:552 +0xaf
net/rpc.(*Server).readRequest(0xc20809f600, 0x2b07227a9e30, 0xc2080d76b0, 0xc20807b4c0, 0x10, 0xc2080d7680, 0x0, 0x0, 0x0, 0x0, ...)
/usr/local/go/src/pkg/net/rpc/server.go:519 +0xcc
net/rpc.(*Server).ServeCodec(0xc20809f600, 0x2b07227a9e30, 0xc2080d76b0)
/usr/local/go/src/pkg/net/rpc/server.go:438 +0x7a
net/rpc.(*Server).ServeConn(0xc20809f600, 0x2b07227a9d30, 0xc20803c378)
/usr/local/go/src/pkg/net/rpc/server.go:430 +0x1ca
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:133 +0x2a6
goroutine 98 [select]:
github.com/cockroachdb/cockroach/multiraft.(*state).start(0xc20810d4a0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:271 +0xaf5
created by github.com/cockroachdb/cockroach/multiraft.(*MultiRaft).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:118 +0x4b
goroutine 73 [IO wait]:
net.runtime_pollWait(0x2b07227a94c8, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc2080dd560, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc2080dd560, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc2080dd500, 0xc2080f6000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c380, 0xc2080f6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c380, 0xc2080f6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080ee2a0)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080ee2a0, 0xc20807a010, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080ee2a0, 0xc20807a010, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080ee2a0, 0xc20807a010, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080ee2a0, 0xc20807a010, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d81e0, 0xc2080d81e0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d81e0, 0xc2080d6200, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d81e0, 0xc35400, 0xc2080d6210, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d81e0, 0xc35400, 0xc2080d6210, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobClientCodec).ReadResponseHeader(0xc2080d6180, 0xc2080d6210, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/client.go:223 +0x86
net/rpc.(*Client).input(0xc2080ee060)
/usr/local/go/src/pkg/net/rpc/client.go:109 +0x131
created by net/rpc.NewClientWithCodec
/usr/local/go/src/pkg/net/rpc/client.go:201 +0xd0
goroutine 1188 [select]:
github.com/cockroachdb/cockroach/multiraft.(*state).start(0xc2084c0570)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:271 +0xaf5
created by github.com/cockroachdb/cockroach/multiraft.(*MultiRaft).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:118 +0x4b
goroutine 1003 [select]:
github.com/cockroachdb/cockroach/multiraft.(*writeTask).start(0xc2081fe9c0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:143 +0x751
created by github.com/cockroachdb/cockroach/multiraft.(*state).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:241 +0x17f
goroutine 100 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft(0xc208126dd0, 0x2b07227a9578, 0xc20810d410, 0xc2080ee120)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:873 +0x32a
created by github.com/cockroachdb/cockroach/storage.(*Store).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:337 +0x922
goroutine 99 [select]:
github.com/cockroachdb/cockroach/storage.(*singleNodeRaft).run(0xc20810d410)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:110 +0x45d
created by github.com/cockroachdb/cockroach/storage.newSingleNodeRaft
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:76 +0x477
goroutine 95 [select]:
github.com/cockroachdb/cockroach/storage.(*Range).startGossip(0xc2080ee480)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:513 +0x141
created by github.com/cockroachdb/cockroach/storage.(*Range).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:184 +0xb8
goroutine 70 [select]:
github.com/cockroachdb/cockroach/multiraft.(*writeTask).start(0xc2080d7140)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:143 +0x751
created by github.com/cockroachdb/cockroach/multiraft.(*state).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:241 +0x17f
goroutine 53 [select]:
github.com/cockroachdb/cockroach/storage.(*Range).startGossip(0xc208005620)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:513 +0x141
created by github.com/cockroachdb/cockroach/storage.(*Range).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:184 +0xb8
goroutine 54 [runnable]:
github.com/coreos/etcd/raft.(*multiNode).run(0xc208005a40)
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:131 +0x15e9
created by github.com/coreos/etcd/raft.StartMultiNode
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:27 +0xe4
goroutine 55 [IO wait]:
net.runtime_pollWait(0x2b07227a9418, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc2080dcc30, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc2080dcc30, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).accept(0xc2080dcbd0, 0xf41348, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:409 +0x435
net.(*TCPListener).AcceptTCP(0xc20803c308, 0x18, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:234 +0x8b
net.(*TCPListener).Accept(0xc20803c308, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:244 +0x59
github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept(0xc20807b080, 0xc20809f600, 0x2b07227a84f8, 0xc20803c308)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:124 +0x4c
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).Listen
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:118 +0x2b2
goroutine 56 [select]:
github.com/cockroachdb/cockroach/multiraft.(*state).start(0xc2080d7170)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:271 +0xaf5
created by github.com/cockroachdb/cockroach/multiraft.(*MultiRaft).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:118 +0x4b
goroutine 57 [select]:
github.com/cockroachdb/cockroach/storage.(*singleNodeRaft).run(0xc2080d70e0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:110 +0x45d
created by github.com/cockroachdb/cockroach/storage.newSingleNodeRaft
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:76 +0x477
goroutine 58 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft(0xc20809cdd0, 0x2b07227a9578, 0xc2080d70e0, 0xc208005560)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:873 +0x32a
created by github.com/cockroachdb/cockroach/storage.(*Store).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:337 +0x922
goroutine 103 [select]:
github.com/cockroachdb/cockroach/multiraft.(*writeTask).start(0xc20810d470)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:143 +0x751
created by github.com/cockroachdb/cockroach/multiraft.(*state).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:241 +0x17f
goroutine 997 [select]:
github.com/cockroachdb/cockroach/storage.(*Range).startGossip(0xc208004240)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:513 +0x141
created by github.com/cockroachdb/cockroach/storage.(*Range).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:184 +0xb8
goroutine 999 [IO wait]:
net.runtime_pollWait(0x2b07227a8ff8, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc208235410, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc208235410, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).accept(0xc2082353b0, 0xf41348, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:409 +0x435
net.(*TCPListener).AcceptTCP(0xc20803c280, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:234 +0x8b
net.(*TCPListener).Accept(0xc20803c280, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:244 +0x59
github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept(0xc20811aaa0, 0xc2081f2900, 0x2b07227a84f8, 0xc20803c280)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:124 +0x4c
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).Listen
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:118 +0x2b2
goroutine 105 [IO wait]:
net.runtime_pollWait(0x2b07227a92b8, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20811e0d0, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20811e0d0, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20811e070, 0xc2080bc000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c188, 0xc2080bc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c188, 0xc2080bc000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080ef860)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080ef860, 0xc208105150, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080ef860, 0xc208105150, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080ef860, 0xc208105150, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080ef860, 0xc208105150, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d82d0, 0xc2080d82d0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d82d0, 0xc20810dc00, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d82d0, 0xc35400, 0xc20810dce0, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d82d0, 0xc35400, 0xc20810dce0, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobClientCodec).ReadResponseHeader(0xc20810dc80, 0xc20810dce0, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/client.go:223 +0x86
net/rpc.(*Client).input(0xc2080ef8c0)
/usr/local/go/src/pkg/net/rpc/client.go:109 +0x131
created by net/rpc.NewClientWithCodec
/usr/local/go/src/pkg/net/rpc/client.go:201 +0xd0
goroutine 949 [IO wait]:
net.runtime_pollWait(0x2b07227a90a8, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20818ee60, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20818ee60, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).accept(0xc20818ee00, 0xf41348, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:409 +0x435
net.(*TCPListener).AcceptTCP(0xc20803c318, 0x18, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:234 +0x8b
net.(*TCPListener).Accept(0xc20803c318, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:244 +0x59
github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept(0xc20811b290, 0xc20809f940, 0x2b07227a84f8, 0xc20803c318)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:124 +0x4c
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).Listen
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:118 +0x2b2
goroutine 1185 [runnable]:
github.com/cockroachdb/cockroach/storage.(*Range).startGossip(0xc208193140)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:513 +0x141
created by github.com/cockroachdb/cockroach/storage.(*Range).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:184 +0xb8
goroutine 104 [IO wait]:
net.runtime_pollWait(0x2b07227a9158, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20811e140, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20811e140, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20811e0e0, 0xc208108000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c180, 0xc208108000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c180, 0xc208108000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080ef800)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080ef800, 0xc2081050f5, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080ef800, 0xc2081050f5, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080ef800, 0xc2081050f5, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080ef800, 0xc2081050f5, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d8000, 0xc2080d8000)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d8000, 0xc208101200, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d8000, 0xc353a0, 0xc208101220, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d8000, 0xc353a0, 0xc208101220, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobServerCodec).ReadRequestHeader(0xc20810dad0, 0xc208101220, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:401 +0x86
net/rpc.(*Server).readRequestHeader(0xc2080fa1c0, 0x2b07227a9e30, 0xc20810dad0, 0x0, 0x0, 0xc208101220, 0x539000, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:552 +0xaf
net/rpc.(*Server).readRequest(0xc2080fa1c0, 0x2b07227a9e30, 0xc20810dad0, 0x1000, 0x1465468, 0xc20810daa0, 0x0, 0x0, 0x0, 0x0, ...)
/usr/local/go/src/pkg/net/rpc/server.go:519 +0xcc
net/rpc.(*Server).ServeCodec(0xc2080fa1c0, 0x2b07227a9e30, 0xc20810dad0)
/usr/local/go/src/pkg/net/rpc/server.go:438 +0x7a
net/rpc.(*Server).ServeConn(0xc2080fa1c0, 0x2b07227a9d30, 0xc20803c180)
/usr/local/go/src/pkg/net/rpc/server.go:430 +0x1ca
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:133 +0x2a6
goroutine 96 [runnable]:
github.com/coreos/etcd/raft.(*multiNode).run(0xc2080ee960)
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:131 +0x15e9
created by github.com/coreos/etcd/raft.StartMultiNode
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:27 +0xe4
goroutine 948 [runnable]:
github.com/coreos/etcd/raft.(*multiNode).run(0xc2080eeea0)
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:131 +0x15e9
created by github.com/coreos/etcd/raft.StartMultiNode
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:27 +0xe4
goroutine 950 [select]:
github.com/cockroachdb/cockroach/multiraft.(*state).start(0xc2081235c0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:271 +0xaf5
created by github.com/cockroachdb/cockroach/multiraft.(*MultiRaft).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:118 +0x4b
goroutine 1197 [IO wait]:
net.runtime_pollWait(0x2b07227a8c88, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20848e290, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20848e290, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20848e230, 0xc2084d7000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c340, 0xc2084d7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c340, 0xc2084d7000, 0x1000, 0x1000, 0xc208432990, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc208005080)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc208005080, 0xc208433640, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc208005080, 0xc208433640, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc208005080, 0xc208433640, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc208005080, 0xc208433640, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2083c5770, 0xc200000010)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2083c5770, 0xc2084c1600, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2083c5770, 0xc35400, 0xc2084c1680, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2083c5770, 0xc35400, 0xc2084c1680, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobClientCodec).ReadResponseHeader(0xc2084c1320, 0xc2084c1680, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/client.go:223 +0x86
net/rpc.(*Client).input(0xc2080050e0)
/usr/local/go/src/pkg/net/rpc/client.go:109 +0x131
created by net/rpc.NewClientWithCodec
/usr/local/go/src/pkg/net/rpc/client.go:201 +0xd0
goroutine 1236 [select]:
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).heartbeat(0xc208411c40, 0xc208583ee0, 0xc208004fc0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:477 +0x8ae
created by github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendOne
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:285 +0xac0
goroutine 1202 [semacquire]:
sync.runtime_Semacquire(0xc20841cf14)
/usr/local/go/src/pkg/runtime/sema.goc:199 +0x30
sync.(*Mutex).Lock(0xc20841cf10)
/usr/local/go/src/pkg/sync/mutex.go:66 +0x100
github.com/cockroachdb/cockroach/storage.(*Store).configGossipUpdate(0xc20841cea0, 0xe10910, 0xa, 0x53ea01)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:356 +0x53
github.com/cockroachdb/cockroach/storage.*Store.(github.com/cockroachdb/cockroach/storage.configGossipUpdate)·fm(0xe10910, 0xa, 0x1)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:343 +0x52
github.com/cockroachdb/cockroach/gossip.func·007()
/home/tobias/go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:274 +0x113
created by github.com/cockroachdb/cockroach/gossip.(*infoStore).processCallbacks
/home/tobias/go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:276 +0x385
goroutine 1249 [select]:
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).heartbeat(0xc208411c40, 0xc2082b0680, 0xc208192300)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:477 +0x8ae
created by github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendOne
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:285 +0xac0
goroutine 1201 [semacquire]:
sync.runtime_Semacquire(0xc208216718)
/usr/local/go/src/pkg/runtime/sema.goc:199 +0x30
sync.(*WaitGroup).Wait(0xc2084058e0)
/usr/local/go/src/pkg/sync/waitgroup.go:129 +0x1ca
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendBatch(0xc208411c40, 0xc208585e00, 0xc208048080)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:365 +0x929
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc208411c40, 0xc2081fe4b0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:184 +0x18b
github.com/cockroachdb/cockroach/client.(*txnSender).Send(0xc208405740, 0xc2081fe4b0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/txn_sender.go:55 +0x112
github.com/cockroachdb/cockroach/client.(*KV).Call(0xc20823e9b0, 0xdef170, 0x5, 0x2b07227b4f88, 0xc208585e00, 0x2b07227b4fc8, 0xc208048080, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:123 +0x40e
github.com/cockroachdb/cockroach/client.(*KV).Flush(0xc20823e9b0, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:179 +0x725
github.com/cockroachdb/cockroach/client.(*KV).Call(0xc20823e9b0, 0xe07350, 0xe, 0x2b07227af280, 0xc208585cc0, 0x2b07227af2c0, 0xc208152700, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:109 +0xe3
github.com/cockroachdb/cockroach/storage.func·012(0xc20823e9b0, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:1368 +0x5df
github.com/cockroachdb/cockroach/client.func·003(0x6e5e35, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:229 +0xc8
github.com/cockroachdb/cockroach/util.RetryWithBackoff(0xc208405700, 0x16, 0x2faf080, 0x12a05f200, 0x4000000000000000, 0x0, 0x0, 0xc2083f6c58, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/util/retry.go:80 +0x72
github.com/cockroachdb/cockroach/client.(*KV).RunTransaction(0xc208413cc0, 0xc208405720, 0xc2083f6ee8, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:261 +0x5d5
github.com/cockroachdb/cockroach/storage.(*Range).AdminSplit(0xc208192180, 0xc208585b80, 0xc208152380)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:1369 +0x15f6
github.com/cockroachdb/cockroach/storage.(*Range).addAdminCmd(0xc208192180, 0xe05b70, 0xa, 0x2b07227b5a48, 0xc208585b80, 0x2b07227b5a88, 0xc208152380, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:297 +0x124
github.com/cockroachdb/cockroach/storage.(*Range).AddCmd(0xc208192180, 0xe05b70, 0xa, 0x2b07227b5a48, 0xc208585b80, 0x2b07227b5a88, 0xc208152380, 0x580801, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:268 +0x22f
github.com/cockroachdb/cockroach/storage.func·018(0x588eb4, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:727 +0x151
github.com/cockroachdb/cockroach/util.RetryWithBackoff(0xe05b70, 0xa, 0xf4240, 0x1e8480, 0x4000000000000000, 0x2, 0x0, 0xc2083f7428, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/util/retry.go:80 +0x72
github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd(0xc20841cea0, 0xe05b70, 0xa, 0x2b07227b5a48, 0xc208585b80, 0x2b07227b5a88, 0xc208152380, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:758 +0x464
github.com/cockroachdb/cockroach/kv.func·005(0x809cb7, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/local_sender.go:128 +0x361
github.com/cockroachdb/cockroach/util.RetryWithBackoff(0xc208405620, 0x1a, 0x0, 0x0, 0x0, 0x2, 0x0, 0xc2083f76f0, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/util/retry.go:80 +0x72
github.com/cockroachdb/cockroach/kv.(*LocalSender).Send(0xc208405180, 0xc2081ffe00)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/local_sender.go:143 +0x197
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendOne(0xc208411c40, 0xc2081ffe00)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:254 +0x2a1
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc208411c40, 0xc2081ffe00)
/home/tobias/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:186 +0x1b0
github.com/cockroachdb/cockroach/client.(*KV).Call(0xc208413cc0, 0xe05b70, 0xa, 0x2b07227b5a48, 0xc208585b80, 0x2b07227b5a88, 0xc208152380, 0x0, 0x0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/client/kv.go:123 +0x40e
github.com/cockroachdb/cockroach/storage.(*Store).maybeSplitRangesByConfigs(0xc20841cea0, 0xc2084877a0, 0x4, 0x4)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:424 +0xedf
github.com/cockroachdb/cockroach/storage.(*Store).configGossipUpdate(0xc20841cea0, 0xe10910, 0xa, 0x53ea01)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:374 +0x40b
github.com/cockroachdb/cockroach/storage.*Store.(github.com/cockroachdb/cockroach/storage.configGossipUpdate)·fm(0xe10910, 0xa, 0x2b07227a8301)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:343 +0x52
github.com/cockroachdb/cockroach/gossip.func·007()
/home/tobias/go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:274 +0x113
created by github.com/cockroachdb/cockroach/gossip.(*infoStore).processCallbacks
/home/tobias/go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:276 +0x385
goroutine 1187 [IO wait]:
net.runtime_pollWait(0x2b07227a8de8, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc208498fb0, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc208498fb0, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).accept(0xc208498f50, 0xf41348, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:409 +0x435
net.(*TCPListener).AcceptTCP(0xc20803c1b0, 0x18, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:234 +0x8b
net.(*TCPListener).Accept(0xc20803c1b0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/tcpsock_posix.go:244 +0x59
github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept(0xc208432cc0, 0xc20847c240, 0x2b07227a84f8, 0xc20803c1b0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:124 +0x4c
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).Listen
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:118 +0x2b2
goroutine 1190 [runnable]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft(0xc20841cea0, 0x2b07227a9578, 0xc2084c0450, 0xc208193080)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:873 +0x32a
created by github.com/cockroachdb/cockroach/storage.(*Store).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:337 +0x922
goroutine 1195 [select]:
github.com/cockroachdb/cockroach/multiraft.(*writeTask).start(0xc2084c0540)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:143 +0x751
created by github.com/cockroachdb/cockroach/multiraft.(*state).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:241 +0x17f
goroutine 1196 [IO wait]:
net.runtime_pollWait(0x2b07227a8d38, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20848e300, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20848e300, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20848e2a0, 0xc2084a3000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c338, 0xc2084a3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c338, 0xc2084a3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc208005200)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc208005200, 0xc208433660, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc208005200, 0xc208433660, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc208005200, 0xc208433660, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc208005200, 0xc208433660, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d83c0, 0xc2080d83c0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d83c0, 0xc2084a0d00, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d83c0, 0xc353a0, 0xc2084a0dc0, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d83c0, 0xc353a0, 0xc2084a0dc0, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobServerCodec).ReadRequestHeader(0xc2084c15c0, 0xc2084a0dc0, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:401 +0x86
net/rpc.(*Server).readRequestHeader(0xc20847c240, 0x2b07227a9e30, 0xc2084c15c0, 0x0, 0x0, 0xc2084a0dc0, 0x539000, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:552 +0xaf
net/rpc.(*Server).readRequest(0xc20847c240, 0x2b07227a9e30, 0xc2084c15c0, 0xc208433660, 0x10, 0xc2084c1500, 0x0, 0x0, 0x0, 0x0, ...)
/usr/local/go/src/pkg/net/rpc/server.go:519 +0xcc
net/rpc.(*Server).ServeCodec(0xc20847c240, 0x2b07227a9e30, 0xc2084c15c0)
/usr/local/go/src/pkg/net/rpc/server.go:438 +0x7a
net/rpc.(*Server).ServeConn(0xc20847c240, 0x2b07227a9d30, 0xc20803c338)
/usr/local/go/src/pkg/net/rpc/server.go:430 +0x1ca
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:133 +0x2a6
goroutine 1186 [runnable]:
github.com/coreos/etcd/raft.(*multiNode).run(0xc208193680)
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:131 +0x15e9
created by github.com/coreos/etcd/raft.StartMultiNode
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:27 +0xe4
goroutine 1189 [runnable]:
github.com/cockroachdb/cockroach/storage.(*singleNodeRaft).run(0xc2084c0450)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:110 +0x45d
created by github.com/cockroachdb/cockroach/storage.newSingleNodeRaft
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:76 +0x477
goroutine 957 [select]:
github.com/cockroachdb/cockroach/multiraft.(*writeTask).start(0xc208123590)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:143 +0x751
created by github.com/cockroachdb/cockroach/multiraft.(*state).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:241 +0x17f
goroutine 959 [IO wait]:
net.runtime_pollWait(0x2b07227a8f48, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20824e140, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20824e140, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20824e0e0, 0xc208225000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c3e0, 0xc208225000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c3e0, 0xc208225000, 0x1000, 0x1000, 0x5261fb, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080efe00)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080efe00, 0xc20811be30, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080efe00, 0xc20811be30, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080efe00, 0xc20811be30, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080efe00, 0xc20811be30, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d8780, 0xc2080d8780)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d8780, 0xc208228c00, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d8780, 0xc35400, 0xc208228c30, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d8780, 0xc35400, 0xc208228c30, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobClientCodec).ReadResponseHeader(0xc208228bd0, 0xc208228c30, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/client.go:223 +0x86
net/rpc.(*Client).input(0xc2080efe60)
/usr/local/go/src/pkg/net/rpc/client.go:109 +0x131
created by net/rpc.NewClientWithCodec
/usr/local/go/src/pkg/net/rpc/client.go:201 +0xd0
goroutine 958 [IO wait]:
net.runtime_pollWait(0x2b07227a8e98, 0x72, 0x0)
/usr/local/go/src/pkg/runtime/netpoll.goc:146 +0x66
net.(*pollDesc).Wait(0xc20824e1b0, 0x72, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:84 +0x62
net.(*pollDesc).WaitRead(0xc20824e1b0, 0x0, 0x0)
/usr/local/go/src/pkg/net/fd_poll_runtime.go:89 +0x50
net.(*netFD).Read(0xc20824e150, 0xc2081c1000, 0x1000, 0x1000, 0x0, 0x2b07227a7388, 0xb)
/usr/local/go/src/pkg/net/fd_unix.go:232 +0x430
net.(*conn).Read(0xc20803c3d8, 0xc2081c1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/net/net.go:122 +0x12d
net.(*TCPConn).Read(0xc20803c3d8, 0xc2081c1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
<autogenerated>:23 +0x78
bufio.(*Reader).fill(0xc2080efda0)
/usr/local/go/src/pkg/bufio/bufio.go:97 +0x35d
bufio.(*Reader).Read(0xc2080efda0, 0xc20811be00, 0x1, 0x9, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/bufio/bufio.go:175 +0x554
io.ReadAtLeast(0x2b07227a9de0, 0xc2080efda0, 0xc20811be00, 0x1, 0x9, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:289 +0x12c
io.ReadFull(0x2b07227a9de0, 0xc2080efda0, 0xc20811be00, 0x1, 0x9, 0x0, 0x0, 0x0)
/usr/local/go/src/pkg/io/io.go:307 +0x82
encoding/gob.decodeUintReader(0x2b07227a9de0, 0xc2080efda0, 0xc20811be00, 0x9, 0x9, 0x0, 0x1, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decode.go:66 +0xba
encoding/gob.(*Decoder).recvMessage(0xc2080d8690, 0xc2080d8690)
/usr/local/go/src/pkg/encoding/gob/decoder.go:73 +0x8e
encoding/gob.(*Decoder).decodeTypeSequence(0xc2080d8690, 0xc208256900, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:159 +0x95
encoding/gob.(*Decoder).DecodeValue(0xc2080d8690, 0xc353a0, 0xc208256900, 0x0, 0x160, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:227 +0x1bd
encoding/gob.(*Decoder).Decode(0xc2080d8690, 0xc353a0, 0xc208256900, 0x0, 0x0)
/usr/local/go/src/pkg/encoding/gob/decoder.go:204 +0x30c
net/rpc.(*gobServerCodec).ReadRequestHeader(0xc208228a80, 0xc208256900, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:401 +0x86
net/rpc.(*Server).readRequestHeader(0xc20809f940, 0x2b07227a9e30, 0xc208228a80, 0x0, 0x0, 0xc208256900, 0x539000, 0x0, 0x0)
/usr/local/go/src/pkg/net/rpc/server.go:552 +0xaf
net/rpc.(*Server).readRequest(0xc20809f940, 0x2b07227a9e30, 0xc208228a80, 0xc20811be00, 0x10, 0xc208228a50, 0x0, 0x0, 0x0, 0x0, ...)
/usr/local/go/src/pkg/net/rpc/server.go:519 +0xcc
net/rpc.(*Server).ServeCodec(0xc20809f940, 0x2b07227a9e30, 0xc208228a80)
/usr/local/go/src/pkg/net/rpc/server.go:438 +0x7a
net/rpc.(*Server).ServeConn(0xc20809f940, 0x2b07227a9d30, 0xc20803c3d8)
/usr/local/go/src/pkg/net/rpc/server.go:430 +0x1ca
created by github.com/cockroachdb/cockroach/multiraft.(*localRPCTransport).accept
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/transport.go:133 +0x2a6
goroutine 1001 [select]:
github.com/cockroachdb/cockroach/storage.(*singleNodeRaft).run(0xc2081fe960)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:110 +0x45d
created by github.com/cockroachdb/cockroach/storage.newSingleNodeRaft
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:76 +0x477
goroutine 1000 [select]:
github.com/cockroachdb/cockroach/multiraft.(*state).start(0xc2081fe9f0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:271 +0xaf5
created by github.com/cockroachdb/cockroach/multiraft.(*MultiRaft).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:118 +0x4b
goroutine 951 [select]:
github.com/cockroachdb/cockroach/storage.(*singleNodeRaft).run(0xc208123530)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:110 +0x45d
created by github.com/cockroachdb/cockroach/storage.newSingleNodeRaft
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/raft.go:76 +0x477
goroutine 952 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft(0xc20815c340, 0x2b07227a9578, 0xc208123530, 0xc2080eeae0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:873 +0x32a
created by github.com/cockroachdb/cockroach/storage.(*Store).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:337 +0x922
goroutine 947 [select]:
github.com/cockroachdb/cockroach/storage.(*Range).startGossip(0xc2080eeba0)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:513 +0x141
created by github.com/cockroachdb/cockroach/storage.(*Range).start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/range.go:184 +0xb8
goroutine 998 [runnable]:
github.com/coreos/etcd/raft.(*multiNode).run(0xc208004660)
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:131 +0x15e9
created by github.com/coreos/etcd/raft.StartMultiNode
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/src/github.com/coreos/etcd/raft/multinode.go:27 +0xe4
goroutine 1002 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft(0xc2080db380, 0x2b07227a9578, 0xc2081fe960, 0xc208004060)
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:873 +0x32a
created by github.com/cockroachdb/cockroach/storage.(*Store).Start
/home/tobias/go/src/github.com/cockroachdb/cockroach/storage/store.go:337 +0x922
FAIL github.com/cockroachdb/cockroach/storage 1.731s
make: *** [testrace] Error 1
and this is all of stdout:
make -C proto static_lib
make[1]: Entering directory `/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto'
make[1]: Nothing to be done for `static_lib'.
make[1]: Leaving directory `/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto'
make -C roachlib static_lib
make[1]: Entering directory `/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib'
make[1]: Nothing to be done for `static_lib'.
make[1]: Leaving directory `/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib'
make -C sql/parser
go test -race -run ".*" ./storage -logtostderr -timeout 1m
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
W1214 18:04:06.609685 13568 id_alloc.go:85] allocator key is currently set at -1014; minID is 2; allocating again to skip 1016 IDs
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
I1214 18:04:06.662684 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.662846 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.662975 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663099 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663262 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663370 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663515 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663639 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663753 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663861 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.663976 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664098 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664225 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664356 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664482 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664617 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664751 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.664889 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665034 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665177 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665334 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665495 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665661 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665821 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.665980 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.666143 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.666323 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.666497 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.666665 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.666848 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667024 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667216 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667405 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667604 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667796 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.667996 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.668317 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.668525 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.668736 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.668947 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.669156 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.669365 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.669600 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.669821 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.670034 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.670265 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.670496 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.670732 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.671103 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
I1214 18:04:06.816859 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
I1214 18:04:06.816960 13568 response_cache.go:106] waiting on cmdID: wall_time:1 random:1
Git sha rocksdb_build_git_sha:ed3aa7bb20b029e4fd04089549de0601eec18a5b
Compile time 14:44:02 Dec 8 2014
Options.error_if_exists: 0
Options.create_if_missing: 1
Options.paranoid_checks: 1
Options.env: 0x144c7c0
Options.info_log: 0x2b0734009770
Options.max_open_files: 5000
Options.max_total_wal_size: 0
Options.disableDataSync: 0
Options.use_fsync: 0
Options.max_log_file_size: 0
Options.max_manifest_file_size: 18446744073709551615
Options.log_file_time_to_roll: 0
Options.keep_log_file_num: 1000
Options.allow_os_buffer: 1
Options.allow_mmap_reads: 0
Options.allow_mmap_writes: 0
Options.create_missing_column_families: 0
Options.db_log_dir:
Options.wal_dir: /tmp/rocksdb_test235965642
Options.table_cache_numshardbits: 4
Options.table_cache_remove_scan_count_limit: 16
Options.delete_obsolete_files_period_micros: 21600000000
Options.max_background_compactions: 1
Options.max_background_flushes: 1
Options.WAL_ttl_seconds: 0
Options.WAL_size_limit_MB: 0
Options.manifest_preallocation_size: 4194304
Options.allow_os_buffer: 1
Options.allow_mmap_reads: 0
Options.allow_mmap_writes: 0
Options.is_fd_close_on_exec: 1
Options.skip_log_error_on_recovery: 0
Options.stats_dump_period_sec: 3600
Options.advise_random_on_open: 1
Options.access_hint_on_compaction_start: NORMAL
Options.use_adaptive_mutex: 0
Options.bytes_per_sync: 0
Creating manifest 1
Recovering from manifest file: MANIFEST-000001
Options for column family "default":
Options.comparator: rocksdb.InternalKeyComparator:leveldb.BytewiseComparator
Options.merge_operator: cockroach_merge_operator
Options.compaction_filter_factory: cockroach_compaction_filter_factory
Options.compaction_filter_factory_v2: DefaultCompactionFilterFactoryV2
Options.memtable_factory: SkipListFactory
Options.table_factory: BlockBasedTable
Options.write_buffer_size: 4194304
Options.max_write_buffer_number: 2
Options.block_cache: 0x2b07340098e8
Options.block_cache_compressed: (nil)
Options.block_cache_size: 1073741824
Options.block_size: 4096
Options.block_restart_interval: 16
Options.compression: 1
Options.filter_policy: nullptr
Options.prefix_extractor: nullptr
Options.whole_key_filtering: 1
Options.num_levels: 7
Options.min_write_buffer_number_to_merge: 1
Options.purge_redundant_kvs_while_flush: 1
Options.compression_opts.window_bits: -14
Options.compression_opts.level: -1
Options.compression_opts.strategy: 0
Options.level0_file_num_compaction_trigger: 4
Options.level0_slowdown_writes_trigger: 20
Options.level0_stop_writes_trigger: 24
Options.max_mem_compaction_level: 2
Options.target_file_size_base: 2097152
Options.target_file_size_multiplier: 1
Options.max_bytes_for_level_base: 10485760
Options.max_bytes_for_level_multiplier: 10
Options.max_bytes_for_level_multiplier_addtl[0]: 1
Options.max_bytes_for_level_multiplier_addtl[1]: 1
Options.max_bytes_for_level_multiplier_addtl[2]: 1
Options.max_bytes_for_level_multiplier_addtl[3]: 1
Options.max_bytes_for_level_multiplier_addtl[4]: 1
Options.max_bytes_for_level_multiplier_addtl[5]: 1
Options.max_bytes_for_level_multiplier_addtl[6]: 1
Options.max_sequential_skip_in_iterations: 8
Options.expanded_compaction_factor: 25
Options.source_compaction_factor: 1
Options.max_grandparent_overlap_factor: 10
Options.no_block_cache: 0
Options.arena_block_size: 419430
Options.soft_rate_limit: 0.00
Options.hard_rate_limit: 0.00
Options.rate_limit_delay_max_milliseconds: 1000
Options.disable_auto_compactions: 0
Options.purge_redundant_kvs_while_flush: 1
Options.block_size_deviation: 10
Options.filter_deletes: 0
Options.verify_checksums_in_compaction: 1
Options.compaction_style: 0
Options.compaction_options_universal.size_ratio: 1
Options.compaction_options_universal.min_merge_width: 2
Options.compaction_options_universal.max_merge_width: 4294967295
Options.compaction_options_universal.max_size_amplification_percent: 200
Options.compaction_options_universal.compression_size_percent: 4294967295
Options.compaction_options_fifo.max_table_files_size: 1073741824
Options.table_properties_collectors: InternalKeyPropertiesCollectorFactory;
Options.inplace_update_support: 0
Options.inplace_update_num_locks: 10000
Options.min_partial_merge_operands: 2
Options.memtable_prefix_bloom_bits: 0
Options.memtable_prefix_bloom_probes: 6
Options.memtable_prefix_bloom_huge_page_tlb_size: 0
Options.bloom_locality: 0
Options.max_successive_merges: 0
Recovered from manifest file:/tmp/rocksdb_test235965642/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
Column family [default] (ID 0), log number is 0
[default] New memtable created with log file: #4
(Original Log Time 2014/12/14-18:04:06.822470) BackgroundCallFlush doing FlushMemTableToOutputFile with column family [default], flush slots available 0
[default] Flushing memtable with next log file: 4
[default] Level-0 flush table #5: started
Table was constructed:
[basic properties]: # data blocks=1; # entries=1; raw key size=29; raw average key size=29.000000; raw value size=33; raw average value size=33.000000; data block size=78; index block size=35; filter block size=0; (estimated) table size=113; filter policy name=N/A;
[user collected properties]: kDeletedKeys=0;
[default] Level-0 flush table #5: 530 bytes OK
Creating manifest 6
Deleting manifest 1 current manifest 6
(Original Log Time 2014/12/14-18:04:06.822709) [default] Level-0 commit table #5 started
(Original Log Time 2014/12/14-18:04:06.823880) [default] Level-0 commit table #5: memtable #1 done
(Original Log Time 2014/12/14-18:04:06.823887) [default] Level summary: files[0 0 1 0 0 0 0]
Delete /tmp/rocksdb_test235965642/000003.log type=0 #3 -- OK
[default] Manual compaction starting
------- DUMPING STATS -------
** Compaction Stats [default] **
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) RW-Amp W-Amp Rd(MB/s) Wr(MB/s) Rn(cnt) Rnp1(cnt) Wnp1(cnt) Wnew(cnt) Comp(sec) Comp(cnt) Avg(sec) Stall(sec) Stall(cnt) Avg(ms)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L2 1/0 0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0 0 0 0 0 1 0.000 0.00 0 0.00
Sum 1/0 0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 1.0 0.0 2.2 0 0 0 0 0 1 0.000 0.00 0 0.00
Int 0/0 0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 1.0 0.0 2.2 0 0 0 0 0 1 0.000 0.00 0 0.00
Flush(GB): accumulative 0.000, interval 0.000
Stalls(secs): 0.000 level0_slowdown, 0.000 level0_numfiles, 0.000 memtable_compaction, 0.000 leveln_slowdown_soft, 0.000 leveln_slowdown_hard
Stalls(count): 0 level0_slowdown, 0 level0_numfiles, 0 memtable_compaction, 0 leveln_slowdown_soft, 0 leveln_slowdown_hard
** DB Stats **
Uptime(secs): 0.0 total, 0.0 interval
Cumulative writes: 2 writes, 2 batches, 0.7 writes per batch, 0.00 GB user ingest
Cumulative WAL: 2 writes, 1 syncs, 1.00 writes per sync, 0.00 GB written
Interval writes: 2 writes, 2 batches, 0.7 writes per batch, 0.0 MB user ingest
Interval WAL: 2 writes, 1 syncs, 1.00 writes per sync, 0.00 MB written
(Original Log Time 2014/12/14-18:04:06.824447) [default] Manual compaction from level-0 to level-1 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.824449) Compaction nothing to do
[default] Manual compaction starting
(Original Log Time 2014/12/14-18:04:06.824473) [default] Manual compaction from level-1 to level-2 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.824473) Compaction nothing to do
[default] Manual compaction starting
(Original Log Time 2014/12/14-18:04:06.824514) [default] Manual compaction from level-2 to level-2 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.824518) [default] Compacting 1@2 + 0@2 files, score 0.00 slots available 0
(Original Log Time 2014/12/14-18:04:06.824521) [default] Compaction start summary: Base version 2 Base level 2, seek compaction:0, inputs: [5(530B)]
Table was constructed:
[basic properties]: # data blocks=1; # entries=1; raw key size=29; raw average key size=29.000000; raw value size=33; raw average value size=33.000000; data block size=78; index block size=35; filter block size=0; (estimated) table size=113; filter policy name=N/A;
[user collected properties]: kDeletedKeys=0;
[default] Generated table #7: 1 keys, 530 bytes
(Original Log Time 2014/12/14-18:04:06.825005) [default] Compacted 1@2 + 0@2 files => 530 bytes
(Original Log Time 2014/12/14-18:04:06.825026) [default] compacted to: files[0 0 1 0 0 0 0], 2.3 MB/sec, level 2, files in(1, 0) out(1) MB in(0.0, 0.0) out(0.0), read-write-amplify(2.0) write-amplify(1.0) OK
Delete /tmp/rocksdb_test235965642/000005.sst type=2 #5 -- OK
[default] New memtable created with log file: #4
(Original Log Time 2014/12/14-18:04:06.825234) BackgroundCallFlush doing FlushMemTableToOutputFile with column family [default], flush slots available 0
[default] Flushing memtable with next log file: 4
[default] Level-0 flush table #8: started
[default] Level-0 flush table #8: 0 bytes OK
(Original Log Time 2014/12/14-18:04:06.825259) [default] Level-0 commit table #8 started
(Original Log Time 2014/12/14-18:04:06.825273) [default] Level-0 commit table #8: memtable #1 done
(Original Log Time 2014/12/14-18:04:06.825277) [default] Level summary: files[0 0 1 0 0 0 0]
[default] Manual compaction starting
(Original Log Time 2014/12/14-18:04:06.825303) [default] Manual compaction from level-0 to level-1 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.825304) Compaction nothing to do
[default] Manual compaction starting
(Original Log Time 2014/12/14-18:04:06.825325) [default] Manual compaction from level-1 to level-2 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.825326) Compaction nothing to do
[default] Manual compaction starting
(Original Log Time 2014/12/14-18:04:06.825351) [default] Manual compaction from level-2 to level-2 from (begin) .. (end); will stop at (end)
(Original Log Time 2014/12/14-18:04:06.825353) [default] Compacting 1@2 + 0@2 files, score 0.00 slots available 0
(Original Log Time 2014/12/14-18:04:06.825356) [default] Compaction start summary: Base version 4 Base level 2, seek compaction:0, inputs: [7(530B)]
(Original Log Time 2014/12/14-18:04:06.825389) [default] Compacted 1@2 + 0@2 files => 0 bytes
(Original Log Time 2014/12/14-18:04:06.825401) [default] compacted to: files[0 0 0 0 0 0 0], 29.4 MB/sec, level 2, files in(1, 0) out(0) MB in(0.0, 0.0) out(0.0), read-write-amplify(1.0) write-amplify(0.0) OK
Delete /tmp/rocksdb_test235965642/000007.sst type=2 #7 -- OK
0: average scan: 1.17722ms
1: average scan: 2.710491ms
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
I1214 18:04:06.973702 13568 retry.go:93] Put failed; retrying immediately
I1214 18:04:06.979476 13568 kv.go:126] failed InternalPushTxn: txn "test" {id=key-1d113a63c-f2df-4400-8b9a-48c44ff6f9d8 pri=1, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,13 orig=0.000000000,13 max=0.000000000,13} failed to push "test" {id=key-186ea524f-bdc2-42a6-aedc-dcccdfedd336 pri=2, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,14 orig=0.000000000,14 max=0.000000000,14}
I1214 18:04:06.980341 13568 kv.go:126] failed InternalPushTxn: txn "test" {id=key-1d113a63c-f2df-4400-8b9a-48c44ff6f9d8 pri=1, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,13 orig=0.000000000,13 max=0.000000000,13} failed to push "test" {id=key-186ea524f-bdc2-42a6-aedc-dcccdfedd336 pri=2, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,14 orig=0.000000000,14 max=0.000000000,14}
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
I1214 18:04:06.989734 13568 retry.go:93] Increment failed; retrying immediately
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:06 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:06 method Start has wrong number of ins: 1
2014/12/14 18:04:06 method Stop has wrong number of ins: 1
2014/12/14 18:04:06 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:06 method Validate has wrong number of ins: 1
2014/12/14 18:04:06 raft: 1 became follower at term 0
2014/12/14 18:04:06 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:06 raft: 1 is starting a new election at term 0
2014/12/14 18:04:06 raft: 1 became candidate at term 1
2014/12/14 18:04:06 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:06 raft: 1 became leader at term 1
I1214 18:04:07.002446 13568 retry.go:93] Get failed; retrying immediately
I1214 18:04:07.006253 13568 retry.go:93] Get failed; retrying immediately
I1214 18:04:07.010355 13568 kv.go:126] failed InternalPushTxn: txn "test" {id=key-20a553285-fde8-4efe-b616-eb865bfd9f88 pri=1, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,27 orig=0.000000000,27 max=0.000000000,27} failed to push "test" {id=key-2abd04ce3-691e-477e-8b5a-6586b2723829 pri=2, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,28 orig=0.000000000,28 max=0.000000000,28}
I1214 18:04:07.010603 13568 retry.go:100] Get failed; retrying in 1ms
I1214 18:04:07.013228 13568 kv.go:126] failed InternalPushTxn: txn "test" {id=key-20a553285-fde8-4efe-b616-eb865bfd9f88 pri=1, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,27 orig=0.000000000,27 max=0.000000000,27} failed to push "test" {id=key-2abd04ce3-691e-477e-8b5a-6586b2723829 pri=2, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=0.000000000,28 orig=0.000000000,28 max=0.000000000,28}
I1214 18:04:07.019607 13568 retry.go:93] Get failed; retrying immediately
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.033843 13568 retry.go:93] Get failed; retrying immediately
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.048778 13568 retry.go:93] Get failed; retrying immediately
I1214 18:04:07.050694 13568 retry.go:93] Put failed; retrying immediately
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.294219 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "a"
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.327464 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "a"
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.370031 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "m"
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.405993 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "\x01"
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:07.515656 13568 range.go:1339] initiating a split of range 2 "\x01"-"\xff..." at key "Z"
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
2014/12/14 18:04:07 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:07 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:07 method Start has wrong number of ins: 1
2014/12/14 18:04:07 method Stop has wrong number of ins: 1
2014/12/14 18:04:07 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:07 method Validate has wrong number of ins: 1
2014/12/14 18:04:07 raft: 1 became follower at term 0
2014/12/14 18:04:07 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:07 raft: 1 is starting a new election at term 0
2014/12/14 18:04:07 raft: 1 became candidate at term 1
2014/12/14 18:04:07 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:07 raft: 1 became leader at term 1
I1214 18:04:08.089724 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "testVeMMrhIlhhRzGdXntnhtUZsvDFHmmDBwtKqNhAakqsgWuNxQepgoTHndyNkWKpINvmtBihGqSebhwdmukxAZoZcbnpQLWkTvvmGB"
W1214 18:04:08.163199 13568 txn_coord_sender.go:135] failed to cleanup "\x00\x00\x00rng-" intent: key range "\x00\x00\x00rng-"-"" could not be located within a range on store
W1214 18:04:08.163298 13568 txn_coord_sender.go:135] failed to cleanup "\x00\x00\x00rng-testVeMMrhIlhhRzGdXntnhtUZsvDFHmmDBwtKqNhAakqsgWuNxQepgoTHndyNkWKpINvmtBihGqSebhwdmukxAZoZcbnpQLWkTvvmGB" intent: key range "\x00\x00\x00rng-testVeMMrhIlhhRzGdXntnhtUZsvDFHmmDBwtKqNhAakqsgWuNxQepgoTHndyNkWKpINvmtBihGqSebhwdmukxAZoZcbnpQLWkTvvmGB"-"" could not be located within a range on store
W1214 18:04:08.163431 13568 txn_coord_sender.go:135] failed to cleanup "\x00\x00meta1\xff..." intent: key range "\x00\x00meta1\xff..."-"" could not be located within a range on store
W1214 18:04:08.163502 13568 txn_coord_sender.go:135] failed to cleanup "\x00\x00meta2testVeMMrhIlhhRzGdXntnhtUZsvDFHmmDBwtKqNhAakqsgWuNxQepgoTHndyNkWKpINvmtBihGqSebhwdmukxAZoZcbnpQLWkTvvmGB" intent: key range "\x00\x00meta2testVeMMrhIlhhRzGdXntnhtUZsvDFHmmDBwtKqNhAakqsgWuNxQepgoTHndyNkWKpINvmtBihGqSebhwdmukxAZoZcbnpQLWkTvvmGB"-"" could not be located within a range on store
W1214 18:04:08.163599 13568 txn_coord_sender.go:135] failed to cleanup "\x00\x00meta2\xff..." intent: key range "\x00\x00meta2\xff..."-"" could not be located within a range on store
I1214 18:04:08.164031 13568 kv.go:126] failed EndTransaction: key range "ea32ed0f-f624-4b7f-b2d7-c9b561475914"-"" could not be located within a range on store
I1214 18:04:08.164118 13568 kv.go:126] failed EndTransaction: key range "ea32ed0f-f624-4b7f-b2d7-c9b561475914"-"" could not be located within a range on store
E1214 18:04:08.164162 13568 kv.go:266] failure aborting transaction: key range "ea32ed0f-f624-4b7f-b2d7-c9b561475914"-"" could not be located within a range on store; abort caused by: key range "ea32ed0f-f624-4b7f-b2d7-c9b561475914"-"" could not be located within a range on store
2014/12/14 18:04:08 method ChangeGroupMembership has wrong number of ins: 5
2014/12/14 18:04:08 method CreateGroup reply type not a pointer: []uint64
2014/12/14 18:04:08 method Start has wrong number of ins: 1
2014/12/14 18:04:08 method Stop has wrong number of ins: 1
2014/12/14 18:04:08 method SubmitCommand has wrong number of ins: 4
2014/12/14 18:04:08 method Validate has wrong number of ins: 1
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.171819 13568 store.go:418] splitting range ""-"\xff..." at keys [db4 db5]
I1214 18:04:08.174804 13568 store_split_test.go:421] wrote updated configs
I1214 18:04:08.178007 13568 range.go:1339] initiating a split of range 1 ""-"\xff..." at key "db4"
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.195617 13568 range.go:1339] initiating a split of range 2 "db4"-"\xff..." at key "db5"
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.207712 13568 retry.go:93] Scan failed; retrying immediately
I1214 18:04:08.208772 13568 store.go:418] splitting range ""-"db4" at keys [db3]
I1214 18:04:08.208922 13568 range.go:1339] initiating a split of range 1 ""-"db4" at key "db3"
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.239326 13568 retry.go:93] Scan failed; retrying immediately
I1214 18:04:08.239855 13568 store.go:418] splitting range ""-"db3" at keys [db1 db2]
I1214 18:04:08.239960 13568 range.go:1339] initiating a split of range 1 ""-"db3" at key "db1"
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.263121 13568 retry.go:93] Scan failed; retrying immediately
I1214 18:04:08.263904 13568 range.go:1339] initiating a split of range 5 "db1"-"db3" at key "db2"
2014/12/14 18:04:08 raft: 1 became follower at term 0
2014/12/14 18:04:08 raft: newRaft 1 [peers: [], term: 0, commit: 0, lastindex: 0, lastterm: 0]
2014/12/14 18:04:08 raft: 1 is starting a new election at term 0
2014/12/14 18:04:08 raft: 1 became candidate at term 1
2014/12/14 18:04:08 raft: 1 received vote from 1 at term 1
2014/12/14 18:04:08 raft: 1 became leader at term 1
I1214 18:04:08.274171 13568 retry.go:93] Put failed; retrying immediately
from cockroach.
Related Issues (20)
- kv/kvserver: TestNodeLivenessRetryAmbiguousResultError failed HOT 1
- Sentry: error.go:89: unexpected error from the vectorized engine: × (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.C... HOT 1
- Sentry: error.go:89: unexpected error from the vectorized engine: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Inbox).Next.func1 | git... HOT 1
- Sentry: error.go:89: unexpected error from the vectorized engine: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Inbox).Next.func1 | git... HOT 1
- Sentry: error.go:89: unexpected error from the vectorized engine: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/colflow/colrpc.(*Inbox).Next.func1 | git... HOT 1
- o11y: problem ranges page doesn't load with large number of ranges
- Sentry: error.go:89: unexpected error from the vectorized engine: × (1) assertion failure Wraps: (2) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql/colexecerror.C... HOT 1
- roachtest: jepsen/register/strobe-skews failed [missing required dependencies] HOT 2
- sql: TestTrackOnlyUserOpenTransactionsAndActiveStatements failed HOT 1
- rpc: TestClockOffsetInPingRequest is flaky
- workload/schemachange: populate DEFAULT expressions for input parameters of routines
- backupccl: probable flake in TestDataDriven_import_epoch HOT 1
- observability: increase Go runtime scheduling latency histogram max
- changefeedccl: support changefeeds on drt cluster HOT 1
- changefeedccl: add scale roachtest HOT 1
- sql: using wildcard to display grants for all schemas of a database
- roachtest: retry `cockroach` download HOT 6
- raft/rafttest: TestBasicProgress failed
- kv/kvnemesis: TestKVNemesisSingleNode_ReproposalChaos failed HOT 1
- stats: consider truncating deeply-nested json objects used as upper bounds
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cockroach.