Skip to content

Instantly share code, notes, and snippets.

@tamird
Created May 28, 2015 20:51
Show Gist options
  • Save tamird/b4cdde131fe7aa464e92 to your computer and use it in GitHub Desktop.
Save tamird/b4cdde131fe7aa464e92 to your computer and use it in GitHub Desktop.
crash in range_raftstorage.go
[tamird:~/src/go/src/github.com/cockroachdb/cockroach] acceptance-testing(+5/-1) ± docker logs 87a028887dcf
I0528 20:47:10.338175 1 start.go:110] build Vers: go1.4.2
I0528 20:47:10.339152 1 start.go:111] build Tag: alpha-2609-g7d5551f-dirty
I0528 20:47:10.339160 1 start.go:112] build Time: 2015/05/28 20:30:25
I0528 20:47:10.339167 1 start.go:113] build Deps: github.com/biogo/store:e1f74b3c58befe661feed7fa4cf52436de753128 github.com/cockroachdb/c-lz4:6e71f140a365017bbe0904710007f8725fd3f809 github.com/cockroachdb/c-protobuf:9e8dac59ca2a3fc82cd0665ad32b1a36f3df40b8 github.com/cockroachdb/c-rocksdb:e120ce0fb32f86b94188928743270ea11ff016b3 github.com/cockroachdb/c-snappy:618733f9e5bab8463b9049117a335a7a1bfc9fd5 github.com/cockroachdb/cockroach:7d5551f323428df5868f467c0b0c121c7820f904 github.com/coreos/etcd:5d741e4945d7c5f613d37b1be39ae6a8488d27b9 github.com/elazarl/go-bindata-assetfs:bea323321994103859d60197d229f1a94699dde3 github.com/gogo/protobuf:b9e369e8ffb6773efc654ea13594566404314ee1 github.com/inconshreveable/mousetrap:76626ae9c91c4f2a10f34cad8ce83ea42c93bb75 github.com/julienschmidt/httprouter:8c199fb6259ffc1af525cc3ad52ee60ba8359669 github.com/spf13/cobra:8f5946caaeeff40a98d67f60c25e89c3525038a3 github.com/spf13/pflag:b91b2a94780f4e6b4d3b0c12fd9b5f4b05b1aa45 golang.org/x/net:4dbd2a1007ff2b28b172e65b1ced9616645dd2b5 gopkg.in/yaml.v1:9f9df34309c04878acc86042b16630b0f696e1de
I0528 20:47:10.340565 1 context.go:168] initialized 1 storage engine(s)
I0528 20:47:10.340856 1 start.go:122] starting cockroach cluster
E0528 20:47:10.526267 1 gossip.go:367] invalid bootstrap address: &{typ:tcp addr:roach1.local:8080 exhausted:false}, lookup roach1.local: no such host
E0528 20:47:10.537015 1 gossip.go:367] invalid bootstrap address: &{typ:tcp addr:roach2.local:8080 exhausted:false}, lookup roach2.local: no such host
E0528 20:47:10.540238 1 gossip.go:367] invalid bootstrap address: &{typ:tcp addr:roach3.local:8080 exhausted:false}, lookup roach3.local: no such host
E0528 20:47:10.545972 1 gossip.go:367] invalid bootstrap address: &{typ:tcp addr:roach4.local:8080 exhausted:false}, lookup roach4.local: no such host
I0528 20:47:10.547801 1 rocksdb.go:90] opening rocksdb instance at "/data0"
I0528 20:47:10.574882 1 range.go:936] gossiping first range from store 1, range 1
I0528 20:47:10.578147 1 node.go:291] initialized store store=1:1 ([ssd]=/data0): {Capacity:19507089408 Available:12215545856 RangeCount:0 XXX_unrecognized:[]}
I0528 20:47:10.580691 1 gossip.go:165] gossiping node descriptor node_id:"\001" address:<network:"tcp" address:"roach0.local:8080" > attrs:<>
I0528 20:47:10.580884 1 node.go:382] connecting to gossip network to verify cluster ID...
I0528 20:47:10.581097 1 node.go:399] node connected via gossip and verified as part of cluster "b492c535-445a-4f60-96c4-e336031fecc1"
I0528 20:47:10.581160 1 node.go:256] Started node with [[ssd]=/data0] engine(s) and attributes []
I0528 20:47:10.581376 1 server.go:177] starting https server at roach0.local:8080
W0528 20:47:10.589237 1 dist_sender.go:588] failed to invoke Put: the descriptor for the first range is not available via gossip
I0528 20:47:10.589367 1 retry.go:102] routing Put rpc failed; retrying in 250ms
I0528 20:47:10.593602 1 range.go:995] gossiping accounting config from store 1, range 1
I0528 20:47:10.593768 1 range.go:995] gossiping permissions config from store 1, range 1
I0528 20:47:10.594049 1 range.go:995] gossiping zones config from store 1, range 1
E0528 20:47:10.594320 1 split_queue.go:133] unable to fetch zones config from gossip: gossip.go:227: key "zones" does not exist or has expired
I0528 20:47:10.594833 1 range.go:944] gossiping sentinel from store 1, range 1
E0528 20:47:10.781463 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
I0528 20:47:10.918584 1 client.go:150] client roach0.local:8080 connected
I0528 20:47:10.918839 1 client.go:224] client roach0.local:8080 starting heartbeat
E0528 20:47:11.184727 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:11.588745 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:11.990404 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:12.395503 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
I0528 20:47:12.549666 1 server.go:111] gossip: received 2 info(s) from 172.17.0.191:8080
E0528 20:47:12.818151 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
I0528 20:47:12.849569 1 client.go:150] client roach1.local:8080 connected
I0528 20:47:12.849768 1 client.go:224] client roach1.local:8080 starting heartbeat
E0528 20:47:13.210226 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:13.622575 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:14.024363 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
E0528 20:47:14.428034 1 queue.go:262] failure processing range range=1 (""-"\xff\xff") from replicate queue: allocator.go:207: unable to allocate a target store for {[] }
I0528 20:47:14.563834 1 server.go:111] gossip: received 7 info(s) from 172.17.0.191:8080
I0528 20:47:14.901081 1 client.go:150] client roach2.local:8080 connected
I0528 20:47:14.901209 1 client.go:224] client roach2.local:8080 starting heartbeat
panic: range_raftstorage.go:245: failed to get desc: conflicting write intents [{Key:"\x00\x00\x00k\x00\x01rdsc" Txn:"change replicas of 1" {id=d751d638-91ea-41f4-88a2-e946d05ebe02 pri=1579927167, iso=SERIALIZABLE, stat=PENDING, epo=0, ts=1432846034.852988720,0 orig=1432846034.852988720,0 max=1432846035.102988482,0} XXX_unrecognized:[]}]: resolved? false
goroutine 19 [running]:
github.com/coreos/etcd/raft.(*raft).sendAppend(0xc208182000, 0x300000003)
/go/src/github.com/coreos/etcd/raft/raft.go:250 +0x159
github.com/coreos/etcd/raft.stepLeader(0xc208182000, 0x4, 0x100000001, 0x300000003, 0x7, 0x0, 0xa3, 0x0, 0x0, 0x0, ...)
/go/src/github.com/coreos/etcd/raft/raft.go:523 +0x6f3
github.com/coreos/etcd/raft.(*raft).Step(0xc208182000, 0x4, 0x100000001, 0x300000003, 0x7, 0x0, 0xa3, 0x0, 0x0, 0x0, ...)
/go/src/github.com/coreos/etcd/raft/raft.go:487 +0x259
github.com/coreos/etcd/raft.(*multiNode).run(0xc208112840)
/go/src/github.com/coreos/etcd/raft/multinode.go:236 +0xd0b
created by github.com/coreos/etcd/raft.StartMultiNode
/go/src/github.com/coreos/etcd/raft/multinode.go:56 +0xb6
goroutine 1 [select]:
github.com/cockroachdb/cockroach/server/cli.runStart(0x1621fc0, 0xc20800caf0, 0x0, 0x5)
/go/src/github.com/cockroachdb/cockroach/server/cli/start.go:144 +0xda9
github.com/spf13/cobra.(*Command).execute(0x1621fc0, 0xc20800ccd0, 0x5, 0x5, 0x0, 0x0)
/go/src/github.com/spf13/cobra/command.go:495 +0x65c
github.com/spf13/cobra.(*Command).Execute(0x1620280, 0x0, 0x0)
/go/src/github.com/spf13/cobra/command.go:560 +0x18d
github.com/cockroachdb/cockroach/server/cli.Run(0xc20800a010, 0x6, 0x6, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/server/cli/cli.go:111 +0x88
main.main()
/go/src/github.com/cockroachdb/cockroach/main.go:46 +0x29d
goroutine 5 [chan receive]:
github.com/cockroachdb/cockroach/util/log.(*loggingT).flushDaemon(0x166f800)
/go/src/github.com/cockroachdb/cockroach/util/log/clog.go:1030 +0x78
created by github.com/cockroachdb/cockroach/util/log.init·1
/go/src/github.com/cockroachdb/cockroach/util/log/clog.go:619 +0xcc
goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/src/go/src/runtime/asm_amd64.s:2232 +0x1
goroutine 8 [syscall]:
os/signal.loop()
/usr/src/go/src/os/signal/signal_unix.go:21 +0x1f
created by os/signal.init·1
/usr/src/go/src/os/signal/signal_unix.go:27 +0x35
goroutine 34 [select]:
github.com/cockroachdb/cockroach/multiraft.func·008()
/go/src/github.com/cockroachdb/cockroach/multiraft/storage.go:144 +0x90a
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 10 [sleep]:
github.com/cockroachdb/cockroach/rpc.(*RemoteClockMonitor).MonitorRemoteOffsets(0xc20811bde0)
/go/src/github.com/cockroachdb/cockroach/rpc/clock_offset.go:157 +0x82
created by github.com/cockroachdb/cockroach/server.NewServer
/go/src/github.com/cockroachdb/cockroach/server/server.go:105 +0x729
goroutine 11 [select]:
github.com/cockroachdb/cockroach/gossip.func·021()
/go/src/github.com/cockroachdb/cockroach/gossip/server.go:157 +0x134
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 12 [select]:
github.com/cockroachdb/cockroach/gossip.func·004()
/go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:409 +0x1f2
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 13 [select]:
github.com/cockroachdb/cockroach/gossip.func·005()
/go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:434 +0x919
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 14 [select]:
github.com/cockroachdb/cockroach/gossip.func·007()
/go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:505 +0x1c4
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 15 [chan receive]:
github.com/cockroachdb/cockroach/storage.ProcessStoreEvents(0x7f75c191c760, 0xc208119700, 0xc2080296d0)
/go/src/github.com/cockroachdb/cockroach/storage/feed.go:197 +0x61
created by github.com/cockroachdb/cockroach/server/status.(*NodeStatusMonitor).StartMonitorFeed
/go/src/github.com/cockroachdb/cockroach/server/status/monitor.go:99 +0x7f
goroutine 16 [chan receive]:
github.com/cockroachdb/cockroach/server/status.ProcessNodeEvents(0x7f75c191c7c0, 0xc208119700, 0xc2080296e0)
/go/src/github.com/cockroachdb/cockroach/server/status/feed.go:83 +0x61
created by github.com/cockroachdb/cockroach/server/status.(*NodeStatusMonitor).StartMonitorFeed
/go/src/github.com/cockroachdb/cockroach/server/status/monitor.go:100 +0xe2
goroutine 69 [select]:
github.com/cockroachdb/cockroach/rpc.Send(0x1, 0x1, 0x1dcd6500, 0x12a05f200, 0xc20828b710, 0x8, 0xc20828b6f0, 0x1, 0x1, 0xc208203520, ...)
/go/src/github.com/cockroachdb/cockroach/rpc/send.go:176 +0x12c0
github.com/cockroachdb/cockroach/kv.(*DistSender).sendRPC(0xc208108880, 0xc2080ac620, 0x7f75c191dda8, 0xc208224900, 0x7f75c191de00, 0xc208292230, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:478 +0x95a
github.com/cockroachdb/cockroach/kv.func·005(0x7bf8e8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:561 +0x5e1
github.com/cockroachdb/cockroach/util/retry.WithBackoff(0xc20828b6a0, 0xf, 0xee6b280, 0x6fc23ac00, 0x4000000000000000, 0x0, 0x0, 0x0, 0xc20831e2a8, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/util/retry/retry.go:82 +0x60
github.com/cockroachdb/cockroach/kv.(*DistSender).Send(0xc208108880, 0x7f75c191d260, 0xc208028958, 0x7f75c191dda8, 0xc208224900, 0x7f75c191de00, 0xc208292230, 0x0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:634 +0x44c
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendOne(0xc2081320a0, 0x7f75c191dda8, 0xc208224900, 0x7f75c191de00, 0xc208292230, 0x0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:310 +0x26d
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).sendBatch(0xc2081320a0, 0xc2081e6840, 0xc208240680)
/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:436 +0x753
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc2081320a0, 0x7f75c191d260, 0xc208028958, 0x7f75c19247b0, 0xc2081e66e0, 0x7f75c1924808, 0xc208240600, 0x0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:243 +0x345
github.com/cockroachdb/cockroach/client.(*txnSender).Send(0xc2081ae920, 0x7f75c191d260, 0xc208028958, 0x7f75c19247b0, 0xc2081e66e0, 0x7f75c1924808, 0xc208240600, 0x0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/txn.go:34 +0xef
github.com/cockroachdb/cockroach/client.(*KV).Run(0xc2081ae780, 0xc20831ef90, 0x1, 0x1, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/kv.go:109 +0x3fa
github.com/cockroachdb/cockroach/client.(*KV).Run(0xc2081ae780, 0xc2081e6580, 0x4, 0x6, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/kv.go:125 +0x8f8
github.com/cockroachdb/cockroach/client.(*Txn).Flush(0xc2081ae780, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/txn.go:182 +0xba
github.com/cockroachdb/cockroach/storage.func·023(0xc2081ae780, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/storage/range_command.go:1169 +0x5ba
github.com/cockroachdb/cockroach/client.func·006(0x15, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/txn.go:94 +0x80
github.com/cockroachdb/cockroach/util/retry.WithBackoff(0xc208287e80, 0x14, 0x2faf080, 0x12a05f200, 0x4000000000000000, 0x0, 0x1, 0x0, 0xc20831f6b0, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/util/retry/retry.go:82 +0x60
github.com/cockroachdb/cockroach/client.(*Txn).exec(0xc2081ae780, 0xc20831f918, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/txn.go:118 +0xd6
github.com/cockroachdb/cockroach/client.(*KV).RunTransaction(0xc208108900, 0xc208287ec0, 0xc20831f918, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/client/kv.go:161 +0x5c
github.com/cockroachdb/cockroach/storage.(*Range).ChangeReplicas(0xc208082630, 0x0, 0x400000004, 0xc208131c70, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/storage/range_command.go:1170 +0x864
github.com/cockroachdb/cockroach/storage.(*replicateQueue).process(0xc20811a580, 0x13e27de08d3436ca, 0x0, 0x0, 0x0, 0x0, 0xc208082630, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/storage/replicate_queue.go:116 +0x23a
github.com/cockroachdb/cockroach/storage.(*baseQueue).processOne(0xc208112600, 0xc208119540, 0xc2080386c0)
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:261 +0x4dc
github.com/cockroachdb/cockroach/storage.func·013()
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:214 +0x14b
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 20 [select]:
github.com/cockroachdb/cockroach/multiraft.func·005()
/go/src/github.com/cockroachdb/cockroach/multiraft/multiraft.go:493 +0x18ae
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 21 [select]:
github.com/cockroachdb/cockroach/storage.func·038()
/go/src/github.com/cockroachdb/cockroach/storage/store.go:1362 +0xd9f
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 68 [select]:
github.com/cockroachdb/cockroach/storage.func·013()
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:203 +0x2cb
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 67 [select]:
github.com/cockroachdb/cockroach/storage.func·013()
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:203 +0x2cb
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 24 [select]:
github.com/cockroachdb/cockroach/storage.func·030()
/go/src/github.com/cockroachdb/cockroach/storage/store.go:538 +0x337
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 25 [select]:
github.com/cockroachdb/cockroach/storage.func·031()
/go/src/github.com/cockroachdb/cockroach/storage/store.go:557 +0x337
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 96 [IO wait]:
net.(*pollDesc).Wait(0xc2082920d0, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2082920d0, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc208292070, 0xc2082ba000, 0x1000, 0x1000, 0x0, 0x7f75c1915050, 0xc208117e78)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2081661c8, 0xc2082ba000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc20812dad0, 0x7f75c191e848, 0xc2081661c8, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc20824e2c0, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc20824e2c0, 0xc208145000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc208228600)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc208228600, 0x0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc208228600, 0xc208124900, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc20811e820, 0x7f75c19230b8, 0xc20811e970, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).readResponseHeader(0xc20811e820, 0xc20811e970, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:155 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).ReadResponseHeader(0xc20811e820, 0xc20822e6f0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:80 +0x54
net/rpc.(*Client).input(0xc208228660)
/usr/src/go/src/net/rpc/client.go:109 +0xb6
created by net/rpc.NewClientWithCodec
/usr/src/go/src/net/rpc/client.go:201 +0xd0
goroutine 66 [select]:
github.com/cockroachdb/cockroach/storage.func·013()
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:203 +0x2cb
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 70 [select]:
github.com/cockroachdb/cockroach/storage.func·013()
/go/src/github.com/cockroachdb/cockroach/storage/queue.go:203 +0x2cb
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 71 [select]:
github.com/cockroachdb/cockroach/storage.func·027()
/go/src/github.com/cockroachdb/cockroach/storage/scanner.go:186 +0x9af
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 155 [IO wait]:
net.(*pollDesc).Wait(0xc20812a1b0, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20812a1b0, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20812a150, 0xc2081d0c00, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20828a260)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20810e000, 0xc2081d0c00, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc20812c180, 0x7f75c191e848, 0xc20810e000, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc20824e000, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc20824e000, 0xc2081a9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc208228540)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc208228540, 0xc208228540, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc208228540, 0xc2081a9001, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081aa9c0, 0x7f75c19231a8, 0xc2081aab28, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc2081aa9c0, 0xc208228540, 0xc2081aab28, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc2081aa9c0, 0xc208287780, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc2081aa9c0, 0x0, 0x0, 0xc208287780, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc2081aa9c0, 0xc208067780, 0xc2081e05e0, 0xf7f8a0, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc2081aa9c0)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc20824e000)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc208168460, 0xc20816c1a0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc208168460, 0xc20816c1a0)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2080bc0a0)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 28 [select]:
github.com/cockroachdb/cockroach/server.func·006()
/go/src/github.com/cockroachdb/cockroach/server/node.go:443 +0x88f
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 29 [select]:
github.com/cockroachdb/cockroach/server.func·003()
/go/src/github.com/cockroachdb/cockroach/server/node.go:409 +0x136
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 30 [select]:
github.com/cockroachdb/cockroach/ts.func·001()
/go/src/github.com/cockroachdb/cockroach/ts/db.go:76 +0x11d
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
goroutine 31 [IO wait]:
net.(*pollDesc).Wait(0xc2080ac290, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2080ac290, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).accept(0xc2080ac230, 0x0, 0x7f75c1915050, 0xc2082f2308)
/usr/src/go/src/net/fd_unix.go:419 +0x40b
net.(*TCPListener).AcceptTCP(0xc208036120, 0xc2082eca20, 0x0, 0x0)
/usr/src/go/src/net/tcpsock_posix.go:234 +0x4e
net.(*TCPListener).Accept(0xc208036120, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/tcpsock_posix.go:244 +0x4c
crypto/tls.(*listener).Accept(0xc20801cba0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/tls.go:46 +0x6b
net/http.(*Server).Serve(0xc2081133e0, 0x7f75c191c728, 0xc20801cba0, 0x0, 0x0)
/usr/src/go/src/net/http/server.go:1728 +0x92
net/http.Serve(0x7f75c191c728, 0xc20801cba0, 0x7f75c191dbe8, 0xc208108780, 0x0, 0x0)
/usr/src/go/src/net/http/server.go:1606 +0xa1
github.com/cockroachdb/cockroach/rpc.func·002()
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:133 +0x7f
created by github.com/cockroachdb/cockroach/rpc.(*Server).Serve
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:139 +0xb8
goroutine 82 [IO wait]:
net.(*pollDesc).Wait(0xc20810cd10, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20810cd10, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20810ccb0, 0xc2081ea800, 0x800, 0x800, 0x0, 0x7f75c1915050, 0xc2081304d0)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20810e008, 0xc2081ea800, 0x800, 0x800, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc2081208a0, 0x7f75c191e848, 0xc20810e008, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc208070840, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc208070840, 0xc2081d5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc2080c0600)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc2080c0600, 0xf288a0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc2080c0600, 0x0, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc20811e9c0, 0x7f75c19231a8, 0xc20811eb28, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc20811e9c0, 0xc2080c0600, 0xc20811eb28, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc20811e9c0, 0xc20811bd20, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc20811e9c0, 0x0, 0x0, 0xc20811bd20, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc20811e9c0, 0xc208066080, 0xc208222200, 0xf3cd00, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc20811e9c0)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc208070840)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc2081680a0, 0xc2080328f0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc2081680a0, 0xc2080328f0)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2080bc000)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 55 [IO wait]:
net.(*pollDesc).Wait(0xc20812a220, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20812a220, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20812a1c0, 0xc2081d2400, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20828b7c8)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208166158, 0xc2081d2400, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc2081200c0, 0x7f75c191e848, 0xc208166158, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc2081cc000, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc2081cc000, 0xc20816e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc208113200)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc208113200, 0xc208113200, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc208113200, 0xc20816e001, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc20811e1a0, 0x7f75c19231a8, 0xc20811e308, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc20811e1a0, 0xc208113200, 0xc20811e308, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc20811e1a0, 0xc208202b60, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc20811e1a0, 0x0, 0x0, 0xc208202b60, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc20811e1a0, 0xc208067780, 0xc2081e0640, 0xf7f8a0, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc20811e1a0)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc2081cc000)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc208168000, 0xc20816c0d0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc208168000, 0xc20816c0d0)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2081683c0)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 32 [IO wait]:
net.(*pollDesc).Wait(0xc2080ac530, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2080ac530, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2080ac4d0, 0xc2081d0400, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20828b9a0)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208036360, 0xc2081d0400, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc20811d200, 0x7f75c191e848, 0xc208036360, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc2081ca000, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc2081ca000, 0xc2081c6000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc2080c0540)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc2080c0540, 0xff6, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc2080c0540, 0xc20801f880, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081aa1a0, 0x7f75c19230b8, 0xc2081aa2f0, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).readResponseHeader(0xc2081aa1a0, 0xc2081aa2f0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:155 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).ReadResponseHeader(0xc2081aa1a0, 0xc20812c030, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:80 +0x54
net/rpc.(*Client).input(0xc2080c05a0)
/usr/src/go/src/net/rpc/client.go:109 +0xb6
created by net/rpc.NewClientWithCodec
/usr/src/go/src/net/rpc/client.go:201 +0xd0
goroutine 33 [sleep]:
github.com/cockroachdb/cockroach/rpc.(*Client).startHeartbeat(0xc20802efa0)
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:229 +0x109
created by github.com/cockroachdb/cockroach/rpc.func·001
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:154 +0x4c3
goroutine 344 [IO wait]:
net.(*pollDesc).Wait(0xc2080ad020, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc2080ad020, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc2080acfc0, 0xc20820a800, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20831ab00)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc2081664e8, 0xc20820a800, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc2081a28a0, 0x7f75c191e848, 0xc2081664e8, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc20824eb00, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc20824eb00, 0xc2081fd000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
net/http.(*liveSwitchReader).Read(0xc2080bc368, 0xc2081fd000, 0x1000, 0x1000, 0x8, 0x0, 0x0)
/usr/src/go/src/net/http/server.go:214 +0xab
io.(*LimitedReader).Read(0xc208104d00, 0xc2081fd000, 0x1000, 0x1000, 0x1000, 0x0, 0x0)
/usr/src/go/src/io/io.go:408 +0xce
bufio.(*Reader).fill(0xc2082eca20)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadSlice(0xc2082eca20, 0xc2081a290a, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:295 +0x257
bufio.(*Reader).ReadLine(0xc2082eca20, 0x0, 0x0, 0x0, 0xc207fcd400, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:324 +0x62
net/textproto.(*Reader).readLineSlice(0xc20832b9e0, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/textproto/reader.go:55 +0x9e
net/textproto.(*Reader).ReadLine(0xc20832b9e0, 0x0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/textproto/reader.go:36 +0x4f
net/http.ReadRequest(0xc2082eca20, 0xc20828c1a0, 0x0, 0x0)
/usr/src/go/src/net/http/request.go:598 +0xcb
net/http.(*conn).readRequest(0xc2080bc320, 0x0, 0x0, 0x0)
/usr/src/go/src/net/http/server.go:586 +0x26f
net/http.(*conn).serve(0xc2080bc320)
/usr/src/go/src/net/http/server.go:1162 +0x69e
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 497 [chan receive]:
github.com/cockroachdb/cockroach/storage.func·015(0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/storage/range.go:695 +0xb1
github.com/cockroachdb/cockroach/storage.(*Range).addWriteCmd(0xc208082630, 0x7f75c191d2a0, 0xc2082f1da0, 0x7f75c191dda8, 0xc208190300, 0x7f75c191de00, 0xc208292310, 0xc2082f1d01, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/storage/range.go:711 +0x8ea
github.com/cockroachdb/cockroach/storage.(*Range).AddCmd(0xc208082630, 0x7f75c191d2a0, 0xc2082f1da0, 0x7f75c191dda8, 0xc208190300, 0x7f75c191de00, 0xc208292310, 0x0, 0x0, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/storage/range.go:524 +0x4f6
github.com/cockroachdb/cockroach/storage.func·037(0xc20828b860, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/storage/store.go:1159 +0x3b0
github.com/cockroachdb/cockroach/util/retry.WithBackoff(0xc20828b860, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc2082c5860, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/util/retry/retry.go:82 +0x60
github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd(0xc208126000, 0x7f75c191d2a0, 0xc2082f1c50, 0x7f75c191dda8, 0xc208190300, 0x7f75c191de00, 0xc208292310, 0x0, 0x0, 0x0, ...)
/go/src/github.com/cockroachdb/cockroach/storage/store.go:1209 +0x783
github.com/cockroachdb/cockroach/kv.(*LocalSender).Send(0xc20811bec0, 0x7f75c191d2a0, 0xc2082f1c50, 0x7f75c191dda8, 0xc208190300, 0x7f75c191de00, 0xc208292310, 0x0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/kv/local_sender.go:150 +0x1cd
github.com/cockroachdb/cockroach/server.(*nodeServer).executeCmd(0xc208134000, 0x7f75c191dda8, 0xc208190300, 0x7f75c191de00, 0xc208292310, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/server/node.go:523 +0xd3
github.com/cockroachdb/cockroach/server.(*nodeServer).Put(0xc208134000, 0xc208190300, 0xc208292310, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/server/node.go:542 +0xb1
reflect.Value.call(0xe6f280, 0xf80120, 0x13, 0xfa7c30, 0x4, 0xc2082c5f28, 0x3, 0x3, 0x0, 0x0, ...)
/usr/src/go/src/reflect/value.go:419 +0x10e5
reflect.Value.Call(0xe6f280, 0xf80120, 0x13, 0xc2082c5f28, 0x3, 0x3, 0x0, 0x0, 0x0)
/usr/src/go/src/reflect/value.go:296 +0xbc
net/rpc.(*service).call(0xc20803c240, 0xc208119580, 0xc208130260, 0xc208067780, 0xc2081e0640, 0xf7f8a0, 0xc208190300, 0x16, 0xf6d1e0, 0xc208292310, ...)
/usr/src/go/src/net/rpc/server.go:382 +0x1f7
created by net/rpc.(*Server).ServeCodec
/usr/src/go/src/net/rpc/server.go:476 +0x44a
goroutine 618 [select]:
github.com/cockroachdb/cockroach/server.(*rpcTransport).processQueue(0xc20811c9f0, 0x300000003)
/go/src/github.com/cockroachdb/cockroach/server/raft_transport.go:161 +0xebd
created by github.com/cockroachdb/cockroach/server.(*rpcTransport).Send
/go/src/github.com/cockroachdb/cockroach/server/raft_transport.go:205 +0x13e
goroutine 103 [IO wait]:
net.(*pollDesc).Wait(0xc20800b560, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20800b560, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20800b500, 0xc2081d3000, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20828ad30)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208166938, 0xc2081d3000, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc20812c4e0, 0x7f75c191e848, 0xc208166938, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc2081ccb00, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc2081ccb00, 0xc2081a7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc2080c04e0)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc2080c04e0, 0x4, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc2080c04e0, 0xc2082f10b0, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081abba0, 0x7f75c19231a8, 0xc2081abd08, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc2081abba0, 0xc2080c04e0, 0xc2081abd08, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc2081abba0, 0xc208202ba0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc2081abba0, 0x0, 0x0, 0xc208202ba0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc2081abba0, 0xc208108980, 0xc208202b60, 0xf4dd60, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc2081abba0)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc2081ccb00)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc20814c0a0, 0xc2081c2000)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc20814c0a0, 0xc2081c2000)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2081681e0)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 112 [IO wait]:
net.(*pollDesc).Wait(0xc20810ced0, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20810ced0, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20810ce70, 0xc2081d3800, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc208206078)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc208166240, 0xc2081d3800, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc2082205d0, 0x7f75c191e848, 0xc208166240, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc2081cd8c0, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc2081cd8c0, 0xc2081ad000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc2080c08a0)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc2080c08a0, 0x4, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc2080c08a0, 0xc2081a3350, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081aa820, 0x7f75c19231a8, 0xc2081aa988, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc2081aa820, 0xc2080c08a0, 0xc2081aa988, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc2081aa820, 0xc2081c0560, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc2081aa820, 0x0, 0x0, 0xc2081c0560, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc2081aa820, 0xc208108980, 0xc2081c05c0, 0xf4dd60, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc2081aa820)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc2081cd8c0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc208168280, 0xc2081c20d0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc208168280, 0xc2081c20d0)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc20814c140)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 201 [sleep]:
github.com/cockroachdb/cockroach/rpc.(*Client).startHeartbeat(0xc20802e1e0)
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:229 +0x109
created by github.com/cockroachdb/cockroach/rpc.func·001
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:154 +0x4c3
goroutine 518 [semacquire]:
sync.(*Cond).Wait(0xc208119640)
/usr/src/go/src/sync/cond.go:62 +0x9e
github.com/cockroachdb/cockroach/gossip.(*server).Gossip(0xc208119600, 0xc20807fc30, 0xc2082d6840, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/gossip/server.go:118 +0xb1d
reflect.Value.call(0xe680c0, 0xf22c40, 0x13, 0xfa7c30, 0x4, 0xc208199f28, 0x3, 0x3, 0x0, 0x0, ...)
/usr/src/go/src/reflect/value.go:419 +0x10e5
reflect.Value.Call(0xe680c0, 0xf22c40, 0x13, 0xc208199f28, 0x3, 0x3, 0x0, 0x0, 0x0)
/usr/src/go/src/reflect/value.go:296 +0xbc
net/rpc.(*service).call(0xc20803c200, 0xc208119580, 0xc208130238, 0xc208066080, 0xc208222200, 0xf3cd00, 0xc20807fc30, 0x16, 0xf22d20, 0xc2082d6840, ...)
/usr/src/go/src/net/rpc/server.go:382 +0x1f7
created by net/rpc.(*Server).ServeCodec
/usr/src/go/src/net/rpc/server.go:476 +0x44a
goroutine 126 [select]:
github.com/cockroachdb/cockroach/server.(*rpcTransport).processQueue(0xc20811c9f0, 0x200000002)
/go/src/github.com/cockroachdb/cockroach/server/raft_transport.go:161 +0xebd
created by github.com/cockroachdb/cockroach/server.(*rpcTransport).Send
/go/src/github.com/cockroachdb/cockroach/server/raft_transport.go:205 +0x13e
goroutine 254 [IO wait]:
net.(*pollDesc).Wait(0xc20812ab50, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20812ab50, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20812aaf0, 0xc20820a400, 0x400, 0x400, 0x0, 0x7f75c1915050, 0xc20828a768)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20814e390, 0xc20820a400, 0x400, 0x400, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc208250480, 0x7f75c191e848, 0xc20814e390, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc208070000, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc208070000, 0xc208268000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc208232d80)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc208232d80, 0xc208232d80, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc208232d80, 0xc208268001, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081aa000, 0x7f75c19231a8, 0xc2081aa168, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).readRequestHeader(0xc2081aa000, 0xc208232d80, 0xc2081aa168, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:173 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*serverCodec).ReadRequestHeader(0xc2081aa000, 0xc2081e05e0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/server.go:60 +0x6e
net/rpc.(*Server).readRequestHeader(0xc208119580, 0x7f75c1923238, 0xc2081aa000, 0x0, 0x0, 0xc2081e05e0, 0x0, 0x0, 0x0)
/usr/src/go/src/net/rpc/server.go:575 +0x97
net/rpc.(*Server).readRequest(0xc208119580, 0x7f75c1923238, 0xc2081aa000, 0xc208067780, 0xc2081c05c0, 0xf7f8a0, 0x0, 0x0, 0x0, 0x0, ...)
/usr/src/go/src/net/rpc/server.go:542 +0xa2
net/rpc.(*Server).ServeCodec(0xc208119580, 0x7f75c1923238, 0xc2081aa000)
/usr/src/go/src/net/rpc/server.go:461 +0x6d
github.com/cockroachdb/cockroach/rpc.(*Server).serveConn(0xc208108780, 0x7f75c191e720, 0xc208070000)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:213 +0x88
github.com/cockroachdb/cockroach/rpc.(*Server).ServeHTTP(0xc208108780, 0x7f75c1922f60, 0xc2080bc1e0, 0xc2081104e0)
/go/src/github.com/cockroachdb/cockroach/rpc/server.go:103 +0x3b6
net/http.serverHandler.ServeHTTP(0xc2081133e0, 0x7f75c1922f60, 0xc2080bc1e0, 0xc2081104e0)
/usr/src/go/src/net/http/server.go:1703 +0x19a
net/http.(*conn).serve(0xc2080bc140)
/usr/src/go/src/net/http/server.go:1204 +0xb57
created by net/http.(*Server).Serve
/usr/src/go/src/net/http/server.go:1751 +0x35e
goroutine 587 [IO wait]:
net.(*pollDesc).Wait(0xc20810ce60, 0x72, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:84 +0x47
net.(*pollDesc).WaitRead(0xc20810ce60, 0x0, 0x0)
/usr/src/go/src/net/fd_poll_runtime.go:89 +0x43
net.(*netFD).Read(0xc20810ce00, 0xc2082d0000, 0x1000, 0x1000, 0x0, 0x7f75c1915050, 0xc208206008)
/usr/src/go/src/net/fd_unix.go:242 +0x40f
net.(*conn).Read(0xc20810e3a0, 0xc2082d0000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/net/net.go:121 +0xdc
crypto/tls.(*block).readFromUntil(0xc2081a2fc0, 0x7f75c191e848, 0xc20810e3a0, 0x5, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:454 +0xe6
crypto/tls.(*Conn).readRecord(0xc208070580, 0x17, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:539 +0x2da
crypto/tls.(*Conn).Read(0xc208070580, 0xc208194000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/src/go/src/crypto/tls/conn.go:904 +0x166
bufio.(*Reader).fill(0xc2082284e0)
/usr/src/go/src/bufio/bufio.go:97 +0x1ce
bufio.(*Reader).ReadByte(0xc2082284e0, 0x0, 0x0, 0x0)
/usr/src/go/src/bufio/bufio.go:196 +0x86
encoding/binary.ReadUvarint(0x7f75c19230f0, 0xc2082284e0, 0x1670240, 0x0, 0x0)
/usr/src/go/src/encoding/binary/varint.go:110 +0x5b
github.com/cockroachdb/cockroach/rpc/codec.(*baseConn).recvProto(0xc2081aaea0, 0x7f75c19230b8, 0xc2081aaff0, 0x0, 0x113dce8, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/conn.go:91 +0x76
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).readResponseHeader(0xc2081aaea0, 0xc2081aaff0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:155 +0x86
github.com/cockroachdb/cockroach/rpc/codec.(*clientCodec).ReadResponseHeader(0xc2081aaea0, 0xc20812cff0, 0x0, 0x0)
/go/src/github.com/cockroachdb/cockroach/rpc/codec/client.go:80 +0x54
net/rpc.(*Client).input(0xc2082285a0)
/usr/src/go/src/net/rpc/client.go:109 +0xb6
created by net/rpc.NewClientWithCodec
/usr/src/go/src/net/rpc/client.go:201 +0xd0
goroutine 496 [select]:
github.com/cockroachdb/cockroach/rpc.sendOne(0xc20802efa0, 0x12a05f200, 0xc20828b710, 0x8, 0xf7f8a0, 0xc208224900, 0xf6d1e0, 0xc2082922a0, 0xc2082320c0)
/go/src/github.com/cockroachdb/cockroach/rpc/send.go:235 +0x9af
created by github.com/cockroachdb/cockroach/rpc.Send
/go/src/github.com/cockroachdb/cockroach/rpc/send.go:173 +0x1578
goroutine 588 [sleep]:
github.com/cockroachdb/cockroach/rpc.(*Client).startHeartbeat(0xc20802e640)
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:229 +0x109
created by github.com/cockroachdb/cockroach/rpc.func·001
/go/src/github.com/cockroachdb/cockroach/rpc/client.go:154 +0x4c3
goroutine 495 [select]:
github.com/cockroachdb/cockroach/kv.func·013()
/go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:532 +0x9d9
github.com/cockroachdb/cockroach/util.func·001()
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:75 +0x51
created by github.com/cockroachdb/cockroach/util.(*Stopper).RunWorker
/go/src/github.com/cockroachdb/cockroach/util/stopper.go:76 +0xe3
[tamird:~/src/go/src/github.com/cockroachdb/cockroach] acceptance-testing(+5/-1) ±
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment