Skip to content

Instantly share code, notes, and snippets.

@benesch

benesch/log.log

Created December 11, 2018 21:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save benesch/bcf007990a04928417af55ab22f9fe01 to your computer and use it in GitHub Desktop.
Save benesch/bcf007990a04928417af55ab22f9fe01 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
log.log
=== RUN TestStoreRangeMergeRaftSnapshot
I181211 06:35:27.048012 37049 gossip/gossip.go:391 [n1] NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:42779" > attrs:<> locality:<> ServerVersion:<major_val:0 minor_val:0 patch:0 unstable:0 > build_tag:"" started_at:0
W181211 06:35:27.054099 37049 gossip/gossip.go:1499 [n2] no incoming or outgoing connections
I181211 06:35:27.054193 37049 gossip/gossip.go:391 [n2] NodeDescriptor set to node_id:2 address:<network_field:"tcp" address_field:"127.0.0.1:38785" > attrs:<> locality:<> ServerVersion:<major_val:0 minor_val:0 patch:0 unstable:0 > build_tag:"" started_at:0
I181211 06:35:27.054397 37020 gossip/client.go:128 [n2] started gossip client to 127.0.0.1:42779
W181211 06:35:27.060978 37049 gossip/gossip.go:1499 [n3] no incoming or outgoing connections
I181211 06:35:27.061057 37049 gossip/gossip.go:391 [n3] NodeDescriptor set to node_id:3 address:<network_field:"tcp" address_field:"127.0.0.1:34059" > attrs:<> locality:<> ServerVersion:<major_val:0 minor_val:0 patch:0 unstable:0 > build_tag:"" started_at:0
I181211 06:35:27.061754 37404 gossip/client.go:128 [n3] started gossip client to 127.0.0.1:42779
I181211 06:35:27.113098 37049 storage/store_snapshot.go:760 [s1,r1/1:/M{in-ax}] sending preemptive snapshot 2e9a15bb at applied index 16
I181211 06:35:27.113321 37049 storage/store_snapshot.go:803 [s1,r1/1:/M{in-ax}] streamed snapshot to (n2,s2):?: kv pairs: 49, log entries: 6, rate-limit: 2.0 MiB/sec, 0.00s
I181211 06:35:27.113730 37185 storage/replica_raftstorage.go:809 [s2,r1/?:{-}] applying preemptive snapshot at index 16 (id=2e9a15bb, encoded size=8344, 1 rocksdb batches, 6 log entries)
I181211 06:35:27.114335 37185 storage/replica_raftstorage.go:815 [s2,r1/?:/M{in-ax}] applied preemptive snapshot in 1ms [clear=0ms batch=0ms entries=0ms commit=0ms]
I181211 06:35:27.114656 37049 storage/replica_command.go:899 [s1,r1/1:/M{in-ax}] change replicas (ADD_REPLICA (n2,s2):2): read existing descriptor r1:/M{in-ax} [(n1,s1):1, next=2, gen=0]
I181211 06:35:27.116273 37049 storage/replica.go:3828 [s1,r1/1:/M{in-ax},txn=c2820d2f] proposing ADD_REPLICA((n2,s2):2): updated=[(n1,s1):1 (n2,s2):2] next=3
I181211 06:35:27.117545 37049 storage/store_snapshot.go:760 [s1,r1/1:/M{in-ax}] sending preemptive snapshot e193353d at applied index 18
I181211 06:35:27.117737 37049 storage/store_snapshot.go:803 [s1,r1/1:/M{in-ax}] streamed snapshot to (n3,s3):?: kv pairs: 52, log entries: 8, rate-limit: 2.0 MiB/sec, 0.00s
I181211 06:35:27.118037 37413 storage/replica_raftstorage.go:809 [s3,r1/?:{-}] applying preemptive snapshot at index 18 (id=e193353d, encoded size=9286, 1 rocksdb batches, 8 log entries)
I181211 06:35:27.118797 37413 storage/replica_raftstorage.go:815 [s3,r1/?:/M{in-ax}] applied preemptive snapshot in 1ms [clear=0ms batch=0ms entries=0ms commit=0ms]
I181211 06:35:27.119340 37049 storage/replica_command.go:899 [s1,r1/1:/M{in-ax}] change replicas (ADD_REPLICA (n3,s3):3): read existing descriptor r1:/M{in-ax} [(n1,s1):1, (n2,s2):2, next=3, gen=0]
I181211 06:35:27.122336 37049 storage/replica.go:3828 [s1,r1/1:/M{in-ax},txn=4cafee75] proposing ADD_REPLICA((n3,s3):3): updated=[(n1,s1):1 (n2,s2):2 (n3,s3):3] next=4
I181211 06:35:27.261499 37049 storage/replica_command.go:349 [s1,r1/1:/M{in-ax}] initiating a split of this range at key "a" [r2]
I181211 06:35:27.562602 37049 storage/replica_command.go:349 [s1,r2/1:{a-/Max}] initiating a split of this range at key "b" [r3]
I181211 06:35:27.571688 37049 storage/replica_command.go:349 [s1,r3/1:{b-/Max}] initiating a split of this range at key "c" [r4]
I181211 06:35:27.579891 37049 storage/replica_command.go:492 [s1,r2/1:{a-b}] initiating a merge of r3:{b-c} [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=1] into this range
I181211 06:35:27.667063 37102 storage/store.go:2561 [s1,r2/1:{a-b},txn=19eb44f4] removing replica r3/1
I181211 06:35:27.667138 37212 storage/store.go:2561 [s2,r2/2:{a-b}] removing replica r3/2
I181211 06:35:27.667997 37049 storage/replica_command.go:492 [s1,r2/1:{a-c}] initiating a merge of r4:{c-/Max} [(n1,s1):1, (n2,s2):2, (n3,s3):3, next=4, gen=0] into this range
I181211 06:35:27.687421 37132 storage/store.go:2561 [s1,r2/1:{a-c},txn=58a6eddb] removing replica r4/1
I181211 06:35:27.687567 37222 storage/store.go:2561 [s2,r2/2:{a-c}] removing replica r4/2
E181211 06:35:27.710276 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:27.710315 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.060355 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.060410 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.160240 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.160275 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.460543 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.460589 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.660302 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.660526 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.860206 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:28.860360 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.160311 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.160364 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.260220 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.260297 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
I181211 06:35:29.310493 37399 gossip/gossip.go:1513 [n3] node has connected to cluster via gossip
I181211 06:35:29.341109 37272 gossip/gossip.go:1513 [n2] node has connected to cluster via gossip
E181211 06:35:29.660373 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.660415 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.660381 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:29.660437 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.060533 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.060838 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.160653 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.160653 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.460444 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.460504 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.660271 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.660413 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.860240 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:30.860436 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.160324 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.160324 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.260387 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.260432 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.660334 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.660380 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.660334 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:31.660405 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.060810 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.060865 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.160253 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.160253 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.460235 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.460304 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.660519 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.660633 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.860382 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:32.860382 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.160479 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.160567 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.260384 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.260402 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.661030 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.661246 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.661652 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:33.661727 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.060317 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.060379 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.160464 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.160524 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.460461 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.460520 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.660567 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.660652 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.860314 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:34.860314 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.160663 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.160734 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.260732 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.260816 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.660532 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.660575 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.660532 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:35.660599 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.060288 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.060445 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.160819 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.160862 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.460687 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.460999 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.660606 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.660677 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.860427 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:36.860432 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.161416 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.161837 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.261018 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.261062 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.660403 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.660455 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.660403 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:37.660483 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.060369 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.060597 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.160379 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.160443 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.460803 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.460821 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.661771 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.661799 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.860354 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:38.860484 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.160289 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.160431 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.260487 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.260514 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.660458 37430 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.660508 37430 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.660533 37280 storage/store.go:3640 [s3,r4/3:{c-/Max}] unable to add to replica GC queue: queue disabled
E181211 06:35:39.660587 37280 storage/store.go:3640 [s3,r3/3:{b-c}] unable to add to replica GC queue: queue disabled
I181211 06:35:39.799857 37049 storage/replica_command.go:349 [s1,r2/1:{a-/Max}] initiating a split of this range at key "d" [r5]; replica r2/3 not caught up: next = 18, match = 0, state = ProgressStateProbe, waiting = true, pendingSnapshot = 0; delayed split for 12.0s to avoid Raft snapshot (without success); r2/3 is being probed (may or may not need a Raft snapshot)
I181211 06:35:39.826038 37337 storage/store.go:2561 [s3,r2/3:{a-b}] removing replica r3/3
I181211 06:35:39.826615 37337 storage/store.go:2561 [s3,r2/3:{a-c}] removing replica r4/3
I181211 06:35:42.668128 37162 storage/compactor/compactor.go:329 [s1,compactor] purging suggested compaction for range "b" - "c" that contains live data
I181211 06:35:42.668169 37162 storage/compactor/compactor.go:329 [s1,compactor] purging suggested compaction for range "c" - /Max that contains live data
I181211 06:35:42.668128 37264 storage/compactor/compactor.go:329 [s2,compactor] purging suggested compaction for range "b" - "c" that contains live data
I181211 06:35:42.668253 37264 storage/compactor/compactor.go:329 [s2,compactor] purging suggested compaction for range "c" - /Max that contains live data
I181211 06:35:42.888371 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:43.888572 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:44.888749 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:45.889019 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:46.889207 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:47.889446 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:48.890432 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:49.892452 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:50.892667 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:51.892874 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:52.893095 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:53.893369 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:54.826463 37381 storage/compactor/compactor.go:329 [s3,compactor] purging suggested compaction for range "b" - "c" that contains live data
I181211 06:35:54.826516 37381 storage/compactor/compactor.go:329 [s3,compactor] purging suggested compaction for range "c" - /Max that contains live data
I181211 06:35:54.893603 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:55.893787 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:56.894050 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:57.894262 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:58.894548 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:35:59.894763 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:00.894962 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:01.895253 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:02.895461 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:03.895686 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:04.895891 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:05.896115 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:06.896334 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:07.896595 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:08.896840 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:09.897122 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:10.897380 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:11.897567 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:12.897781 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:13.897991 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
W181211 06:36:14.551227 37380 storage/store_rebalancer.go:226 [s3,store-rebalancer] StorePool missing descriptor for local store
I181211 06:36:14.898281 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:15.898528 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:16.898815 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:17.898934 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:18.899136 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:19.899320 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:20.899530 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:21.899693 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:22.899883 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
I181211 06:36:23.900094 37049 storage/client_merge_test.go:2865 SucceedsSoon: expected store2 to apply at least 1 additional raft snapshot
W181211 06:36:24.901462 37272 gossip/gossip.go:1499 [n2] no incoming or outgoing connections
W181211 06:36:24.901564 37399 gossip/gossip.go:1499 [n3] no incoming or outgoing connections
--- FAIL: TestStoreRangeMergeRaftSnapshot (57.87s)
client_merge_test.go:2865: condition failed to evaluate within 45s: expected store2 to apply at least 1 additional raft snapshot
goroutine 37049 [running]:
runtime/debug.Stack(0xa7a358200, 0xc420838cc0, 0x2e9afa0)
/usr/local/go/src/runtime/debug/stack.go:24 +0xa7
github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon(0x2ef6120, 0xc4215dc0f0, 0xc420838c90)
/go/src/github.com/cockroachdb/cockroach/pkg/testutils/soon.go:49 +0x10d
github.com/cockroachdb/cockroach/pkg/storage_test.TestStoreRangeMergeRaftSnapshot(0xc4215dc0f0)
/go/src/github.com/cockroachdb/cockroach/pkg/storage/client_merge_test.go:2865 +0xd1c
testing.tRunner(0xc4215dc0f0, 0x2a4ab50)
/usr/local/go/src/testing/testing.go:777 +0xd0
created by testing.(*T).Run
/usr/local/go/src/testing/testing.go:824 +0x2e0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment