Skip to content

Instantly share code, notes, and snippets.

@tleyden
Created October 7, 2017 00:03
Show Gist options
  • Save tleyden/ef4ce9ed67dee5c12a745de8b565842d to your computer and use it in GitHub Desktop.
Save tleyden/ef4ce9ed67dee5c12a745de8b565842d to your computer and use it in GitHub Desktop.
tleyden_macbook:sync_gateway tleyden$ SG_TEST_BACKING_STORE=Couchbase SG_TEST_COUCHBASE_SERVER_URL=http://localhost:8091 SG_TEST_USE_XATTRS=false ./test.sh -run TestReproduceTestResidue
Testing code with 'go test' ...
Running Sync Gateway unit tests
? github.com/couchbase/sync_gateway [no test files]
PASS
ok github.com/couchbase/sync_gateway/auth 0.011s
PASS
ok github.com/couchbase/sync_gateway/base 0.011s
PASS
ok github.com/couchbase/sync_gateway/channels 0.012s
=== RUN TestReproduceTestResidue
2017-10-06 17:00:48.961100 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:48.961280 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:48.961290 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:48.961304 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:48.961312 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:48.965978 I | Flushing test bucket: test_data_bucket
2017-10-06T17:00:49.427-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:49.932-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:50.439-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06 17:00:50.945225 I | workerReadOwnWrites completed without errors
2017-10-06T17:00:50.945-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:00:51.052-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:51.052-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:51.053-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:00:51.053-07:00 WARNING: Using DCP Logging Receiver. Receiver: 1 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:00:51.053-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:00:51.054327 I | bucketDataSource.Start() called
_time=2017-10-06T17:00:51.068-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:00:51.176705 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.176-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:00:51.177014 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.177-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:00:51.177-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.177-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:00:51.177-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.177-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:00:51.177-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.177-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:00:51.177-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06T17:00:51.177-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:00:51.177-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:00:51.177-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:00:51.177-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:00:51.177366 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.177572 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.177-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:00:51.177-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:00:51.177-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:00:51.177-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:00:51.177-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:51.178-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:00:51.178-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc4203a5ec0 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:00:51.178-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.178-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:00:51.178-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:00:51.178-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.178-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.178-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.178-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:51.178-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.178-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.178-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.178-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:00:51.178-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.185-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:00:51.185-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:00:51.185-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:00:51.185-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:00:51.185-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:00:51.185-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.185-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.185-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:00:51.185-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:51.185-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.185-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.185-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:51.185-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:00:51.185-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.185-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:51.185-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:51.185-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:00:51.185-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:00:51.185-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.185-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.185-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.185-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.185-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:00:51.185-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:51.228266 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.228718 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.229-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:00:51.229-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:00:51.229-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:00:51.229-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:00:51.229-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:00:51.229-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:00:51.229-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.229-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.229-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:51.229-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.229-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:51.229-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.229-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.229-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.229-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.229-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.229-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.229-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.229-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:00:51.229-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:00:51.229-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.229-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:00:51.236-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:00:51.236-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:00:51.236-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:00:51.236-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.236-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.236-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:51.236-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.236-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.236-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:00:51.236-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:51.236-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:51.236-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.236-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.236-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:00:51.236-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.236-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.236-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.236-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:00:51.236-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.329-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:00:51.329467 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.329941 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.330-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:00:51.330-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:00:51.330-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:00:51.330-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:00:51.330-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:00:51.330-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:00:51.330-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:00:51.330-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:00:51.330-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:00:51.330-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.330-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.330-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06 17:00:51.330429 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.330-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.330-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.330-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.330-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.330-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:00:51.330-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.330-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:00:51.330-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:00:51.330-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:00:51.330-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:00:51.330-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:00:51.330-07:00 Cache: #7 ==> channel "NBC"
2017-10-06 17:00:51.330803 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:51.330-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:00:51.330-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:00:51.330-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:00:51.330-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.330-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.330-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.330-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:51.330-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.331-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.331-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.331-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:00:51.331-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:00:51.331-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.331-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.331-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:00:51.331-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.331-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:00:51.331-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:00:51.331-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.331-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:00:51.331-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:00:51.331-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:00:51.332-07:00 Cache: Received #13 after 1ms ("doc-13" / "1-a")
2017-10-06T17:00:51.332-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:00:51.332-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:00:51.332-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:00:51.332-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.332-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:00:51.332-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.332-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:51.332-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:51.332-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.332-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:00:51.332-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:00:51.332-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.332-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.332-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:00:51.332-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:51.332-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:51.332-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:51.332-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.332-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:51.333-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.333-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.333-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:00:51.333-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:51.333-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:51.333-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:51.333-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:51.333-07:00 Cache: getCachedChanges("!", 13) --> 0 changes valid from #1
2017-10-06T17:00:51.333-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:51.333-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:51.333-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:51.333-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:51.333-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:51.333-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:00:51.333-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:51.432-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:00:51.482565 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482598 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482684 I | Read changes entry: <nil>
2017-10-06 17:00:51.482732 I | Read changes entry: <nil>
2017-10-06 17:00:51.482760 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482776 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482812 I | Read changes entry: <nil>
2017-10-06 17:00:51.482838 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482866 I | Read changes entry: <nil>
2017-10-06 17:00:51.482881 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482905 I | Read changes entry: <nil>
2017-10-06 17:00:51.482920 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.482966 I | Read changes entry: <nil>
2017-10-06 17:00:51.482998 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.483046 I | Read changes entry: <nil>
2017-10-06 17:00:51.483080 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:51.483099 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:00:51.483-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:00:51.483-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:00:51.483137 I | ********** dumping stack. # of goroutines: 32
2017-10-06T17:00:51.483-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:51.483-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:00:51.483-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:00:51.483184 I | bucketDataSource.Close() called
2017-10-06T17:00:51.483-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52722->127.0.0.1:11210: use of closed network connection
2017-10-06T17:00:51.483-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52722->127.0.0.1:11210: use of closed network connection. Receiver ID: 1 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:00:51.488892 I | Stack: goroutine 6 [running]:
github.com/couchbase/sync_gateway/db.TestReproduceTestResidue(0xc420096780)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/sync_gateway/db/change_cache_test.go:284 +0x1a6
testing.tRunner(0xc420096780, 0x6dcbc0)
/usr/local/go/src/testing/testing.go:610 +0x81
created by testing.(*T).Run
/usr/local/go/src/testing/testing.go:646 +0x2ec
goroutine 1 [chan receive]:
testing.(*T).Run(0xc4200966c0, 0x630e1e, 0x18, 0x6dcbc0, 0x5e601)
/usr/local/go/src/testing/testing.go:647 +0x316
testing.RunTests.func1(0xc4200966c0)
/usr/local/go/src/testing/testing.go:793 +0x6d
testing.tRunner(0xc4200966c0, 0xc4202ffe20)
/usr/local/go/src/testing/testing.go:610 +0x81
testing.RunTests(0x6dd798, 0xa5ed00, 0x89, 0x89, 0xf96b)
/usr/local/go/src/testing/testing.go:799 +0x2f5
testing.(*M).Run(0xc4202ffee8, 0x0)
/usr/local/go/src/testing/testing.go:743 +0x85
main.main()
github.com/couchbase/sync_gateway/db/_test/_testmain.go:370 +0xc6
goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2086 +0x1
goroutine 20 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4201d2080, 0xf, 0xc4201d5260, 0xc420117c20, 0xc4201b8360)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 10 [semacquire]:
sync.runtime_notifyListWait(0xc420165410, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420165400)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc4201d5080, 0xc4201ae170, 0xc420117c30)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4201ae170, 0xc4201c2420)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4201d5260, 0xc420117c20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4201d5260)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 21 [IO wait]:
net.runtime_pollWait(0x18090f0, 0x72, 0x7)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201978e0, 0x72, 0xc4200409d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201978e0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420197880, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6018, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b600, 0xc4201bb000, 0x1000, 0x1000, 0x30, 0xc420040b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201b83c0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201b83c0, 0x1, 0x0, 0x1, 0x0, 0xc4201b8420, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 11 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420162b60)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 15 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201d8300, 0xc420117c20, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 16 [IO wait]:
net.runtime_pollWait(0x18091b0, 0x72, 0x5)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420197640, 0x72, 0xc420043cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420197640, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201975e0, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343a8, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201d8240)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201d8240, 0xc4201d53c0, 0x18, 0x18, 0x70, 0xc420265880, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc420117bd0, 0xc4201d53c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc420117bd0, 0xc420265880, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc420117c20, 0xc4201d8300, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 22 [select]:
net/http.(*persistConn).writeLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 38 [IO wait]:
net.runtime_pollWait(0x1809030, 0x72, 0x8)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201be290, 0x72, 0xc4200429d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201be290, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201be230, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343f0, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b700, 0xc4201ea000, 0x1000, 0x1000, 0x267ea0, 0xc420042b58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d8a20)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d8a20, 0x1, 0xc420042bbd, 0x1, 0x0, 0xc420212180, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 39 [select]:
net/http.(*persistConn).writeLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 51 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4202d6840, 0xc4201b10e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:261 +0x41b
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4202d6840)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 52 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420278270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 31 [runnable]:
syscall.Syscall(0x6, 0xa, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/syscall/asm_darwin_amd64.s:16 +0x5
syscall.Close(0xa, 0xc420214698, 0xc420036c00)
/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:405 +0x4a
net.(*netFD).destroy(0xc420214690)
/usr/local/go/src/net/fd_unix.go:187 +0x4a
net.(*netFD).readUnlock(0xc420214690)
/usr/local/go/src/net/fd_mutex.go:229 +0x53
net.(*netFD).Read(0xc420214690, 0xc4202c9000, 0x1000, 0x1000, 0x0, 0x8fbd80, 0xc420016a90)
/usr/local/go/src/net/fd_unix.go:254 +0x26b
net.(*conn).Read(0xc4201b6128, 0xc4202c9000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201b9440)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201b9440, 0xc420276840, 0x18, 0x18, 0x70, 0xc4204a6000, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4201b1090, 0xc420276840, 0x18, 0x18, 0xc4204a6060, 0xc42031dec8)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4201b1090, 0xc4204a6000, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4201b10e0, 0xc4201b9500, 0xc4202a6cb0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 32 [select]:
net/http.(*persistConn).readLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 71 [chan receive]:
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).worker.func4(0xc4203a4600, 0xc4202eaa00, 0xc4203a45a0, 0xc42039aa80)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1008 +0xce
created by github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).worker
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1037 +0x4ba
goroutine 30 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201b9500, 0xc4201b10e0, 0xc4202a6cb0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 33 [select]:
net/http.(*persistConn).writeLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 55 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc42020d9c0, 0xf, 0xc4202d6840, 0xc4201b10e0, 0xc420212e40)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 68 [select]:
net/http.(*persistConn).readLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 69 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 58 [select]:
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).refreshCluster(0xc4202eaa00, 0xf)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:642 +0x8d6
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).Start.func1.1(0x1)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:547 +0x2a
github.com/couchbase/go-couchbase/cbdatasource.ExponentialBackoffLoop(0x632ace, 0x1b, 0xc420055f60, 0x64, 0xc43fc00000, 0x3e8)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:2032 +0x35
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).Start.func1(0xc4202eaa00, 0x64, 0x3fc00000, 0x3e8)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:548 +0x7a
created by github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).Start
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:553 +0x1f6
goroutine 59 [chan receive]:
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).refreshWorkers(0xc4202eaa00)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:690 +0x170
created by github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).Start
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:555 +0x218
goroutine 60 [runnable]:
syscall.Syscall(0x4, 0x2, 0xc42016c000, 0x3f, 0x3f, 0x0, 0x0)
/usr/local/go/src/syscall/asm_darwin_amd64.s:16 +0x5
syscall.write(0x2, 0xc42016c000, 0x3f, 0x1000, 0x0, 0x624763, 0x3)
/usr/local/go/src/syscall/zsyscall_darwin_amd64.go:1361 +0x55
syscall.Write(0x2, 0xc42016c000, 0x3f, 0x1000, 0xa57598, 0x8, 0x1)
/usr/local/go/src/syscall/syscall_unix.go:180 +0x49
os.(*File).write(0xc420034018, 0xc42016c000, 0x3f, 0x1000, 0x1a7893, 0xa57590, 0x0)
/usr/local/go/src/os/file_unix.go:249 +0xa8
os.(*File).Write(0xc420034018, 0xc42016c000, 0x3f, 0x1000, 0xc420046c18, 0x4f8401, 0xc4201649c0)
/usr/local/go/src/os/file.go:142 +0x5f
bufio.(*Writer).flush(0xc4201649c0, 0x1000000003c0e82, 0x20)
/usr/local/go/src/bufio/bufio.go:563 +0x75
bufio.(*Writer).Flush(0xc4201649c0, 0x5, 0xc420322840)
/usr/local/go/src/bufio/bufio.go:552 +0x2b
github.com/coreos/pkg/capnslog.(*PrettyFormatter).Flush(0xc42013ce90)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/coreos/pkg/capnslog/formatters.go:106 +0x2e
github.com/coreos/pkg/capnslog.(*PrettyFormatter).Format(0xc42013ce90, 0x0, 0x0, 0xc4201dcd03, 0x5, 0xc42038c790, 0x1, 0x1)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/coreos/pkg/capnslog/formatters.go:102 +0x394
github.com/coreos/pkg/capnslog.(*PackageLogger).internalLog(0xc420160dc0, 0x4, 0xc42038c703, 0xc42038c790, 0x1, 0x1)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/coreos/pkg/capnslog/pkg_logger.go:36 +0xd9
github.com/coreos/pkg/capnslog.packageWriter.Write(0xc420160dc0, 0xc420096900, 0x20, 0xc0, 0xa66500, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/coreos/pkg/capnslog/log_hijack.go:37 +0x102
log.(*Logger).Output(0xc420018190, 0x2, 0xc4203227a0, 0x1f, 0x0, 0x0)
/usr/local/go/src/log/log.go:166 +0x20d
log.Printf(0x635866, 0x1f, 0x0, 0x0, 0x0)
/usr/local/go/src/log/log.go:289 +0x80
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).Close(0xc4202eaa00, 0x5, 0x63fa8e)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1669 +0x55
github.com/couchbase/sync_gateway/base.StartDCPFeed.func1(0xffffffffffffffff, 0x0, 0xc420236400, 0xc420213080, 0x902180, 0xc4202eaa00)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/sync_gateway/base/dcp_feed.go:530 +0xa1
created by github.com/couchbase/sync_gateway/base.StartDCPFeed
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/sync_gateway/base/dcp_feed.go:531 +0x768
goroutine 70 [select]:
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).worker(0xc4202eaa00, 0xc4203e63e0, 0xf, 0xc4203a4360, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1244 +0xc44
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).workerStart.func1.1(0xc42039a9c0)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:819 +0x45
github.com/couchbase/go-couchbase/cbdatasource.ExponentialBackoffLoop(0xc42039a9c0, 0x23, 0xc420301f30, 0x64, 0x3fc00000, 0x3e8)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:2032 +0x35
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).workerStart.func1(0xc4202eaa00, 0xc4203e63e0, 0xf, 0xc4203a4360, 0x64, 0xc43fc00000, 0x3e8)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:820 +0x10a
created by github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).workerStart
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:823 +0xb9
goroutine 64 [IO wait]:
net.runtime_pollWait(0x1808c70, 0x72, 0xd)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c760, 0x72, 0xc42031e9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c760, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c700, 0xc420359000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4202281d0, 0xc420359000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000ba00, 0xc420359000, 0x1000, 0x1000, 0x267ea0, 0xc42031eb58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420213800)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420213800, 0x1, 0xc42031ebbd, 0x1, 0x0, 0xc42030a3c0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 65 [select]:
net/http.(*persistConn).writeLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 72 [IO wait]:
net.runtime_pollWait(0x1808bb0, 0x72, 0xf)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4202a7480, 0x72, 0xc4203cfaf8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4202a7480, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202a7420, 0xc420323b20, 0x18, 0x18, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b61d0, 0xc420323b20, 0x18, 0x18, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
io.ReadAtLeast(0x1840000, 0xc4201b61d0, 0xc420323b20, 0x18, 0x18, 0x18, 0xc42047e205, 0xc4, 0xc4)
/usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1840000, 0xc4201b61d0, 0xc420323b20, 0x18, 0x18, 0xe, 0xc42047e1ff, 0x6)
/usr/local/go/src/io/io.go:325 +0x58
github.com/couchbase/gomemcached.(*MCRequest).Receive(0xc4203e2080, 0x1840000, 0xc4201b61d0, 0xc420323b20, 0x18, 0x18, 0xc4203e2080, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/gomemcached/mc_req.go:141 +0x96
github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).worker.func5(0xc4203a4660, 0xc4202eaa00, 0xc4203e63e0, 0xf, 0xc42021ae00, 0x3a, 0xc42039aa80, 0xc4203e6808, 0xc42039ab10, 0xc4203a45a0, ...)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1098 +0x275
created by github.com/couchbase/go-couchbase/cbdatasource.(*bucketDataSource).worker
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/go-couchbase/cbdatasource/cbdatasource.go:1226 +0x564
2017-10-06 17:00:51.493406 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:51.493418 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.493428 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.493467 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.493473 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:51.495755 I | Flushing test bucket: test_data_bucket
2017-10-06 17:00:51.924095 I | workerReadOwnWrites completed without errors
2017-10-06T17:00:51.924-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:00:52.030-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.030-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.030-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:00:52.030-07:00 WARNING: Using DCP Logging Receiver. Receiver: 2 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:00:52.030-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:00:52.030924 I | bucketDataSource.Start() called
_time=2017-10-06T17:00:52.043-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:00:52.157735 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:52.158082 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.158-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06T17:00:52.158-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:00:52.158-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.158-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:00:52.158-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.158-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:00:52.158-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.158-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:00:52.158-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:00:52.158345 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.158-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:00:52.158-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:00:52.158-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:00:52.158-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:00:52.158613 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.158-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:00:52.158-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:00:52.159-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:00:52.159-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:00:52.159-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.159-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:00:52.159-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc42030a720 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:00:52.159-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.159-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.159-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:00:52.159-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:00:52.159-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.159-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.159-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.159-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.159-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.159-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.159-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:00:52.159-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:52.164-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:00:52.164-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:00:52.164-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:00:52.164-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:00:52.164-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:00:52.164-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.164-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.164-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:00:52.164-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:52.164-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.164-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.164-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:52.164-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:00:52.164-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.164-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:52.164-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:52.164-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:00:52.164-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:00:52.164-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.164-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.164-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.164-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.164-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:00:52.164-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:52.209216 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:52.209686 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.209-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:00:52.209-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:00:52.210-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:00:52.210-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:00:52.210-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:00:52.210-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:00:52.210-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.210-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.210-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:52.210-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.210-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.210-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.210-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:52.210-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.210-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.210-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.210-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.210-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.210-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:00:52.210-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:52.210-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:00:52.210-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:00:52.218-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:00:52.218-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:00:52.218-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:00:52.218-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.218-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.218-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:52.218-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.218-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.218-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.218-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:00:52.218-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:52.218-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:52.218-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.218-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:00:52.218-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.218-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.218-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.218-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:00:52.218-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:52.310-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:00:52.310332 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:52.310783 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.311-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:00:52.311-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:00:52.311-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:00:52.311-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:00:52.311-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:00:52.311-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:00:52.311-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:00:52.311-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:00:52.311-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:00:52.311-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.311-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.311-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06 17:00:52.311252 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.311-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.311-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.311-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.311-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.311-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:00:52.311-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:52.311-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06 17:00:52.311649 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.311-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:00:52.311-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:00:52.311-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:00:52.311-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:00:52.311-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:00:52.311-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:00:52.311-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:00:52.311-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:00:52.311-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.311-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.311-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.311-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:00:52.311-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:00:52.311-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.311-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:00:52.312-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:00:52.312-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:00:52.312-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:00:52.312-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:00:52.312-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.312-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.312-07:00 Changes+: MultiChangesFeed sending {Seq:7::8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.312-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.312-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.312-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:00:52.312-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.312-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.312-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:00:52.312-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:00:52.312-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.312-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:00:52.312-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:00:52.312-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:52.312-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:52.312-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.312-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:52.312-07:00 Changes+: Found sequence later than stable sequence: stable:[12] entry:[13] (doc-13)
2017-10-06T17:00:52.312-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.312-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.312-07:00 Changes+: Sleep 100 ms
2017-10-06T17:00:52.412-07:00 waitForSequence(13) took 100 ms
2017-10-06T17:00:52.413-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.413-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.413-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:52.413-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.413-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:00:52.413-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:00:52.413-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:52.413-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:52.413-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.413-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.413-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:00:52.413-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:52.413-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:52.413-07:00 Cache: getCachedChanges("!", 13) --> 0 changes valid from #1
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:52.413-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:52.413-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:52.413-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:52.413-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:00:52.413-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:52.463339 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463364 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463411 I | Read changes entry: <nil>
2017-10-06 17:00:52.463430 I | Read changes entry: <nil>
2017-10-06 17:00:52.463443 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463452 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463479 I | Read changes entry: <nil>
2017-10-06 17:00:52.463503 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463532 I | Read changes entry: <nil>
2017-10-06 17:00:52.463545 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463564 I | Read changes entry: <nil>
2017-10-06 17:00:52.463575 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463592 I | Read changes entry: <nil>
2017-10-06 17:00:52.463602 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463611 I | Read changes entry: {Seq:7::8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:52.463628 I | Read changes entry: <nil>
2017-10-06 17:00:52.463644 I | Read changes entry: <nil>
2017-10-06 17:00:52.463654 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:00:52.463-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:00:52.463-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:00:52.463684 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:52.463697 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.463-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:52.463-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:00:52.463-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:00:52.463713 I | bucketDataSource.Close() called
2017-10-06 17:00:52.463758 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:52.463768 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:52.463779 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:52.463-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52741->127.0.0.1:11210: use of closed network connection
2017-10-06T17:00:52.463-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52741->127.0.0.1:11210: use of closed network connection. Receiver ID: 2 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:00:52.466697 I | Flushing test bucket: test_data_bucket
2017-10-06 17:00:52.895754 I | workerReadOwnWrites completed without errors
2017-10-06T17:00:52.895-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:00:52.998-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.998-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:52.998-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:00:52.998-07:00 WARNING: Using DCP Logging Receiver. Receiver: 3 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:00:52.998-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:00:52.999524 I | bucketDataSource.Start() called
_time=2017-10-06T17:00:53.011-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:00:53.126030 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:53.126-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06T17:00:53.126-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:00:53.126-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.126-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:00:53.126-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.126-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:00:53.126-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.126-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:00:53.126-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:00:53.126470 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.126667 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:53.126-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:00:53.126-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:00:53.126-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:00:53.126-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:00:53.126838 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:53.126-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:00:53.126-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:00:53.127-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:00:53.127-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:00:53.127-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:53.127-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:00:53.127-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc4204334a0 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:00:53.127-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:00:53.127-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:00:53.127-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.127-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:53.127-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.127-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:53.127-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:53.127-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.127-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.127-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.127-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:00:53.127-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:53.133-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:00:53.133-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:00:53.133-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:00:53.133-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:00:53.133-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:00:53.133-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:53.133-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.133-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:00:53.133-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.133-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:53.133-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:53.133-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:53.133-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.133-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:53.133-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:53.133-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:00:53.133-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:00:53.133-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:00:53.133-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.133-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.133-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.133-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.133-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:00:53.133-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:53.177381 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.177856 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:53.178-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:00:53.178-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:00:53.178-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:00:53.178-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:00:53.178-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:00:53.178-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:00:53.178-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:53.178-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.178-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:53.178-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:53.178-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.178-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.178-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:53.178-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:53.178-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.178-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.178-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.178-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.178-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:00:53.178-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:53.178-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:00:53.178-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:00:53.183-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:00:53.183-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:00:53.183-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:00:53.183-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:53.183-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.183-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:53.183-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:53.183-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.183-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.183-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:00:53.183-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:53.183-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:53.183-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.183-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:00:53.183-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.183-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.183-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.183-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:00:53.183-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:53.278-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:00:53.278634 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.279741 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.280056 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.280331 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:53.288-07:00 Cache: Received #4 after 10ms ("doc-4" / "1-a")
2017-10-06T17:00:53.288-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:00:53.288-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:00:53.288-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:00:53.288-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:00:53.288-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:00:53.288-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:00:53.288-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:00:53.288-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:00:53.288-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:53.288-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.288-07:00 Cache: Received #7 after 9ms ("doc-7" / "1-a")
2017-10-06T17:00:53.288-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:00:53.288-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:00:53.288-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:00:53.288-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:00:53.288-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:00:53.289-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:00:53.289-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:00:53.289-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:00:53.289-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.289-07:00 Cache: Received #8 after 8ms ("doc-8" / "1-a")
2017-10-06T17:00:53.289-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:00:53.289-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:00:53.289-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:00:53.289-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:53.289-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:00:53.289-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:00:53.289-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.289-07:00 Cache: Received #13 after 8ms ("doc-13" / "1-a")
2017-10-06T17:00:53.289-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:00:53.289-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:00:53.289-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed sending {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed sending {Seq:6::8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.289-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:53.289-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:53.289-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:53.289-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:53.289-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:53.289-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:53.289-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:53.289-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:53.289-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:53.289-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:00:53.289-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:53.380-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:00:53.431135 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431168 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431238 I | Read changes entry: <nil>
2017-10-06 17:00:53.431282 I | Read changes entry: <nil>
2017-10-06 17:00:53.431306 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431322 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431348 I | Read changes entry: <nil>
2017-10-06 17:00:53.431363 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431406 I | Read changes entry: <nil>
2017-10-06 17:00:53.431440 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431507 I | Read changes entry: <nil>
2017-10-06 17:00:53.431553 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431574 I | Read changes entry: {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431594 I | Read changes entry: {Seq:6::8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431642 I | Read changes entry: <nil>
2017-10-06 17:00:53.431663 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:53.431677 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:00:53.431-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:00:53.431-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06T17:00:53.431-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:00:53.431760 I | bucketDataSource.Close() called
2017-10-06T17:00:53.431-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:00:53.431-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:00:53.431833 I | ********** dumping stack. # of goroutines: 56
2017-10-06T17:00:53.431-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52760->127.0.0.1:11210: use of closed network connection
2017-10-06T17:00:53.431-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52760->127.0.0.1:11210: use of closed network connection. Receiver ID: 3 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:00:53.435264 I | Stack: goroutine 6 [running]:
github.com/couchbase/sync_gateway/db.TestReproduceTestResidue(0xc420096780)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/sync_gateway/db/change_cache_test.go:284 +0x1a6
testing.tRunner(0xc420096780, 0x6dcbc0)
/usr/local/go/src/testing/testing.go:610 +0x81
created by testing.(*T).Run
/usr/local/go/src/testing/testing.go:646 +0x2ec
goroutine 1 [chan receive]:
testing.(*T).Run(0xc4200966c0, 0x630e1e, 0x18, 0x6dcbc0, 0x5e601)
/usr/local/go/src/testing/testing.go:647 +0x316
testing.RunTests.func1(0xc4200966c0)
/usr/local/go/src/testing/testing.go:793 +0x6d
testing.tRunner(0xc4200966c0, 0xc420459e30)
/usr/local/go/src/testing/testing.go:610 +0x81
testing.RunTests(0x6dd798, 0xa5ed00, 0x89, 0x89, 0xf96b)
/usr/local/go/src/testing/testing.go:799 +0x2f5
testing.(*M).Run(0xc420459ef8, 0x0)
/usr/local/go/src/testing/testing.go:743 +0x85
main.main()
github.com/couchbase/sync_gateway/db/_test/_testmain.go:370 +0xc6
goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2086 +0x1
goroutine 20 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4201d2080, 0xf, 0xc4201d5260, 0xc420117c20, 0xc4201b8360)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 10 [semacquire]:
sync.runtime_notifyListWait(0xc420165410, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420165400)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc4201d5080, 0xc4201ae170, 0xc420117c30)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4201ae170, 0xc4201c2420)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4201d5260, 0xc420117c20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4201d5260)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 21 [IO wait]:
net.runtime_pollWait(0x18090f0, 0x72, 0x7)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201978e0, 0x72, 0xc4200409d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201978e0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420197880, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6018, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b600, 0xc4201bb000, 0x1000, 0x1000, 0x30, 0xc420040b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201b83c0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201b83c0, 0x1, 0x0, 0x1, 0x0, 0xc4201b8420, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 11 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420162b60)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 144 [select]:
net/http.(*persistConn).writeLoop(0xc42047a600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 15 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201d8300, 0xc420117c20, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 16 [IO wait]:
net.runtime_pollWait(0x18091b0, 0x72, 0x5)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420197640, 0x72, 0xc420043cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420197640, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201975e0, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343a8, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201d8240)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201d8240, 0xc4201d53c0, 0x18, 0x18, 0x70, 0xc420265880, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc420117bd0, 0xc4201d53c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc420117bd0, 0xc420265880, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc420117c20, 0xc4201d8300, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 22 [select]:
net/http.(*persistConn).writeLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 183 [select]:
net/http.(*persistConn).writeLoop(0xc42037c100)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 38 [IO wait]:
net.runtime_pollWait(0x1809030, 0x72, 0x8)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201be290, 0x72, 0xc4200429d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201be290, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201be230, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343f0, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b700, 0xc4201ea000, 0x1000, 0x1000, 0x267ea0, 0xc420042b58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d8a20)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d8a20, 0x1, 0xc420042bbd, 0x1, 0x0, 0xc420432cc0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 39 [select]:
net/http.(*persistConn).writeLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 136 [IO wait]:
net.runtime_pollWait(0x1808eb0, 0x72, 0xe)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420215870, 0x72, 0xc420455cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420215870, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420215810, 0xc4201ba000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420228010, 0xc4201ba000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201d81e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201d81e0, 0xc4203e80c0, 0x18, 0x18, 0x70, 0xc42035c770, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4201b02d0, 0xc4203e80c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4201b02d0, 0xc42035c770, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4201b0370, 0xc4201d83c0, 0xc4202a6150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 52 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420278270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 138 [select]:
net/http.(*persistConn).writeLoop(0xc4204c8500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 32 [select]:
net/http.(*persistConn).readLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 190 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203e6320, 0xf, 0xc4204ddca0, 0xc4201b04b0, 0xc42030aa80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 33 [select]:
net/http.(*persistConn).writeLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 137 [IO wait]:
net.runtime_pollWait(0x1808bb0, 0x72, 0xa)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4202a6140, 0x72, 0xc42031a9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4202a6140, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202a60e0, 0xc42037f000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420228020, 0xc42037f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4204c8500, 0xc42037f000, 0x1000, 0x1000, 0x30, 0xc42031ab58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d84e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d84e0, 0x1, 0x0, 0x1, 0x0, 0xc4201d8720, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4204c8500)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 68 [select]:
net/http.(*persistConn).readLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 69 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 140 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420078680)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 219 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4204324e0, 0xc4201b04b0, 0xc42035c230)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 168 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203e63c0, 0xf, 0xc42041dcc0, 0xc4201b0370, 0xc4200133e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 135 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201d83c0, 0xc4201b0370, 0xc4202a6150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 164 [semacquire]:
sync.runtime_notifyListWait(0xc4204ca4d0, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4204ca4c0)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42041dae0, 0xc4203e67d0, 0xc4201b0380)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4203e67d0, 0xc420402630)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc42041dcc0, 0xc4201b0370)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc42041dcc0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 186 [semacquire]:
sync.runtime_notifyListWait(0xc4204ca310, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4204ca300)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc4204ddac0, 0xc4203e67a0, 0xc4201b04c0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4203e67a0, 0xc420402790)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4204ddca0, 0xc4201b04b0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4204ddca0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 182 [select]:
net/http.(*persistConn).readLoop(0xc42037c100)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 64 [IO wait]:
net.runtime_pollWait(0x1808c70, 0x72, 0xd)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c760, 0x72, 0xc42031e9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c760, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c700, 0xc420359000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4202281d0, 0xc420359000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000ba00, 0xc420359000, 0x1000, 0x1000, 0x267ea0, 0xc42031eb58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420213800)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420213800, 0x1, 0xc42031ebbd, 0x1, 0x0, 0xc4201b8de0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 65 [select]:
net/http.(*persistConn).writeLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 165 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420078270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 143 [select]:
net/http.(*persistConn).readLoop(0xc42047a600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 260 [select]:
net/http.(*persistConn).readLoop(0xc42000b800)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 187 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4201ac410)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 261 [select]:
net/http.(*persistConn).writeLoop(0xc42000b800)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 220 [IO wait]:
net.runtime_pollWait(0x1808d30, 0x72, 0x12)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420264370, 0x72, 0xc420047cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420264370, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420264310, 0xc4201e3000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6020, 0xc4201e3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420432360)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420432360, 0xc420310100, 0x18, 0x18, 0x70, 0xc420157260, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4201b0460, 0xc420310100, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4201b0460, 0xc420157260, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4201b04b0, 0xc4204324e0, 0xc42035c230)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 221 [IO wait]:
net.runtime_pollWait(0x18088b0, 0x72, 0x10)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c220, 0x72, 0xc4200469d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c220, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c1c0, 0xc4204e2000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6030, 0xc4204e2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000af00, 0xc4204e2000, 0x1000, 0x1000, 0x30, 0xc420046b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420432840)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420432840, 0x1, 0x0, 0x1, 0x0, 0xc420432960, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000af00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 222 [select]:
net/http.(*persistConn).writeLoop(0xc42000af00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 242 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4201ac270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 247 [select]:
net/http.(*persistConn).readLoop(0xc42000b900)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 248 [select]:
net/http.(*persistConn).writeLoop(0xc42000b900)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
2017-10-06 17:00:53.439160 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:53.439174 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.439184 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.439213 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.439220 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:53.441565 I | Flushing test bucket: test_data_bucket
2017-10-06 17:00:53.869065 I | workerReadOwnWrites completed without errors
2017-10-06T17:00:53.869-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:00:53.977-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:53.977-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:53.977-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:00:53.977-07:00 WARNING: Using DCP Logging Receiver. Receiver: 4 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:00:53.977-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:00:53.977968 I | bucketDataSource.Start() called
_time=2017-10-06T17:00:53.991-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:00:54.103344 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.103-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:00:54.103576 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.103-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:00:54.103-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.103-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:00:54.103-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.103-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:00:54.103-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.103-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:00:54.103-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:00:54.103780 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.103-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:00:54.103-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:00:54.103-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:00:54.103-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:00:54.103932 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.104-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:00:54.104-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:00:54.104-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:00:54.104-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:00:54.104-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:54.104-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:00:54.104-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc4201b9c20 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:00:54.104-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:00:54.104-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.104-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.104-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:00:54.104-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.104-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.104-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.104-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:54.104-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.104-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.104-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.104-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:00:54.104-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.112-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:00:54.112-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:00:54.112-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:00:54.112-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:00:54.112-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:00:54.112-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:54.112-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.112-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:00:54.112-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:54.112-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.112-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.112-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:54.112-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:00:54.112-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.112-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:54.112-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:54.112-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:00:54.112-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:00:54.112-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.112-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.112-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.112-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.112-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:00:54.112-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:54.154845 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:54.155331 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.155-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:00:54.155-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:00:54.155-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:00:54.155-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:00:54.155-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:00:54.155-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:00:54.155-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:54.155-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.155-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:54.155-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.155-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.155-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.155-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:54.156-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.156-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.156-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.156-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.156-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.156-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:00:54.156-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.156-07:00 Cache: Received #12 after 1ms ("doc-12" / "1-a")
2017-10-06T17:00:54.156-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:00:54.162-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:00:54.162-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:00:54.162-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:00:54.162-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:54.162-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.162-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:54.162-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:54.162-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.162-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.162-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.162-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.162-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:00:54.162-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:54.162-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:00:54.162-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.162-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.162-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.162-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:00:54.162-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.255-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:00:54.255895 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:54.256486 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.256-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:00:54.256-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:00:54.256-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:00:54.256-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:00:54.256-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:00:54.256-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:00:54.256-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:00:54.257-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:00:54.257-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:00:54.257-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:00:54.257159 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.257-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.257-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.257-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:00:54.257-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:00:54.257-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:00:54.257-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:00:54.257-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:00:54.257-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:00:54.257-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:00:54.257-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:00:54.257-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed sending {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.257-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.257-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06 17:00:54.257657 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.257-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.257-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.257-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.257-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.257-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.257-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:00:54.257-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.257-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:00:54.257-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:00:54.257-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:00:54.257-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:00:54.257-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:00:54.258-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:00:54.258-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:00:54.258-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.258-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:54.258-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.258-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:00:54.258-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.258-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:00:54.258-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:00:54.258-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:00:54.258-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:00:54.258-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:00:54.258-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:54.258-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:54.258-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:54.258-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:54.258-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:54.258-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:54.258-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:54.258-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:54.258-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:00:54.258-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:54.358-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:00:54.409426 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409503 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409593 I | Read changes entry: <nil>
2017-10-06 17:00:54.409631 I | Read changes entry: <nil>
2017-10-06 17:00:54.409650 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409664 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409690 I | Read changes entry: <nil>
2017-10-06 17:00:54.409705 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409730 I | Read changes entry: <nil>
2017-10-06 17:00:54.409744 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409769 I | Read changes entry: <nil>
2017-10-06 17:00:54.409783 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409795 I | Read changes entry: {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409819 I | Read changes entry: <nil>
2017-10-06 17:00:54.409832 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409856 I | Read changes entry: <nil>
2017-10-06 17:00:54.409869 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:54.409892 I | Read changes entry: <nil>
2017-10-06 17:00:54.409906 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:00:54.409-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:00:54.409-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06T17:00:54.409-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:00:54.409973 I | bucketDataSource.Close() called
2017-10-06T17:00:54.410-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:00:54.410-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:00:54.410027 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:54.410055 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:54.410079 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:54.410095 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.410-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52779->127.0.0.1:11210: use of closed network connection
2017-10-06 17:00:54.410112 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:54.410-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52779->127.0.0.1:11210: use of closed network connection. Receiver ID: 4 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:00:54.413221 I | Flushing test bucket: test_data_bucket
2017-10-06 17:00:54.820479 I | workerReadOwnWrites completed without errors
2017-10-06T17:00:54.820-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:00:54.934-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:54.934-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:54.934-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:00:54.934-07:00 WARNING: Using DCP Logging Receiver. Receiver: 5 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:00:54.934-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:00:54.934799 I | bucketDataSource.Start() called
_time=2017-10-06T17:00:54.945-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:00:55.057531 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.057-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:00:55.057919 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.058-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:00:55.058-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.058-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:00:55.058-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.058-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:00:55.058-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.058-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:00:55.058-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:00:55.058163 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.058-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:00:55.058-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:00:55.058-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:00:55.058-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:00:55.058383 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.058-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:00:55.058-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:00:55.058-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:00:55.058-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:00:55.058-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:55.058-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:00:55.058-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc420232f00 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:00:55.059-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.059-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:55.059-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:00:55.059-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:00:55.059-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.059-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.059-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.059-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.059-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.059-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.059-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:00:55.059-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.063-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:00:55.063-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:00:55.063-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:00:55.063-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:00:55.063-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:00:55.063-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.064-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.064-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:00:55.064-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.064-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:55.064-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:55.064-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:00:55.064-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.064-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.064-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:00:55.064-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:00:55.064-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:00:55.064-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:00:55.064-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.064-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.064-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.064-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.064-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:00:55.064-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:00:55.109038 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:55.109520 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.109-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:00:55.109-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:00:55.109-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:00:55.109-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:00:55.109-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:00:55.109-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:00:55.109-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.109-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.109-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:55.109-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:55.110-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:55.110-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.110-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.110-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.110-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.110-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.110-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.110-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:00:55.110-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.110-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:00:55.110-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.110-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:00:55.115-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:00:55.115-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:00:55.115-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:00:55.115-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.115-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.115-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:00:55.115-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.115-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:00:55.115-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:55.115-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:00:55.115-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.115-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.115-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.115-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:00:55.115-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.115-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.115-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.115-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:00:55.115-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.210-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:00:55.210336 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:55.210795 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.211-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:00:55.211-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:00:55.211-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:00:55.211-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:00:55.211-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:00:55.211-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:00:55.211-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:00:55.211-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:00:55.211-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06 17:00:55.211308 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.211-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.211-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:00:55.211-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.211-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:00:55.211-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:00:55.211-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:55.211-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:00:55.211-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:00:55.211-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:00:55.211-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:00:55.211-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:00:55.211-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed sending {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.211-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.211-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.211-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06 17:00:55.211691 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.211-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.211-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.211-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.211-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.211-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:00:55.211-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.211-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:00:55.211-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:00:55.211-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:00:55.211-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:00:55.211-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:00:55.211-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:00:55.212-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:00:55.212-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.212-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:00:55.212-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.212-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:00:55.212-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.212-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:00:55.212-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:00:55.212-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:00:55.212-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:00:55.212-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:00:55.212-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:00:55.212-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:00:55.212-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:00:55.212-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:00:55.212-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:00:55.212-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:00:55.212-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:00:55.212-07:00 Changes+: Sent output <- nil
2017-10-06T17:00:55.212-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:00:55.212-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:00:55.312-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:00:55.362471 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362510 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362592 I | Read changes entry: <nil>
2017-10-06 17:00:55.362650 I | Read changes entry: <nil>
2017-10-06 17:00:55.362677 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362691 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362724 I | Read changes entry: <nil>
2017-10-06 17:00:55.362739 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362764 I | Read changes entry: <nil>
2017-10-06 17:00:55.362779 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362803 I | Read changes entry: <nil>
2017-10-06 17:00:55.362817 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362830 I | Read changes entry: {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362900 I | Read changes entry: <nil>
2017-10-06 17:00:55.362927 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.362954 I | Read changes entry: <nil>
2017-10-06 17:00:55.362970 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:00:55.363008 I | Read changes entry: <nil>
2017-10-06 17:00:55.363044 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:00:55.363-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:00:55.363-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:00:55.363087 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:00:55.363097 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.363-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:00:55.363131 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.363-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:00:55.363-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:00:55.363155 I | bucketDataSource.Close() called
2017-10-06 17:00:55.363195 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:00:55.363218 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:00:55.363-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52805->127.0.0.1:11210: use of closed network connection
2017-10-06T17:00:55.363-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52805->127.0.0.1:11210: use of closed network connection. Receiver ID: 5 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:00:55.366991 I | Flushing test bucket: test_data_bucket
2017-10-06T17:00:55.801-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:56.309-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:56.816-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:57.318-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:57.826-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:58.335-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:58.843-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:59.349-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:00:59.853-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06T17:01:00.357-07:00 WARNING: TestBucketManager.EmptyBucket(): still 11 items in bucket after flush, waiting for no items. Will retry. -- base.(*TestBucketManager).EmptyTestBucket() at util_testing.go:313
2017-10-06 17:01:00.863893 I | workerReadOwnWrites completed without errors
2017-10-06T17:01:00.863-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:01:00.975-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:00.975-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:00.975-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:01:00.975-07:00 WARNING: Using DCP Logging Receiver. Receiver: 6 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:01:00.975-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:01:00.976029 I | bucketDataSource.Start() called
_time=2017-10-06T17:01:00.989-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:01:01.108410 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.108-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06T17:01:01.108-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:01:01.108-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.108-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:01:01.108-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.108-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:01:01.108-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.108-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:01:01.108-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:01:01.108937 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.109179 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.109319 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.109-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:01:01.109-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:01:01.109-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:01:01.109-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06T17:01:01.109-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:01:01.109-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:01:01.109-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:01.109-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:01:01.109-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:01:01.109-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:01:01.109-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc4201d8a80 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:01:01.109-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:01.109-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.109-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:01:01.109-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:01:01.109-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.109-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:01.109-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.109-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:01:01.109-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:01:01.109-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:01:01.109-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:01:01.109-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:01:01.109-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.109-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:01.109-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.109-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:01.109-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:01:01.109-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.109-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.109-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.109-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.109-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.110-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:01:01.110-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.110-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:01.110-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.110-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:01.110-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.110-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.110-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:01.110-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.110-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.110-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.110-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.110-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:01:01.110-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.116-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:01:01.116-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:01:01.116-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:01:01.116-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:01:01.116-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:01:01.116-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.116-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.116-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:01:01.116-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.116-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:01.116-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:01:01.116-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.116-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:01.116-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:01.116-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:01.116-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.116-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:01:01.116-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:01:01.116-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.116-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.116-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.116-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.117-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:01:01.117-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:01:01.160319 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.160857 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.161-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:01:01.161-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:01:01.161-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:01:01.161-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:01:01.161-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:01:01.161-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:01:01.161-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.161-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.161-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:01.161-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.161-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.161-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:01.161-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.161-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.161-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.161-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:01:01.161-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.161-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:01:01.161-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.161-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.161-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:01:01.161-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.169-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:01:01.169-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:01:01.169-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:01:01.169-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.169-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.169-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:01.169-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:01.169-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.169-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.169-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.169-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.169-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:01:01.169-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:01.169-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:01:01.169-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.169-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.169-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.169-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:01:01.169-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.261-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:01:01.261555 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.262018 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.262-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:01:01.262-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:01:01.262-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:01:01.262-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:01:01.262-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:01:01.262-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:01:01.262-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:01:01.262-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:01:01.262-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:01:01.262-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.262-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.262-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.262-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06 17:01:01.262460 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.262-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.262-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.262-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.262-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:01:01.262-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.262-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:01:01.262-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:01:01.262-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:01:01.262-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:01:01.262-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:01:01.262-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:01:01.262-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:01:01.262-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:01:01.262-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:01:01.262-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.262-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.262-07:00 Sequences: get oldest, returning: 8
2017-10-06 17:01:01.262863 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.262-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.262-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.262-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.263-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:01:01.263-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.263-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:01:01.263-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:01:01.263-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:01:01.263-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:01:01.263-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:01:01.263-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:01:01.263-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:01:01.263-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.263-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:01.263-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.263-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:01:01.263-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:01:01.263-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:01:01.263-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:01:01.263-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:01:01.263-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.263-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:01:01.263-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:01.263-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:01.263-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:01.263-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:01.263-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:01.263-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:01.263-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:01.263-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:01.263-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:01:01.263-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:01.363-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:01:01.414451 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414501 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414568 I | Read changes entry: <nil>
2017-10-06 17:01:01.414613 I | Read changes entry: <nil>
2017-10-06 17:01:01.414637 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414651 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414695 I | Read changes entry: <nil>
2017-10-06 17:01:01.414723 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414764 I | Read changes entry: <nil>
2017-10-06 17:01:01.414787 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414816 I | Read changes entry: <nil>
2017-10-06 17:01:01.414830 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414865 I | Read changes entry: <nil>
2017-10-06 17:01:01.414888 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414924 I | Read changes entry: <nil>
2017-10-06 17:01:01.414939 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:01:01.414974 I | Read changes entry: <nil>
2017-10-06 17:01:01.414991 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:01:01.415-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:01:01.415-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:01:01.415028 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06T17:01:01.415-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:01.415-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:01:01.415-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:01:01.415043 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.415066 I | bucketDataSource.Close() called
2017-10-06 17:01:01.415126 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.415151 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:01.415166 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:01.415-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52838->127.0.0.1:11210: use of closed network connection
2017-10-06T17:01:01.415-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52838->127.0.0.1:11210: use of closed network connection. Receiver ID: 6 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:01:01.418389 I | Flushing test bucket: test_data_bucket
2017-10-06 17:01:01.878893 I | workerReadOwnWrites completed without errors
2017-10-06T17:01:01.878-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:01:01.995-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:01.995-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:01.995-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:01:01.995-07:00 WARNING: Using DCP Logging Receiver. Receiver: 7 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:01:01.995-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:01:01.995794 I | bucketDataSource.Start() called
_time=2017-10-06T17:01:02.006-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:01:02.118484 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.118-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:01:02.118756 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.118-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:01:02.118-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.118-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:01:02.118-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.118-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:01:02.118-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.118-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:01:02.118-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:01:02.118984 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.119-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:01:02.119-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:01:02.119-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:01:02.119-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:01:02.119188 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.119-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:01:02.119-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:01:02.119-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:01:02.119-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:01:02.119-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:02.119-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:01:02.119-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc420233c20 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:01:02.119-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:01:02.119-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.119-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.119-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:01:02.119-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.119-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.119-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.119-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:02.119-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.119-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.119-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.119-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:01:02.119-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.126-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:01:02.126-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:01:02.126-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:01:02.126-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:01:02.126-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:01:02.126-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.126-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.126-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:01:02.126-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:02.126-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:01:02.126-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.126-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:02.126-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:02.126-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:02.126-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.126-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.126-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:01:02.126-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:01:02.126-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.126-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.126-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.126-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.126-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:01:02.126-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:01:02.169956 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:02.170470 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.170-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:01:02.170-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:01:02.170-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:01:02.170-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:01:02.170-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:01:02.170-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:01:02.170-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.170-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.170-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:02.170-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.170-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.170-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.170-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:02.171-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.171-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.171-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.171-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.171-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.171-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:01:02.171-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.171-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:01:02.171-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:01:02.178-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:01:02.178-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:01:02.178-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:01:02.178-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.178-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.178-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:02.178-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.178-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:01:02.178-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:02.178-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:02.178-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.178-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.178-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.178-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:01:02.178-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.178-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.178-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.178-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:01:02.178-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.271-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:01:02.271190 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:02.271736 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.272-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:01:02.272-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:01:02.272-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:01:02.272-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:01:02.272-07:00 Cache: #4 ==> channel "CBS"
2017-10-06 17:01:02.272074 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.272-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:01:02.272-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:01:02.272-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:01:02.272-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:01:02.272-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.272-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.272-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.272-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:01:02.272-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:01:02.272-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06 17:01:02.272426 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.272-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:01:02.272-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.272-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:01:02.272-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:01:02.272-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:01:02.272-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:01:02.272-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:01:02.272-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.272-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:01:02.272-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.272-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.272-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.272-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.272-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:01:02.272-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:01:02.272-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:01:02.272-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.272-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.272-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.272-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:01:02.272-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.272-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:01:02.272-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:01:02.272-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:01:02.272-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.273-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:02.273-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:01:02.273-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.273-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:01:02.273-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:01:02.273-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:01:02.273-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.273-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:02.273-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:02.273-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:02.273-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:02.273-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:01:02.273-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:02.273-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:02.273-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:02.273-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:01:02.273-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:02.373-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:01:02.423896 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.423936 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424004 I | Read changes entry: <nil>
2017-10-06 17:01:02.424053 I | Read changes entry: <nil>
2017-10-06 17:01:02.424077 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424094 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424156 I | Read changes entry: <nil>
2017-10-06 17:01:02.424193 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424230 I | Read changes entry: <nil>
2017-10-06 17:01:02.424247 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424295 I | Read changes entry: <nil>
2017-10-06 17:01:02.424330 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424372 I | Read changes entry: <nil>
2017-10-06 17:01:02.424392 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424420 I | Read changes entry: <nil>
2017-10-06 17:01:02.424437 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:01:02.424463 I | Read changes entry: <nil>
2017-10-06 17:01:02.424478 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:01:02.424-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:01:02.424-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:01:02.424517 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:01:02.424531 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.424-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:01:02.424565 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:02.424585 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.424-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06 17:01:02.424604 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:02.424-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:01:02.424676 I | bucketDataSource.Close() called
2017-10-06T17:01:02.424-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52859->127.0.0.1:11210: use of closed network connection
2017-10-06T17:01:02.424-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52859->127.0.0.1:11210: use of closed network connection. Receiver ID: 7 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:01:02.428012 I | Flushing test bucket: test_data_bucket
2017-10-06 17:01:02.871211 I | workerReadOwnWrites completed without errors
2017-10-06T17:01:02.871-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:01:02.987-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:02.987-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:02.987-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:01:02.987-07:00 WARNING: Using DCP Logging Receiver. Receiver: 8 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:01:02.987-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:01:02.988542 I | bucketDataSource.Start() called
_time=2017-10-06T17:01:02.999-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:01:03.116746 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.116-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:01:03.117036 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.117-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:01:03.117-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.117-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:01:03.117-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.117-07:00 Cache: #1 ==> channel "NBC"
2017-10-06 17:01:03.117243 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.117-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.117-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:01:03.117-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06T17:01:03.117-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:01:03.117-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:01:03.117-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:01:03.117-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06T17:01:03.117-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:01:03.117-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06 17:01:03.117530 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.117-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:03.117-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:01:03.117-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:01:03.117-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc420232ba0 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:01:03.117-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:01:03.118-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.118-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.118-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:01:03.118-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.118-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:01:03.118-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.118-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.118-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.118-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.118-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.118-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.118-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:01:03.118-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.123-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:01:03.123-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:01:03.123-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:01:03.123-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:01:03.123-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:01:03.123-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.123-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.123-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:01:03.123-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:03.123-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:03.123-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:03.123-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.123-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:01:03.123-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.123-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:03.123-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:01:03.123-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.123-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:01:03.123-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.123-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.123-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.123-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.123-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:01:03.123-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:01:03.168151 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:03.168663 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.168-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:01:03.169-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:01:03.169-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:01:03.169-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:01:03.169-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:01:03.169-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:01:03.169-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.169-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.169-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:03.169-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.169-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:03.169-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.169-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.169-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.169-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.169-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.169-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.169-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.169-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:01:03.169-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.169-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:01:03.169-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:01:03.175-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:01:03.175-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:01:03.175-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:01:03.175-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.175-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.175-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:03.175-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:03.175-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.175-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.175-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.175-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.175-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:01:03.175-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:03.175-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:01:03.175-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.175-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.175-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.175-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:01:03.175-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.269-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:01:03.269586 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:03.270030 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.270-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:01:03.270-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:01:03.270-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:01:03.270-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:01:03.270-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:01:03.270-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:01:03.270-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:01:03.270-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:01:03.270-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:01:03.270-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:01:03.270581 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.270-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.270-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:01:03.270-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:01:03.270-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:01:03.270-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:01:03.270-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:03.270-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.270-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:01:03.270-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:01:03.270-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:01:03.270-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:01:03.270-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:01:03.270-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:01:03.270-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.270-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.270-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.270-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.270-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06 17:01:03.270998 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed sending {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.271-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.271-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.271-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.271-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:01:03.271-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.271-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:01:03.271-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:01:03.271-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:01:03.271-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:01:03.271-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:01:03.271-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:01:03.271-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:01:03.271-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.271-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:03.271-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.271-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:01:03.271-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.271-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:01:03.271-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:01:03.271-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:01:03.271-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:01:03.271-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:01:03.271-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:03.271-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:03.271-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:03.271-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:03.271-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:03.271-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:03.271-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:03.271-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:03.271-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:01:03.272-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:03.371-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:01:03.422207 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422241 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422307 I | Read changes entry: <nil>
2017-10-06 17:01:03.422354 I | Read changes entry: <nil>
2017-10-06 17:01:03.422391 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422409 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422448 I | Read changes entry: <nil>
2017-10-06 17:01:03.422464 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422506 I | Read changes entry: <nil>
2017-10-06 17:01:03.422540 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422597 I | Read changes entry: <nil>
2017-10-06 17:01:03.422635 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422653 I | Read changes entry: {Seq:6::7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422692 I | Read changes entry: <nil>
2017-10-06 17:01:03.422742 I | Read changes entry: <nil>
2017-10-06 17:01:03.422774 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:01:03.422814 I | Read changes entry: <nil>
2017-10-06 17:01:03.422832 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:01:03.422-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:01:03.422-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:01:03.422870 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06 17:01:03.422880 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.422-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:03.422-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06 17:01:03.422894 I | bucketDataSource.Close() called
2017-10-06T17:01:03.422-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:01:03.422956 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:03.422975 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:03.422989 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:03.423-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52878->127.0.0.1:11210: use of closed network connection
2017-10-06T17:01:03.423-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52878->127.0.0.1:11210: use of closed network connection. Receiver ID: 8 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:01:03.426349 I | Flushing test bucket: test_data_bucket
2017-10-06 17:01:03.841137 I | workerReadOwnWrites completed without errors
2017-10-06T17:01:03.841-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:01:03.961-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:03.961-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:03.961-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:01:03.961-07:00 WARNING: Using DCP Logging Receiver. Receiver: 9 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:01:03.961-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:01:03.962128 I | bucketDataSource.Start() called
_time=2017-10-06T17:01:03.973-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:01:04.092656 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.092-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06 17:01:04.092905 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.093-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: #1 ==> channel "ABC"
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:01:04.093-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06 17:01:04.093118 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.093-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:01:04.093-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:01:04.093-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:01:04.093-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:01:04.093309 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.093-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:01:04.093-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:01:04.093-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:04.093-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:01:04.093-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:01:04.093-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:01:04.093-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc420badf20 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:01:04.093-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:04.093-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.093-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:01:04.093-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:04.093-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.093-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:01:04.093-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:04.093-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.093-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:01:04.093-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:04.093-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:01:04.093-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:01:04.093-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.093-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:01:04.093-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.094-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.094-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.094-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.094-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:01:04.094-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.094-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:04.094-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.094-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.094-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:04.094-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.094-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.094-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:04.094-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.094-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.094-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.094-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:01:04.094-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.099-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:01:04.099-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:01:04.099-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:01:04.099-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:01:04.099-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:01:04.099-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.099-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.099-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:01:04.099-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:04.099-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.099-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.099-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:04.099-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:01:04.100-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.100-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:04.100-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:04.100-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:01:04.100-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:01:04.100-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.100-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.100-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.100-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.100-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:01:04.100-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:01:04.144264 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:04.144729 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.144-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:01:04.145-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:01:04.145-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:01:04.145-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:01:04.145-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:01:04.145-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:01:04.145-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.145-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.145-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:04.145-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.145-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.145-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:04.145-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.145-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.145-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.145-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.145-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.145-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.145-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:01:04.145-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.145-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:01:04.145-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:01:04.151-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:01:04.151-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:01:04.151-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:01:04.151-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.151-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.151-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:04.151-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:04.151-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.151-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.151-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.151-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.151-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:01:04.151-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:04.151-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:01:04.151-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.151-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.151-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.151-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:01:04.151-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.245-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:01:04.245658 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:04.246135 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.246-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:01:04.246-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:01:04.246-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:01:04.246-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:01:04.246-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:01:04.246-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:01:04.246-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:01:04.246-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:01:04.246-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:01:04.246-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.246-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.246-07:00 Sequences: get oldest, returning: 7
2017-10-06T17:01:04.246-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:04.246-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06 17:01:04.246628 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.246-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.246-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.246-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.246-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.246-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.246-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.246-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.246-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:01:04.246-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:01:04.246-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:01:04.246-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:01:04.246-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:01:04.246-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.246-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:01:04.246-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:01:04.246-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:01:04.246-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:01:04.246-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:01:04.246-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:01:04.246969 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.246-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.246-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:01:04.247-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.247-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:01:04.247-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.247-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:01:04.247-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:01:04.247-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:01:04.247-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:01:04.247-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:01:04.247-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:01:04.247-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:01:04.247-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.247-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:04.247-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:04.247-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.247-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:01:04.247-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.247-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:01:04.247-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:01:04.247-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:01:04.247-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:01:04.247-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:04.247-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:04.247-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:04.247-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:04.247-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:04.247-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:04.247-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:04.247-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:04.247-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:01:04.247-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:04.347-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:01:04.398734 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.398783 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.398857 I | Read changes entry: <nil>
2017-10-06 17:01:04.398918 I | Read changes entry: <nil>
2017-10-06 17:01:04.398953 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.398970 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399004 I | Read changes entry: <nil>
2017-10-06 17:01:04.399020 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399045 I | Read changes entry: <nil>
2017-10-06 17:01:04.399067 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399093 I | Read changes entry: <nil>
2017-10-06 17:01:04.399107 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399159 I | Read changes entry: <nil>
2017-10-06 17:01:04.399198 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399239 I | Read changes entry: <nil>
2017-10-06 17:01:04.399262 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:01:04.399292 I | Read changes entry: <nil>
2017-10-06 17:01:04.399313 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:01:04.399-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:01:04.399-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:01:04.399378 I | ------------------------------ testContinuousChangesBackfill() ------------------------------
2017-10-06T17:01:04.399-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06 17:01:04.399392 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.399-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:01:04.399-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:01:04.399429 I | bucketDataSource.Close() called
2017-10-06 17:01:04.400253 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:04.400302 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:04.400343 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:04.400-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52900->127.0.0.1:11210: use of closed network connection
2017-10-06T17:01:04.400-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52900->127.0.0.1:11210: use of closed network connection. Receiver ID: 9 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:01:04.403633 I | Flushing test bucket: test_data_bucket
2017-10-06 17:01:04.827232 I | workerReadOwnWrites completed without errors
2017-10-06T17:01:04.827-07:00 GoCBCustomSGTranscoder Opening Couchbase database test_data_bucket on <http://localhost:8091> as user "test_data_bucket"
2017-10-06T17:01:04.946-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:04.946-07:00 WARNING: Got unrecoverable error key not found trying to get key _sync:seq. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:04.946-07:00 Cache: Initializing changes cache with options {ChannelCacheOptions:{ChannelCacheMinLength:0 ChannelCacheMaxLength:0 ChannelCacheAge:0s} CachePendingSeqMaxWait:5ms CachePendingSeqMaxNum:50 CacheSkippedSeqMaxWait:2m0s}
2017-10-06T17:01:04.947-07:00 WARNING: Using DCP Logging Receiver. Receiver: 10 -- base.NewDCPReceiver() at dcp_feed.go:111
2017-10-06T17:01:04.947-07:00 DCP: SetBucketNotifyFn()
2017-10-06 17:01:04.947562 I | bucketDataSource.Start() called
_time=2017-10-06T17:01:04.960-07:00 _level=INFO _msg=Using plain authentication for user test_data_bucket
2017-10-06 17:01:05.068604 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:05.068823 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.068-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{_sync:user:naomi}") count=2
2017-10-06T17:01:05.068-07:00 Cache: Received #1 after 0ms ("doc-1" / "1-a")
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "NBC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: #1 ==> channel "NBC"
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "ABC" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: #1 ==> channel "ABC"
2017-10-06 17:01:05.069028 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "*" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: #1 ==> channel "*"
2017-10-06T17:01:05.069-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, NBC}") count=3
2017-10-06T17:01:05.069-07:00 Cache: Received #2 after 0ms ("doc-2" / "1-a")
2017-10-06T17:01:05.069-07:00 Cache: #2 ==> channel "ABC"
2017-10-06T17:01:05.069-07:00 Cache: #2 ==> channel "*"
2017-10-06T17:01:05.069-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC}") count=4
2017-10-06 17:01:05.069218 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.069-07:00 Cache: Received #5 after 0ms ("doc-5" / "1-a")
2017-10-06T17:01:05.069-07:00 Cache: Deferring #5 (1 now waiting for #3...#4)
2017-10-06T17:01:05.069-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:05.069-07:00 Changes+: Int sequence multi changes feed...
2017-10-06T17:01:05.069-07:00 Changes: MultiChangesFeed(channels: {*}, options: {Since:0 Limit:0 Conflicts:false IncludeDocs:false Wait:true Continuous:true Terminator:0xc420bebd40 HeartbeatMs:0 TimeoutMs:0 ActiveOnly:false}) ... (to naomi)
2017-10-06T17:01:05.069-07:00 Cache: Received #6 after 0ms ("doc-6" / "1-a")
2017-10-06T17:01:05.069-07:00 Cache: Deferring #6 (2 now waiting for #3...#4)
2017-10-06T17:01:05.069-07:00 WARNING: Got unrecoverable error <nil> trying to get key _sync:user:naomi. Not going to retry. -- base.CouchbaseBucketGoCB.Get.func2() at bucket_gocb.go:259
2017-10-06T17:01:05.069-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("NBC", 0) --> 1 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 1 changes for channel NBC
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "PBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("PBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "!" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("!", 0) --> 0 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.069-07:00 Changes+: Channel feed processing seq:1 in channel NBC (to naomi)
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("ABC", 0) --> 2 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 2 changes for channel ABC
2017-10-06T17:01:05.069-07:00 Cache: Initialized cache for channel "CBS" with options: &{ChannelCacheMinLength:50 ChannelCacheMaxLength:500 ChannelCacheAge:1m0s}
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("CBS", 0) --> 0 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.069-07:00 Changes+: Channel feed processing seq:1 in channel ABC (to naomi)
2017-10-06T17:01:05.069-07:00 Changes+: Channel feed processing seq:2 in channel ABC (to naomi)
2017-10-06T17:01:05.069-07:00 Changes+: MultiChangesFeed sending {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.069-07:00 Changes+: MultiChangesFeed sending {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.069-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.069-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.069-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 2
2017-10-06T17:01:05.069-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.069-07:00 Cache: getCachedChanges("CBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:05.069-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.070-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.070-07:00 Cache: getCachedChanges("PBS", 2) --> 0 changes valid from #1
2017-10-06T17:01:05.070-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.070-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.070-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.070-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 4
2017-10-06T17:01:05.070-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.075-07:00 Cache: #5 ==> channel "PBS"
2017-10-06T17:01:05.075-07:00 Cache: #5 ==> channel "*"
2017-10-06T17:01:05.075-07:00 Cache: #6 ==> channel "CBS"
2017-10-06T17:01:05.075-07:00 Cache: #6 ==> channel "*"
2017-10-06T17:01:05.075-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS, PBS}") count=5
2017-10-06T17:01:05.075-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.075-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.075-07:00 Sequences: get oldest, returning: 3
2017-10-06T17:01:05.075-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.075-07:00 Cache: getCachedChanges("PBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:05.075-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:05.075-07:00 Cache: getCachedChanges("!", 2) --> 0 changes valid from #1
2017-10-06T17:01:05.075-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.075-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.075-07:00 Cache: getCachedChanges("CBS", 2) --> 1 changes valid from #1
2017-10-06T17:01:05.075-07:00 Changes+: [changesFeed] Found 1 changes for channel CBS
2017-10-06T17:01:05.075-07:00 Changes+: Channel feed processing seq:6 in channel CBS (to naomi)
2017-10-06T17:01:05.075-07:00 Changes+: Channel feed processing seq:5 in channel PBS (to naomi)
2017-10-06T17:01:05.075-07:00 Changes+: MultiChangesFeed sending {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.075-07:00 Changes+: MultiChangesFeed sending {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.075-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.075-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.075-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 5
2017-10-06T17:01:05.075-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06 17:01:05.120000 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:05.120339 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.120-07:00 Cache: Received #3 after 0ms ("doc-3" / "1-a")
2017-10-06T17:01:05.120-07:00 Cache: Received previously skipped out-of-order change (seq 3, expecting 7) doc "doc-3" / "1-a"
2017-10-06T17:01:05.120-07:00 Sequences: Acquired late sequence lock for 3
2017-10-06T17:01:05.120-07:00 Cache: #3 ==> channel "CBS"
2017-10-06T17:01:05.120-07:00 Cache: #3 ==> channel "*"
2017-10-06T17:01:05.120-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, CBS}") count=6
2017-10-06T17:01:05.120-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.120-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.120-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:05.120-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.120-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:05.120-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.120-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.120-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.120-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.120-07:00 Cache: Received #12 after 0ms ("doc-12" / "1-a")
2017-10-06T17:01:05.120-07:00 Changes+: MultiChangesFeed sending {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.120-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.120-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.120-07:00 Cache: Deferring #12 (1 now waiting for #7...#11)
2017-10-06T17:01:05.120-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 6
2017-10-06T17:01:05.120-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.126-07:00 Cache: #12 ==> channel "PBS"
2017-10-06T17:01:05.126-07:00 Cache: #12 ==> channel "*"
2017-10-06T17:01:05.126-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, PBS}") count=7
2017-10-06T17:01:05.126-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.126-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.126-07:00 Sequences: get oldest, returning: 4
2017-10-06T17:01:05.126-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.126-07:00 Cache: getCachedChanges("PBS", 6) --> 1 changes valid from #6
2017-10-06T17:01:05.126-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:05.126-07:00 Cache: getCachedChanges("!", 6) --> 0 changes valid from #1
2017-10-06T17:01:05.126-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.126-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.126-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.126-07:00 Changes+: Channel feed processing seq:12 in channel PBS (to naomi)
2017-10-06T17:01:05.126-07:00 Changes+: MultiChangesFeed sending {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.126-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.126-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.126-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 7
2017-10-06T17:01:05.126-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.220-07:00 waitForSequence(12) took 100 ms
2017-10-06 17:01:05.220950 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06 17:01:05.221395 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.221-07:00 Cache: Received #4 after 0ms ("doc-4" / "1-a")
2017-10-06T17:01:05.221-07:00 Cache: Received previously skipped out-of-order change (seq 4, expecting 13) doc "doc-4" / "1-a"
2017-10-06T17:01:05.221-07:00 Sequences: Acquired late sequence lock for 4
2017-10-06T17:01:05.221-07:00 Cache: #4 ==> channel "ABC"
2017-10-06T17:01:05.221-07:00 Cache: #4 ==> channel "CBS"
2017-10-06T17:01:05.221-07:00 Cache: #4 ==> channel "NBC"
2017-10-06T17:01:05.221-07:00 Cache: #4 ==> channel "PBS"
2017-10-06T17:01:05.221-07:00 Cache: #4 ==> channel "*"
2017-10-06T17:01:05.221-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=8
2017-10-06T17:01:05.221-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.221-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.221-07:00 Sequences: get oldest, returning: 7
2017-10-06 17:01:05.221879 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.221-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:05.221-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.221-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.221-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.221-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.221-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.222-07:00 Cache: Received #7 after 0ms ("doc-7" / "1-a")
2017-10-06T17:01:05.222-07:00 Cache: Received previously skipped out-of-order change (seq 7, expecting 13) doc "doc-7" / "1-a"
2017-10-06T17:01:05.222-07:00 Sequences: Acquired late sequence lock for 7
2017-10-06T17:01:05.222-07:00 Cache: #7 ==> channel "CBS"
2017-10-06T17:01:05.222-07:00 Cache: #7 ==> channel "NBC"
2017-10-06T17:01:05.222-07:00 Cache: #7 ==> channel "PBS"
2017-10-06T17:01:05.222-07:00 Cache: #7 ==> channel "ABC"
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed sending {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.222-07:00 Cache: #7 ==> channel "*"
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.222-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.222-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, CBS, NBC, PBS}") count=9
2017-10-06T17:01:05.222-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 8
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.222-07:00 Sequences: get oldest, returning: 8
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.222-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06 17:01:05.222230 I | NOT Using xattrs: strings.ToLower(useXattrs) != strings.ToLower(TestEnvSyncGatewayTrue). |false| != |true|
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed sending {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.222-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.222-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 9
2017-10-06T17:01:05.222-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.222-07:00 Cache: Received #8 after 0ms ("doc-8" / "1-a")
2017-10-06T17:01:05.222-07:00 Cache: Received previously skipped out-of-order change (seq 8, expecting 13) doc "doc-8" / "1-a"
2017-10-06T17:01:05.222-07:00 Sequences: Acquired late sequence lock for 8
2017-10-06T17:01:05.222-07:00 Cache: #8 ==> channel "ABC"
2017-10-06T17:01:05.222-07:00 Cache: #8 ==> channel "PBS"
2017-10-06T17:01:05.222-07:00 Cache: #8 ==> channel "*"
2017-10-06T17:01:05.222-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=10
2017-10-06T17:01:05.222-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.222-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel ABC
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel PBS
2017-10-06T17:01:05.222-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.222-07:00 Cache: Received #13 after 0ms ("doc-13" / "1-a")
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed sending {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.222-07:00 Cache: #13 ==> channel "ABC"
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.222-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.222-07:00 Cache: #13 ==> channel "PBS"
2017-10-06T17:01:05.222-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 10
2017-10-06T17:01:05.222-07:00 Cache: #13 ==> channel "*"
2017-10-06T17:01:05.222-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.222-07:00 Changes+: Notifying that "test_data_bucket" changed (keys="{*, ABC, PBS}") count=11
2017-10-06T17:01:05.222-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.222-07:00 Changes+: MultiChangesFeed: channels expand to "!:1,ABC:1,CBS:1,NBC:1,PBS:1" ... (to naomi)
2017-10-06T17:01:05.222-07:00 Sequences: get oldest, returning: 9
2017-10-06T17:01:05.222-07:00 Cache: getCachedChanges("ABC", 12) --> 1 changes valid from #9
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 1 changes for channel ABC
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel CBS
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 0 changes for channel NBC
2017-10-06T17:01:05.222-07:00 Cache: getCachedChanges("PBS", 12) --> 1 changes valid from #13
2017-10-06T17:01:05.222-07:00 Changes+: [changesFeed] Found 1 changes for channel PBS
2017-10-06T17:01:05.223-07:00 Cache: getCachedChanges("!", 12) --> 0 changes valid from #1
2017-10-06T17:01:05.223-07:00 Changes+: [changesFeed] Found 0 changes for channel !
2017-10-06T17:01:05.222-07:00 Changes+: Channel feed processing seq:13 in channel ABC (to naomi)
2017-10-06T17:01:05.223-07:00 Changes+: Channel feed processing seq:13 in channel PBS (to naomi)
2017-10-06T17:01:05.223-07:00 Changes+: MultiChangesFeed sending {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]} (to naomi)
2017-10-06T17:01:05.223-07:00 Changes+: MultiChangesFeed waiting... (to naomi)
2017-10-06T17:01:05.223-07:00 Changes+: Sent output <- nil
2017-10-06T17:01:05.223-07:00 Changes+: No new changes to send to change listener. Waiting for "test_data_bucket"'s count to pass 11
2017-10-06T17:01:05.223-07:00 Changes+: Calling tapNotifier.Wait()
2017-10-06T17:01:05.323-07:00 waitForSequence(13) took 100 ms
2017-10-06 17:01:05.373526 I | Read changes entry: {Seq:1, ID:doc-1, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373547 I | Read changes entry: {Seq:2, ID:doc-2, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373599 I | Read changes entry: <nil>
2017-10-06 17:01:05.373620 I | Read changes entry: <nil>
2017-10-06 17:01:05.373631 I | Read changes entry: {Seq:2::5, ID:doc-5, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373637 I | Read changes entry: {Seq:2::6, ID:doc-6, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373661 I | Read changes entry: <nil>
2017-10-06 17:01:05.373680 I | Read changes entry: {Seq:3, ID:doc-3, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373699 I | Read changes entry: <nil>
2017-10-06 17:01:05.373711 I | Read changes entry: {Seq:3::12, ID:doc-12, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373725 I | Read changes entry: <nil>
2017-10-06 17:01:05.373734 I | Read changes entry: {Seq:4, ID:doc-4, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373756 I | Read changes entry: <nil>
2017-10-06 17:01:05.373769 I | Read changes entry: {Seq:7, ID:doc-7, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373786 I | Read changes entry: <nil>
2017-10-06 17:01:05.373794 I | Read changes entry: {Seq:8, ID:doc-8, Changes:[map[rev:1-a]]}
2017-10-06 17:01:05.373807 I | Read changes entry: <nil>
2017-10-06 17:01:05.373815 I | Read changes entry: {Seq:8::13, ID:doc-13, Changes:[map[rev:1-a]]}
2017-10-06T17:01:05.373-07:00 Changes+: changeListener.Stop() called
2017-10-06T17:01:05.373-07:00 Changes+: listener.tapNotifier.Broadcast()
2017-10-06 17:01:05.373837 I | ********** dumping stack. # of goroutines: 135
2017-10-06T17:01:05.373-07:00 Changes+: /finished Calling tapNotifier.Wait()
2017-10-06T17:01:05.373-07:00 Changes+: listener.terminator was closed, getting out of Wait() loop
2017-10-06T17:01:05.373-07:00 Changes: MultiChangesFeed done (to naomi)
2017-10-06 17:01:05.373852 I | bucketDataSource.Close() called
2017-10-06T17:01:05.373-07:00 DCP: OnError: pkt.Receive, err: read tcp 127.0.0.1:52919->127.0.0.1:11210: use of closed network connection
2017-10-06T17:01:05.373-07:00 WARNING: Error processing DCP stream - will attempt to restart/reconnect: pkt.Receive, err: read tcp 127.0.0.1:52919->127.0.0.1:11210: use of closed network connection. Receiver ID: 10 -- base.(*DCPReceiver).OnError() at dcp_feed.go:130
2017-10-06 17:01:05.376671 I | Stack: goroutine 6 [running]:
github.com/couchbase/sync_gateway/db.TestReproduceTestResidue(0xc420096780)
/Users/tleyden/Development/sync_gateway/godeps/src/github.com/couchbase/sync_gateway/db/change_cache_test.go:284 +0x1a6
testing.tRunner(0xc420096780, 0x6dcbc0)
/usr/local/go/src/testing/testing.go:610 +0x81
created by testing.(*T).Run
/usr/local/go/src/testing/testing.go:646 +0x2ec
goroutine 1 [chan receive]:
testing.(*T).Run(0xc4200966c0, 0x630e1e, 0x18, 0x6dcbc0, 0x5e601)
/usr/local/go/src/testing/testing.go:647 +0x316
testing.RunTests.func1(0xc4200966c0)
/usr/local/go/src/testing/testing.go:793 +0x6d
testing.tRunner(0xc4200966c0, 0xc420459e30)
/usr/local/go/src/testing/testing.go:610 +0x81
testing.RunTests(0x6dd798, 0xa5ed00, 0x89, 0x89, 0xf96b)
/usr/local/go/src/testing/testing.go:799 +0x2f5
testing.(*M).Run(0xc420459ef8, 0x0)
/usr/local/go/src/testing/testing.go:743 +0x85
main.main()
github.com/couchbase/sync_gateway/db/_test/_testmain.go:370 +0xc6
goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2086 +0x1
goroutine 20 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4201d2080, 0xf, 0xc4201d5260, 0xc420117c20, 0xc4201b8360)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 10 [semacquire]:
sync.runtime_notifyListWait(0xc4204cb450, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4204cb440)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42035a7a0, 0xc42030cdd0, 0xc42030cdd0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc42030cdd0, 0xc42030cdd0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4201d5260, 0xc420117c20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4201d5260)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 21 [IO wait]:
net.runtime_pollWait(0x18090f0, 0x72, 0x7)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201978e0, 0x72, 0xc4200409d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201978e0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420197880, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6018, 0xc4201bb000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b600, 0xc4201bb000, 0x1000, 0x1000, 0x30, 0xc420040b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201b83c0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201b83c0, 0x1, 0x0, 0x1, 0x0, 0xc4201b8420, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 11 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420162b60)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 144 [select]:
net/http.(*persistConn).writeLoop(0xc42047a600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 15 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201d8300, 0xc420117c20, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 16 [IO wait]:
net.runtime_pollWait(0x18091b0, 0x72, 0x5)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420197640, 0x72, 0xc420043cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420197640, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201975e0, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343a8, 0xc42016d000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201d8240)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201d8240, 0xc4201d53c0, 0x18, 0x18, 0x70, 0xc42035ca80, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc420117bd0, 0xc4201d53c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc420117bd0, 0xc42035ca80, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc420117c20, 0xc4201d8300, 0xc420197730)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 22 [select]:
net/http.(*persistConn).writeLoop(0xc42000b600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 183 [select]:
net/http.(*persistConn).writeLoop(0xc42037c100)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 38 [IO wait]:
net.runtime_pollWait(0x1809030, 0x72, 0x8)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201be290, 0x72, 0xc4200429d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201be290, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201be230, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200343f0, 0xc4201ea000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000b700, 0xc4201ea000, 0x1000, 0x1000, 0x267ea0, 0xc420042b58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d8a20)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d8a20, 0x1, 0xc420042bbd, 0x1, 0x0, 0xc420bea2a0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 39 [select]:
net/http.(*persistConn).writeLoop(0xc42000b700)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 136 [IO wait]:
net.runtime_pollWait(0x1808eb0, 0x72, 0xe)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420215870, 0x72, 0xc420455cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420215870, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420215810, 0xc4201ba000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420228010, 0xc4201ba000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4201d81e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4201d81e0, 0xc4203e80c0, 0x18, 0x18, 0x70, 0xc42023f6c0, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4201b02d0, 0xc4203e80c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4201b02d0, 0xc42023f6c0, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4201b0370, 0xc4201d83c0, 0xc4202a6150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 280 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420278dd0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 138 [select]:
net/http.(*persistConn).writeLoop(0xc4204c8500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 32 [select]:
net/http.(*persistConn).readLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 190 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203e6320, 0xf, 0xc4204ddca0, 0xc4201b04b0, 0xc42030aa80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 33 [select]:
net/http.(*persistConn).writeLoop(0xc420074600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 137 [IO wait]:
net.runtime_pollWait(0x1808bb0, 0x72, 0xa)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4202a6140, 0x72, 0xc42031a9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4202a6140, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202a60e0, 0xc42037f000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420228020, 0xc42037f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4204c8500, 0xc42037f000, 0x1000, 0x1000, 0x30, 0xc42031ab58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d84e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d84e0, 0x1, 0x0, 0x1, 0x0, 0xc4201d8720, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4204c8500)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 68 [select]:
net/http.(*persistConn).readLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 69 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 382 [IO wait]:
net.runtime_pollWait(0x1bb2b68, 0x72, 0x26)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42033a060, 0x72, 0xc4202fccc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42033a060, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42033a000, 0xc4203af000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4203b03c8, 0xc4203af000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420213d40)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420213d40, 0xc4202a56a0, 0x18, 0x18, 0x70, 0xc420336d20, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4204e1040, 0xc4202a56a0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4204e1040, 0xc420336d20, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4204e1090, 0xc420213e00, 0xc420157650)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 219 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4204324e0, 0xc4201b04b0, 0xc42035c230)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 168 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203e63c0, 0xf, 0xc42041dcc0, 0xc4201b0370, 0xc4200133e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 135 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4201d83c0, 0xc4201b0370, 0xc4202a6150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 164 [semacquire]:
sync.runtime_notifyListWait(0xc420b2efd0, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420b2efc0)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42025e260, 0xc420252700, 0xc420252700)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc420252700, 0xc420252700)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc42041dcc0, 0xc4201b0370)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc42041dcc0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 186 [semacquire]:
sync.runtime_notifyListWait(0xc42000cd50, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc42000cd40)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42035a6e0, 0xc4203e7940, 0xc4203e7940)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4203e7940, 0xc4203e7940)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4204ddca0, 0xc4201b04b0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4204ddca0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 182 [select]:
net/http.(*persistConn).readLoop(0xc42037c100)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 64 [IO wait]:
net.runtime_pollWait(0x1808c70, 0x72, 0xd)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c760, 0x72, 0xc42031e9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c760, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c700, 0xc420359000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4202281d0, 0xc420359000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000ba00, 0xc420359000, 0x1000, 0x1000, 0x267ea0, 0xc42031eb58, 0x571d)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420213800)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420213800, 0x1, 0xc42031ebbd, 0x1, 0x0, 0xc4202952c0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 65 [select]:
net/http.(*persistConn).writeLoop(0xc42000ba00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 165 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420078270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 236 [semacquire]:
sync.runtime_notifyListWait(0xc420b586d0, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420b586c0)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42025f9a0, 0xc420b5ee20, 0xc420b5ee20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc420b5ee20, 0xc420b5ee20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4203e8fc0, 0xc42041a820)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4203e8fc0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 363 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc42020ce80, 0xf, 0xc4203e8fc0, 0xc42041a820, 0xc42029c720)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 143 [select]:
net/http.(*persistConn).readLoop(0xc42047a600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 663 [select]:
net/http.(*persistConn).writeLoop(0xc42047a900)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 206 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc420212120, 0xc42048a140, 0xc4201be150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 260 [select]:
net/http.(*persistConn).readLoop(0xc42000b800)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 187 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4201ac410)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 446 [IO wait]:
net.runtime_pollWait(0x1bb3168, 0x72, 0x1e)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42023e3e0, 0x72, 0xc4202fecc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42023e3e0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42023e380, 0xc420320000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4203b0020, 0xc420320000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420294420)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420294420, 0xc4202d8120, 0x18, 0x18, 0x70, 0xc420b84460, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4204e61e0, 0xc4202d8120, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4204e61e0, 0xc420b84460, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4204e6280, 0xc4202944e0, 0xc42035c310)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 391 [select]:
net/http.(*persistConn).readLoop(0xc4201f9000)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 611 [select]:
net/http.(*persistConn).readLoop(0xc42037ca00)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 508 [select]:
net/http.(*persistConn).writeLoop(0xc4201f9700)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 261 [select]:
net/http.(*persistConn).writeLoop(0xc42000b800)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 547 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8200)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 595 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4202792b0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 220 [IO wait]:
net.runtime_pollWait(0x1808d30, 0x72, 0x12)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420264370, 0x72, 0xc420047cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420264370, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420264310, 0xc4201e3000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6020, 0xc4201e3000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420432360)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420432360, 0xc420310100, 0x18, 0x18, 0x70, 0xc42033a150, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4201b0460, 0xc420310100, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4201b0460, 0xc42033a150, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4201b04b0, 0xc4204324e0, 0xc42035c230)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 325 [select]:
net/http.(*persistConn).readLoop(0xc4201f8800)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 546 [select]:
net/http.(*persistConn).readLoop(0xc4201f8200)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 326 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8800)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 387 [select]:
net/http.(*persistConn).readLoop(0xc42047a500)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 344 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4202941e0, 0xc42041a820, 0xc4202a6850)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 701 [select]:
net/http.(*persistConn).readLoop(0xc4201f9500)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 221 [IO wait]:
net.runtime_pollWait(0x18088b0, 0x72, 0x10)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c220, 0x72, 0xc4200469d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c220, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c1c0, 0xc4204e2000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6030, 0xc4204e2000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42000af00, 0xc4204e2000, 0x1000, 0x1000, 0x30, 0xc420046b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420432840)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420432840, 0x1, 0x0, 0x1, 0x0, 0xc420432960, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42000af00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 222 [select]:
net/http.(*persistConn).writeLoop(0xc42000af00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 711 [semacquire]:
sync.runtime_notifyListWait(0xc420b580d0, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420b580c0)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc420b11da0, 0xc420af61c0, 0xc420c088d0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc420af61c0, 0xc420b724d0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc42025e180, 0xc420c088c0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc42025e180)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 719 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4200784e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 247 [select]:
net/http.(*persistConn).readLoop(0xc42000b900)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 248 [select]:
net/http.(*persistConn).writeLoop(0xc42000b900)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 292 [semacquire]:
sync.runtime_notifyListWait(0xc420165b90, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420165b80)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc420357b00, 0xc42030dbe0, 0xc42030dbe0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc42030dbe0, 0xc42030dbe0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc420406360, 0xc42048a140)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc420406360)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 445 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc4202944e0, 0xc4204e6280, 0xc42035c310)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 207 [IO wait]:
net.runtime_pollWait(0x18087f0, 0x72, 0x16)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420214300, 0x72, 0xc420496cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420214300, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202142a0, 0xc420094000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6008, 0xc420094000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420212060)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420212060, 0xc4203fe080, 0x18, 0x18, 0x70, 0xc420b857a0, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc42048a0f0, 0xc4203fe080, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc42048a0f0, 0xc420b857a0, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc42048a140, 0xc420212120, 0xc4201be150)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 293 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420162270)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 430 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8a00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 392 [select]:
net/http.(*persistConn).writeLoop(0xc4201f9000)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 308 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc42030c2a0, 0xf, 0xc420406360, 0xc42048a140, 0xc4204330e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 125 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8f00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 296 [IO wait]:
net.runtime_pollWait(0x18085b0, 0x72, 0x14)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201be140, 0x72, 0xc42049d9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201be140, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201be0e0, 0xc42041f000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4203b0048, 0xc42041f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc420074500, 0xc42041f000, 0x1000, 0x1000, 0x30, 0xc42049db58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc42030aae0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc42030aae0, 0x1, 0x0, 0x1, 0x0, 0xc42030ab40, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc420074500)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 279 [semacquire]:
sync.runtime_notifyListWait(0xc42047d350, 0x0)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc42047d340)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc420161560, 0xc4203c4c80, 0xc4203c4c80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4203c4c80, 0xc4203c4c80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4202079e0, 0xc4204e6280)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4202079e0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 297 [select]:
net/http.(*persistConn).writeLoop(0xc420074500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 447 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc420478260, 0xf, 0xc4202079e0, 0xc4204e6280, 0xc4202946c0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 329 [select]:
net/http.(*persistConn).readLoop(0xc4201f8900)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 330 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8900)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 124 [IO wait]:
net.runtime_pollWait(0x18082b0, 0x72, 0x18)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4202a6840, 0x72, 0xc4203029d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4202a6840, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202a67e0, 0xc42035e000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420404000, 0xc42035e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4201f8f00, 0xc42035e000, 0x1000, 0x1000, 0x30, 0xc420302b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4203a4060)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4203a4060, 0x1, 0x0, 0x1, 0x0, 0xc4203a40c0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4201f8f00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 521 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203c5e70, 0xf, 0xc42024ec40, 0xc4204e1180, 0xc4201497a0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 237 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420162dd0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 388 [select]:
net/http.(*persistConn).writeLoop(0xc42047a500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 633 [semacquire]:
sync.runtime_notifyListWait(0xc420165890, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420165880)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc4203561c0, 0xc42030d750, 0xc4204e7c80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc42030d750, 0xc420408e70)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4203563c0, 0xc4204e7c70)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4203563c0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 449 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420163110)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 414 [select]:
net/http.(*persistConn).writeLoop(0xc42047af00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 507 [IO wait]:
net.runtime_pollWait(0x1bb2c28, 0x72, 0x20)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42033a370, 0x72, 0xc4203009d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42033a370, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42033a310, 0xc42024b000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420404340, 0xc42024b000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4201f9700, 0xc42024b000, 0x1000, 0x1000, 0x30, 0xc420300b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420b53f20)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420b53f20, 0x1, 0x0, 0x1, 0x0, 0xc420b53f80, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4201f9700)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 345 [IO wait]:
net.runtime_pollWait(0x18084f0, 0x72, 0x1a)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4202643e0, 0x72, 0xc4204cecc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4202643e0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420264380, 0xc4204e5000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4202280e8, 0xc4204e5000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420294120)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420294120, 0xc4203108c0, 0x18, 0x18, 0x70, 0xc420264460, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc42041a7d0, 0xc4203108c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc42041a7d0, 0xc420264460, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc42041a820, 0xc4202941e0, 0xc4202a6850)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 429 [IO wait]:
net.runtime_pollWait(0x1bb2f28, 0x72, 0x1c)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42035c300, 0x72, 0xc42042e9d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42035c300, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42035c2a0, 0xc420343000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6028, 0xc420343000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4201f8a00, 0xc420343000, 0x1000, 0x1000, 0x30, 0xc42042eb58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4202321e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4202321e0, 0x1, 0x0, 0x1, 0x0, 0xc420232240, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4201f8a00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 413 [select]:
net/http.(*persistConn).readLoop(0xc42047af00)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 504 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc4201acf70)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 471 [select]:
net/http.(*persistConn).readLoop(0xc42047b000)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 472 [select]:
net/http.(*persistConn).writeLoop(0xc42047b000)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 503 [semacquire]:
sync.runtime_notifyListWait(0xc420b2ecd0, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc420b2ecc0)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc42024ea60, 0xc4201afb10, 0xc4204e1190)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4201afb10, 0xc42009a2c0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc42024ec40, 0xc4204e1180)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc42024ec40)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 529 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420279110)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 464 [select]:
net/http.(*persistConn).writeLoop(0xc42000b200)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 520 [IO wait]:
net.runtime_pollWait(0x1bb2e68, 0x72, 0x22)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42023f640, 0x72, 0xc4204cccc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42023f640, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42023f5e0, 0xc420256000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420228298, 0xc420256000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420149560)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420149560, 0xc4201945c0, 0x18, 0x18, 0x70, 0xc42035c000, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4204e1130, 0xc4201945c0, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4204e1130, 0xc42035c000, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4204e1180, 0xc420149620, 0xc42033a380)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 519 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc420149620, 0xc4204e1180, 0xc42033a380)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 648 [IO wait]:
net.runtime_pollWait(0x1bb2628, 0x72, 0x28)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420337b10, 0x72, 0xc420be39d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420337b10, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420337ab0, 0xc42046e000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4203b0438, 0xc42046e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42037cb00, 0xc42046e000, 0x1000, 0x1000, 0x30, 0xc420be3b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc4201d8cc0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc4201d8cc0, 0x1, 0x0, 0x1, 0x0, 0xc4201d8d20, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42037cb00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 463 [select]:
net/http.(*persistConn).readLoop(0xc42000b200)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 591 [select]:
net/http.(*persistConn).writeLoop(0xc42047b300)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 530 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420163040)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 526 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc420148a20, 0xc4204e7c70, 0xc420337b20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 590 [select]:
net/http.(*persistConn).readLoop(0xc42047b300)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 634 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420163c70)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 527 [IO wait]:
net.runtime_pollWait(0x1bb2868, 0x72, 0x2a)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420265f70, 0x72, 0xc420be5cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420265f70, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420265f10, 0xc4203e4000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4200340f8, 0xc4203e4000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc420148960)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420148960, 0xc42025f620, 0x18, 0x18, 0x70, 0xc420076a10, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc4204e7c20, 0xc42025f620, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc4204e7c20, 0xc420076a10, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc4204e7c70, 0xc420148a20, 0xc420337b20)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 662 [select]:
net/http.(*persistConn).readLoop(0xc42047a900)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 636 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc42030d380, 0xf, 0xc4203563c0, 0xc4204e7c70, 0xc420013e60)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 383 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc4203e7020, 0xf, 0xc4203e88a0, 0xc4204e1090, 0xc420213f80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 580 [semacquire]:
sync.runtime_notifyListWait(0xc4201b3f10, 0x4)
/usr/local/go/src/runtime/sema.go:267 +0x122
sync.(*Cond).Wait(0xc4201b3f00)
/usr/local/go/src/sync/cond.go:57 +0x80
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpQueue).pop(0xc4203e8500, 0xc4203c46e0, 0xc4204e10a0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:138 +0x6d
gopkg.in/couchbase/gocbcore%2ev7.(*memdOpConsumer).Pop(0xc4203c46e0, 0xc420403b80)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdopqueue.go:28 +0x33
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop(0xc4203e88a0, 0xc4204e1090)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:235 +0x1ec
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).Run(0xc4203e88a0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:287 +0x26f
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipeline).StartClients
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:66 +0xd8
goroutine 581 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420192410)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 612 [select]:
net/http.(*persistConn).writeLoop(0xc42037ca00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 381 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc420213e00, 0xc4204e1090, 0xc420157650)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 584 [IO wait]:
net.runtime_pollWait(0x1bb2928, 0x72, 0x24)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420157640, 0x72, 0xc4202c19d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420157640, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4201575e0, 0xc420470000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4201b6140, 0xc420470000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc42037c500, 0xc420470000, 0x1000, 0x1000, 0x30, 0xc4202c1b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc42025a540)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc42025a540, 0x1, 0x0, 0x1, 0x0, 0xc42025a5a0, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc42037c500)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 585 [select]:
net/http.(*persistConn).writeLoop(0xc42037c500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 712 [sleep]:
time.Sleep(0x2540be400)
/usr/local/go/src/runtime/time.go:59 +0xe1
gopkg.in/couchbase/gocbcore%2ev7.(*Agent).cccpLooper(0xc420163380)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:413 +0xab
created by gopkg.in/couchbase/gocbcore%2ev7.(*Agent).connect
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/agent.go:558 +0x960
goroutine 649 [select]:
net/http.(*persistConn).writeLoop(0xc42037cb00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 729 [select]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func1(0xc420013aa0, 0xc420c088c0, 0xc42035caf0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:123 +0x29a
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:139 +0x98
goroutine 653 [select]:
net/http.(*persistConn).readLoop(0xc42047a800)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 654 [select]:
net/http.(*persistConn).writeLoop(0xc42047a800)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 730 [IO wait]:
net.runtime_pollWait(0x1bb2568, 0x72, 0x2e)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420264290, 0x72, 0xc420b68cc8, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420264290, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420264230, 0xc420259000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420034098, 0xc420259000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
bufio.(*Reader).fill(0xc4200139e0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4200139e0, 0xc42035a860, 0x18, 0x18, 0x70, 0xc42033bea0, 0x0)
/usr/local/go/src/bufio/bufio.go:209 +0x1bc
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).readFullBuffer(0xc420c08870, 0xc42035a860, 0x18, 0x18, 0x0, 0x0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:130 +0x65
gopkg.in/couchbase/gocbcore%2ev7.(*memdTcpConn).ReadPacket(0xc420c08870, 0xc42033bea0, 0xf, 0x2)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdconn.go:146 +0x4a
gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run.func2(0xc420c088c0, 0xc420013aa0, 0xc42035caf0)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:147 +0xdf
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdClient).run
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdclient.go:198 +0xce
goroutine 681 [chan receive]:
gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop.func1(0xc420b5e350, 0xf, 0xc42025e180, 0xc420c088c0, 0xc420bea240)
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:192 +0x129
created by gopkg.in/couchbase/gocbcore%2ev7.(*memdPipelineClient).ioLoop
/Users/tleyden/Development/sync_gateway/godeps/src/gopkg.in/couchbase/gocbcore.v7/memdpipeline.go:205 +0xfb
goroutine 716 [select]:
net/http.(*persistConn).writeLoop(0xc4201f8b00)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 715 [IO wait]:
net.runtime_pollWait(0x1bb2328, 0x72, 0x2c)
/usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420264300, 0x72, 0xc420be19d0, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420264300, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc4202642a0, 0xc420b56000, 0x1000, 0x1000, 0x0, 0x8fe600, 0xc4200160c8)
/usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4203b0060, 0xc420b56000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:173 +0x70
net/http.(*persistConn).Read(0xc4201f8b00, 0xc420b56000, 0x1000, 0x1000, 0x30, 0xc420be1b58, 0x3bebc)
/usr/local/go/src/net/http/transport.go:1261 +0x154
bufio.(*Reader).fill(0xc420bacba0)
/usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Peek(0xc420bacba0, 0x1, 0x0, 0x1, 0x0, 0xc420bacc00, 0x0)
/usr/local/go/src/bufio/bufio.go:129 +0x62
net/http.(*persistConn).readLoop(0xc4201f8b00)
/usr/local/go/src/net/http/transport.go:1418 +0x1a1
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 702 [select]:
net/http.(*persistConn).writeLoop(0xc4201f9500)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
goroutine 740 [select]:
net/http.(*persistConn).readLoop(0xc4201f9600)
/usr/local/go/src/net/http/transport.go:1541 +0x9c9
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1062 +0x4e9
goroutine 741 [select]:
net/http.(*persistConn).writeLoop(0xc4201f9600)
/usr/local/go/src/net/http/transport.go:1646 +0x3bd
created by net/http.(*Transport).dialConn
/usr/local/go/src/net/http/transport.go:1063 +0x50e
--- PASS: TestReproduceTestResidue (16.42s)
PASS
ok github.com/couchbase/sync_gateway/db 16.436s
PASS
ok github.com/couchbase/sync_gateway/rest 0.015s
Running Sync Gateway Accel unit tests
? github.com/couchbaselabs/sync-gateway-accel [no test files]
PASS
ok github.com/couchbaselabs/sync-gateway-accel/indexwriter 0.016s
? github.com/couchbaselabs/sync-gateway-accel/sg_accel [no test files]
tleyden_macbook:sync_gateway tleyden$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment