Skip to content

Instantly share code, notes, and snippets.

@aeneaswiener

aeneaswiener/gist:aa38495c7e7d9ff3d74c Secret

Last active November 4, 2015 14:26
Show Gist options
  • Save aeneaswiener/aa38495c7e7d9ff3d74c to your computer and use it in GitHub Desktop.
Save aeneaswiener/aa38495c7e7d9ff3d74c to your computer and use it in GitHub Desktop.
Download ZIP
Kafka balanced consumer stops consuming
Raw
gistfile1.txt
2015-11-04 13:46:56,641 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:46:56,642 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:46:56,898 - pykafka.simpleconsumer - DEBUG - Fetched 3357 messages for partition 15
2015-11-04 13:46:56,919 - pykafka.simpleconsumer - DEBUG - Partition 15 queue holds 3357 messages
2015-11-04 13:46:56,919 - pykafka.simpleconsumer - DEBUG - Fetched 3947 messages for partition 19
2015-11-04 13:46:56,943 - pykafka.simpleconsumer - DEBUG - Partition 19 queue holds 3947 messages
2015-11-04 13:46:56,959 - root - DEBUG - Got 1000 messages, total messages fetched = 4577000, at a rate of 3045.17197006 msgs/sec / 38.7448854549 MB/sec
2015-11-04 13:46:56,984 - root - DEBUG - Got 1000 messages, total messages fetched = 4578000, at a rate of 3045.78568138 msgs/sec / 38.7525624656 MB/sec
2015-11-04 13:46:57,025 - root - DEBUG - Got 1000 messages, total messages fetched = 4579000, at a rate of 3046.36878886 msgs/sec / 38.759600838 MB/sec
2015-11-04 13:46:57,076 - root - DEBUG - Got 1000 messages, total messages fetched = 4580000, at a rate of 3046.93086859 msgs/sec / 38.7668809058 MB/sec
2015-11-04 13:46:57,122 - root - DEBUG - Got 1000 messages, total messages fetched = 4581000, at a rate of 3047.50279147 msgs/sec / 38.7742256832 MB/sec
2015-11-04 13:46:57,186 - root - DEBUG - Got 1000 messages, total messages fetched = 4582000, at a rate of 3048.0372466 msgs/sec / 38.7811322055 MB/sec
2015-11-04 13:46:57,261 - root - DEBUG - Got 1000 messages, total messages fetched = 4583000, at a rate of 3048.55068001 msgs/sec / 38.7875687333 MB/sec
2015-11-04 13:46:57,815 - pykafka.simpleconsumer - DEBUG - Fetched 3928 messages for partition 18
2015-11-04 13:46:57,835 - root - DEBUG - Got 1000 messages, total messages fetched = 4584000, at a rate of 3048.05106278 msgs/sec / 38.7816395045 MB/sec
2015-11-04 13:46:57,982 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 2965 messages
2015-11-04 13:46:57,991 - root - DEBUG - Got 1000 messages, total messages fetched = 4585000, at a rate of 3048.4015156 msgs/sec / 38.7862546973 MB/sec
2015-11-04 13:46:58,137 - root - DEBUG - Got 1000 messages, total messages fetched = 4586000, at a rate of 3048.77046711 msgs/sec / 38.7906930228 MB/sec
2015-11-04 13:46:58,342 - root - DEBUG - Got 1000 messages, total messages fetched = 4587000, at a rate of 3049.01848828 msgs/sec / 38.794079599 MB/sec
2015-11-04 13:46:58,897 - pykafka.simpleconsumer - DEBUG - Fetched 3793 messages for partition 19
2015-11-04 13:46:58,928 - pykafka.simpleconsumer - DEBUG - Partition 19 queue holds 3793 messages
2015-11-04 13:46:58,950 - root - DEBUG - Got 1000 messages, total messages fetched = 4588000, at a rate of 3048.45097025 msgs/sec / 38.7868658007 MB/sec
2015-11-04 13:46:59,005 - root - DEBUG - Got 1000 messages, total messages fetched = 4589000, at a rate of 3049.00468805 msgs/sec / 38.7941001973 MB/sec
2015-11-04 13:46:59,094 - root - DEBUG - Got 1000 messages, total messages fetched = 4590000, at a rate of 3049.48786656 msgs/sec / 38.8000212736 MB/sec
2015-11-04 13:46:59,202 - root - DEBUG - Got 1000 messages, total messages fetched = 4591000, at a rate of 3049.93423299 msgs/sec / 38.8059550892 MB/sec
2015-11-04 13:46:59,801 - pykafka.simpleconsumer - DEBUG - Fetched 3864 messages for partition 18
2015-11-04 13:46:59,827 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 3864 messages
2015-11-04 13:46:59,859 - root - DEBUG - Got 1000 messages, total messages fetched = 4592000, at a rate of 3049.26807718 msgs/sec / 38.7984231997 MB/sec
2015-11-04 13:46:59,900 - root - DEBUG - Got 1000 messages, total messages fetched = 4593000, at a rate of 3049.84815461 msgs/sec / 38.8067813761 MB/sec
2015-11-04 13:47:00,045 - root - DEBUG - Got 1000 messages, total messages fetched = 4594000, at a rate of 3050.21983796 msgs/sec / 38.811168408 MB/sec
2015-11-04 13:47:00,173 - root - DEBUG - Got 1000 messages, total messages fetched = 4595000, at a rate of 3050.62371908 msgs/sec / 38.8161092942 MB/sec
2015-11-04 13:47:00,807 - pykafka.simpleconsumer - DEBUG - Fetched 3934 messages for partition 19
2015-11-04 13:47:00,880 - root - DEBUG - Got 1000 messages, total messages fetched = 4596000, at a rate of 3049.85529176 msgs/sec / 38.8060917165 MB/sec
2015-11-04 13:47:00,937 - pykafka.simpleconsumer - DEBUG - Partition 19 queue holds 2985 messages
2015-11-04 13:47:00,961 - root - DEBUG - Got 1000 messages, total messages fetched = 4597000, at a rate of 3050.35490595 msgs/sec / 38.8125128886 MB/sec
2015-11-04 13:47:01,027 - root - DEBUG - Got 1000 messages, total messages fetched = 4598000, at a rate of 3050.88572379 msgs/sec / 38.8192528222 MB/sec
2015-11-04 13:47:01,099 - root - DEBUG - Got 1000 messages, total messages fetched = 4599000, at a rate of 3051.40256037 msgs/sec / 38.8260222855 MB/sec
2015-11-04 13:47:01,822 - pykafka.simpleconsumer - DEBUG - Fetched 3934 messages for partition 18
2015-11-04 13:47:01,848 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 3934 messages
2015-11-04 13:47:01,892 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:01,893 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:01,946 - root - DEBUG - Got 1000 messages, total messages fetched = 4600000, at a rate of 3050.35328792 msgs/sec / 38.8125098773 MB/sec
2015-11-04 13:47:02,070 - root - DEBUG - Got 1000 messages, total messages fetched = 4601000, at a rate of 3050.76496655 msgs/sec / 38.8180323616 MB/sec
2015-11-04 13:47:02,162 - root - DEBUG - Got 1000 messages, total messages fetched = 4602000, at a rate of 3051.24114776 msgs/sec / 38.8243323279 MB/sec
2015-11-04 13:47:02,224 - root - DEBUG - Got 1000 messages, total messages fetched = 4603000, at a rate of 3051.78030961 msgs/sec / 38.8309653558 MB/sec
2015-11-04 13:47:02,700 - pykafka.simpleconsumer - DEBUG - Fetched 3477 messages for partition 19
2015-11-04 13:47:02,781 - root - DEBUG - Got 1000 messages, total messages fetched = 4604000, at a rate of 3051.31547245 msgs/sec / 38.8251445765 MB/sec
2015-11-04 13:47:02,789 - pykafka.simpleconsumer - DEBUG - Partition 19 queue holds 2796 messages
2015-11-04 13:47:02,818 - root - DEBUG - Got 1000 messages, total messages fetched = 4605000, at a rate of 3051.90261627 msgs/sec / 38.83243542 MB/sec
2015-11-04 13:47:02,893 - root - DEBUG - Got 1000 messages, total messages fetched = 4606000, at a rate of 3052.41495722 msgs/sec / 38.8395093513 MB/sec
2015-11-04 13:47:03,606 - pykafka.simpleconsumer - DEBUG - Fetched 3867 messages for partition 18
2015-11-04 13:47:03,622 - root - DEBUG - Got 1000 messages, total messages fetched = 4607000, at a rate of 3051.6037894 msgs/sec / 38.8288264852 MB/sec
2015-11-04 13:47:03,733 - root - DEBUG - Got 1000 messages, total messages fetched = 4608000, at a rate of 3052.0411789 msgs/sec / 38.8350835401 MB/sec
2015-11-04 13:47:03,794 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 2221 messages
2015-11-04 13:47:03,814 - root - DEBUG - Got 1000 messages, total messages fetched = 4609000, at a rate of 3052.53885661 msgs/sec / 38.8414488207 MB/sec
2015-11-04 13:47:03,848 - root - DEBUG - Got 1000 messages, total messages fetched = 4610000, at a rate of 3053.13264352 msgs/sec / 38.8487086114 MB/sec
2015-11-04 13:47:04,764 - pykafka.simpleconsumer - DEBUG - Fetched 3893 messages for partition 18
2015-11-04 13:47:04,806 - root - DEBUG - Got 1000 messages, total messages fetched = 4611000, at a rate of 3051.85920737 msgs/sec / 38.8325965114 MB/sec
2015-11-04 13:47:04,867 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 3151 messages
2015-11-04 13:47:04,885 - root - DEBUG - Got 1000 messages, total messages fetched = 4612000, at a rate of 3052.36187417 msgs/sec / 38.8388372161 MB/sec
2015-11-04 13:47:04,920 - root - DEBUG - Got 1000 messages, total messages fetched = 4613000, at a rate of 3052.95315952 msgs/sec / 38.8462410035 MB/sec
2015-11-04 13:47:04,955 - root - DEBUG - Got 1000 messages, total messages fetched = 4614000, at a rate of 3053.54446427 msgs/sec / 38.8541042986 MB/sec
2015-11-04 13:47:05,760 - pykafka.simpleconsumer - DEBUG - Fetched 3127 messages for partition 18
2015-11-04 13:47:05,780 - pykafka.simpleconsumer - DEBUG - Partition 18 queue holds 3127 messages
2015-11-04 13:47:05,805 - root - DEBUG - Got 1000 messages, total messages fetched = 4615000, at a rate of 3052.48781509 msgs/sec / 38.8409655845 MB/sec
2015-11-04 13:47:05,839 - root - DEBUG - Got 1000 messages, total messages fetched = 4616000, at a rate of 3053.08032681 msgs/sec / 38.8482713587 MB/sec
2015-11-04 13:47:05,873 - root - DEBUG - Got 1000 messages, total messages fetched = 4617000, at a rate of 3053.67330873 msgs/sec / 38.8558155524 MB/sec
<------------- Consumer stops receiving messages here
2015-11-04 13:47:06,913 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:06,913 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:11,921 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:11,921 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:16,932 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:16,933 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:21,937 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:21,938 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:26,941 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:26,941 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:31,948 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:31,948 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:36,953 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:36,954 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:41,961 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:41,961 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:46,969 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:46,970 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:51,972 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:51,973 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:56,980 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:47:56,980 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:47:58,972 - pykafka.balancedconsumer - INFO - Checking held partitions against ZooKeeper
2015-11-04 13:47:58,972 - kazoo.client - DEBUG - Sending request(xid=331): GetChildren(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2', watcher=None)
2015-11-04 13:47:58,973 - kazoo.client - DEBUG - Received response(xid=331): [u'0-12', u'0-13', u'0-10', u'0-11', u'0-18', u'0-0', u'0-19', u'0-16', u'0-1', u'0-17', u'0-2', u'0-14', u'0-3', u'0-15', u'0-4', u'0-5', u'0-6', u'0-7', u'0-8', u'0-9']
2015-11-04 13:47:58,974 - kazoo.client - DEBUG - Sending request(xid=332): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-12', watcher=None)
2015-11-04 13:47:58,975 - kazoo.client - DEBUG - Received response(xid=332): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15902, mzxid=15902, ctime=1446643537212, mtime=1446643537212, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15902))
2015-11-04 13:47:58,975 - kazoo.client - DEBUG - Sending request(xid=333): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-13', watcher=None)
2015-11-04 13:47:58,976 - kazoo.client - DEBUG - Received response(xid=333): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15903, mzxid=15903, ctime=1446643537270, mtime=1446643537270, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15903))
2015-11-04 13:47:58,976 - kazoo.client - DEBUG - Sending request(xid=334): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-10', watcher=None)
2015-11-04 13:47:58,977 - kazoo.client - DEBUG - Received response(xid=334): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15900, mzxid=15900, ctime=1446643536936, mtime=1446643536936, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15900))
2015-11-04 13:47:58,977 - kazoo.client - DEBUG - Sending request(xid=335): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-11', watcher=None)
2015-11-04 13:47:58,978 - kazoo.client - DEBUG - Received response(xid=335): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15901, mzxid=15901, ctime=1446643537119, mtime=1446643537119, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15901))
2015-11-04 13:47:58,978 - kazoo.client - DEBUG - Sending request(xid=336): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-18', watcher=None)
2015-11-04 13:47:58,979 - kazoo.client - DEBUG - Received response(xid=336): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15904, mzxid=15904, ctime=1446643538271, mtime=1446643538271, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15904))
2015-11-04 13:47:58,980 - kazoo.client - DEBUG - Sending request(xid=337): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-0', watcher=None)
2015-11-04 13:47:58,980 - kazoo.client - DEBUG - Received response(xid=337): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15898, mzxid=15898, ctime=1446643536890, mtime=1446643536890, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15898))
2015-11-04 13:47:58,981 - kazoo.client - DEBUG - Sending request(xid=338): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-19', watcher=None)
2015-11-04 13:47:58,981 - kazoo.client - DEBUG - Received response(xid=338): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15905, mzxid=15905, ctime=1446643538274, mtime=1446643538274, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15905))
2015-11-04 13:47:58,982 - kazoo.client - DEBUG - Sending request(xid=339): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-16', watcher=None)
2015-11-04 13:47:58,983 - kazoo.client - DEBUG - Received response(xid=339): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15837, mzxid=15837, ctime=1446643313795, mtime=1446643313795, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15837))
2015-11-04 13:47:58,983 - kazoo.client - DEBUG - Sending request(xid=340): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-1', watcher=None)
2015-11-04 13:47:58,984 - kazoo.client - DEBUG - Received response(xid=340): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15899, mzxid=15899, ctime=1446643536912, mtime=1446643536912, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15899))
2015-11-04 13:47:58,984 - kazoo.client - DEBUG - Sending request(xid=341): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-17', watcher=None)
2015-11-04 13:47:58,985 - kazoo.client - DEBUG - Received response(xid=341): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15839, mzxid=15839, ctime=1446643313801, mtime=1446643313801, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15839))
2015-11-04 13:47:58,985 - kazoo.client - DEBUG - Sending request(xid=342): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-2', watcher=None)
2015-11-04 13:47:58,986 - kazoo.client - DEBUG - Received response(xid=342): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15906, mzxid=15906, ctime=1446643538282, mtime=1446643538282, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15906))
2015-11-04 13:47:58,987 - kazoo.client - DEBUG - Sending request(xid=343): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-14', watcher=None)
2015-11-04 13:47:58,987 - kazoo.client - DEBUG - Received response(xid=343): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15897, mzxid=15897, ctime=1446643536862, mtime=1446643536862, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15897))
2015-11-04 13:47:58,988 - kazoo.client - DEBUG - Sending request(xid=344): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-3', watcher=None)
2015-11-04 13:47:58,988 - kazoo.client - DEBUG - Received response(xid=344): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15907, mzxid=15907, ctime=1446643538292, mtime=1446643538292, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15907))
2015-11-04 13:47:58,989 - kazoo.client - DEBUG - Sending request(xid=345): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-15', watcher=None)
2015-11-04 13:47:58,990 - kazoo.client - DEBUG - Received response(xid=345): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15835, mzxid=15835, ctime=1446643313787, mtime=1446643313787, version=0, cversion=0, aversion=0, ephemeralO$
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15835))
2015-11-04 13:47:58,990 - kazoo.client - DEBUG - Sending request(xid=346): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-4', watcher=None)
2015-11-04 13:47:58,991 - kazoo.client - DEBUG - Received response(xid=346): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15872, mzxid=15872, ctime=1446643476313, mtime=1446643476313, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15872))
2015-11-04 13:47:58,991 - kazoo.client - DEBUG - Sending request(xid=347): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-5', watcher=None)
2015-11-04 13:47:58,992 - kazoo.client - DEBUG - Received response(xid=347): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15873, mzxid=15873, ctime=1446643476322, mtime=1446643476322, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15873))
2015-11-04 13:47:58,992 - kazoo.client - DEBUG - Sending request(xid=348): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-6', watcher=None)
2015-11-04 13:47:58,993 - kazoo.client - DEBUG - Received response(xid=348): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15880, mzxid=15880, ctime=1446643476378, mtime=1446643476378, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15880))
2015-11-04 13:47:58,994 - kazoo.client - DEBUG - Sending request(xid=349): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-7', watcher=None)
2015-11-04 13:47:58,994 - kazoo.client - DEBUG - Received response(xid=349): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15871, mzxid=15871, ctime=1446643476304, mtime=1446643476304, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15871))
2015-11-04 13:47:58,995 - kazoo.client - DEBUG - Sending request(xid=350): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-8', watcher=None)
2015-11-04 13:47:58,996 - kazoo.client - DEBUG - Received response(xid=350): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15874, mzxid=15874, ctime=1446643476330, mtime=1446643476330, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15874))
2015-11-04 13:47:58,996 - kazoo.client - DEBUG - Sending request(xid=351): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-9', watcher=None)
2015-11-04 13:47:58,997 - kazoo.client - DEBUG - Received response(xid=351): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15876, mzxid=15876, ctime=1446643476346, mtime=1446643476346, version=0, cversion=0, aversion=$
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15876))
2015-11-04 13:48:01,989 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:01,990 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:06,998 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:06,999 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:12,008 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:12,008 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:17,014 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:17,014 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:22,021 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:22,022 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:27,027 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:27,027 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:32,034 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:32,035 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:37,044 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:37,045 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:42,054 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:42,055 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:47,063 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:47,064 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:52,073 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:52,073 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:48:57,082 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:48:57,083 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:02,091 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:02,092 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:07,101 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:07,102 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:12,110 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:12,110 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:17,120 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:17,120 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:22,126 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:22,126 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:27,134 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:27,134 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:32,143 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:32,143 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:37,152 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:37,153 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:42,162 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:42,162 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:47,171 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:47,171 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:52,180 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:52,181 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:57,190 - pykafka.simpleconsumer - INFO - Autocommitting consumer offset for consumer group aeneas_test_cons_3 and topic ln_2011_remaining_2
2015-11-04 13:49:57,190 - pykafka.simpleconsumer - DEBUG - Committing offsets for 7 partitions to broker id 0
2015-11-04 13:49:59,097 - pykafka.balancedconsumer - INFO - Checking held partitions against ZooKeeper
2015-11-04 13:49:59,098 - kazoo.client - DEBUG - Sending request(xid=352): GetChildren(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2', watcher=None)
2015-11-04 13:49:59,099 - kazoo.client - DEBUG - Received response(xid=352): [u'0-12', u'0-13', u'0-10', u'0-11', u'0-18', u'0-0', u'0-19', u'0-16', u'0-1', u'0-17', u'0-2', u'0-14', u'0-3', u'0-15', u'0-4', u'0-5', u'0-6', u'0-7', u'0-8', u'0-9']
2015-11-04 13:49:59,099 - kazoo.client - DEBUG - Sending request(xid=353): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-12', watcher=None)
2015-11-04 13:49:59,100 - kazoo.client - DEBUG - Received response(xid=353): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15902, mzxid=15902, ctime=1446643537212, mtime=1446643537212, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15902))
2015-11-04 13:49:59,101 - kazoo.client - DEBUG - Sending request(xid=354): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-13', watcher=None)
2015-11-04 13:49:59,102 - kazoo.client - DEBUG - Received response(xid=354): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15903, mzxid=15903, ctime=1446643537270, mtime=1446643537270, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15903))
2015-11-04 13:49:59,102 - kazoo.client - DEBUG - Sending request(xid=355): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-10', watcher=None)
2015-11-04 13:49:59,103 - kazoo.client - DEBUG - Received response(xid=355): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15900, mzxid=15900, ctime=1446643536936, mtime=1446643536936, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15900))
2015-11-04 13:49:59,103 - kazoo.client - DEBUG - Sending request(xid=356): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-11', watcher=None)
2015-11-04 13:49:59,104 - kazoo.client - DEBUG - Received response(xid=356): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15901, mzxid=15901, ctime=1446643537119, mtime=1446643537119, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15901))
2015-11-04 13:49:59,104 - kazoo.client - DEBUG - Sending request(xid=357): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-18', watcher=None)
2015-11-04 13:49:59,105 - kazoo.client - DEBUG - Received response(xid=357): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15904, mzxid=15904, ctime=1446643538271, mtime=1446643538271, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15904))
2015-11-04 13:49:59,105 - kazoo.client - DEBUG - Sending request(xid=358): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-0', watcher=None)
2015-11-04 13:49:59,106 - kazoo.client - DEBUG - Received response(xid=358): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15898, mzxid=15898, ctime=1446643536890, mtime=1446643536890, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15898))
2015-11-04 13:49:59,106 - kazoo.client - DEBUG - Sending request(xid=359): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-19', watcher=None)
2015-11-04 13:49:59,107 - kazoo.client - DEBUG - Received response(xid=359): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15905, mzxid=15905, ctime=1446643538274, mtime=1446643538274, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15905))
2015-11-04 13:49:59,107 - kazoo.client - DEBUG - Sending request(xid=360): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-16', watcher=None)
2015-11-04 13:49:59,108 - kazoo.client - DEBUG - Received response(xid=360): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15837, mzxid=15837, ctime=1446643313795, mtime=1446643313795, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15837))
2015-11-04 13:49:59,108 - kazoo.client - DEBUG - Sending request(xid=361): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-1', watcher=None)
2015-11-04 13:49:59,109 - kazoo.client - DEBUG - Received response(xid=361): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15899, mzxid=15899, ctime=1446643536912, mtime=1446643536912, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15899))
2015-11-04 13:49:59,110 - kazoo.client - DEBUG - Sending request(xid=362): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-17', watcher=None)
2015-11-04 13:49:59,110 - kazoo.client - DEBUG - Received response(xid=362): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15839, mzxid=15839, ctime=1446643313801, mtime=1446643313801, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15839))
2015-11-04 13:49:59,111 - kazoo.client - DEBUG - Sending request(xid=363): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-2', watcher=None)
2015-11-04 13:49:59,112 - kazoo.client - DEBUG - Received response(xid=363): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15906, mzxid=15906, ctime=1446643538282, mtime=1446643538282, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15906))
2015-11-04 13:49:59,112 - kazoo.client - DEBUG - Sending request(xid=364): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-14', watcher=None)
2015-11-04 13:49:59,113 - kazoo.client - DEBUG - Received response(xid=364): ('AWs-MacBook-Pro.local:76cf1a49-9cd0-4a4a-9b36-5dfdd01371cc', ZnodeStat(czxid=15897, mzxid=15897, ctime=1446643536862, mtime=1446643536862, version=0, cversion=0, aversion=0,
ephemeralOwner=94773402786530350, dataLength=58, numChildren=0, pzxid=15897))
2015-11-04 13:49:59,113 - kazoo.client - DEBUG - Sending request(xid=365): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-3', watcher=None)
2015-11-04 13:49:59,114 - kazoo.client - DEBUG - Received response(xid=365): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15907, mzxid=15907, ctime=1446643538292, mtime=1446643538292, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15907))
2015-11-04 13:49:59,114 - kazoo.client - DEBUG - Sending request(xid=366): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-15', watcher=None)
2015-11-04 13:49:59,115 - kazoo.client - DEBUG - Received response(xid=366): ('instance-1:edaf622a-e4b3-4514-8e00-8afab2b480b6', ZnodeStat(czxid=15835, mzxid=15835, ctime=1446643313787, mtime=1446643313787, version=0, cversion=0, aversion=0, ephemeralOw
ner=94773402786530348, dataLength=47, numChildren=0, pzxid=15835))
2015-11-04 13:49:59,115 - kazoo.client - DEBUG - Sending request(xid=367): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-4', watcher=None)
2015-11-04 13:49:59,116 - kazoo.client - DEBUG - Received response(xid=367): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15872, mzxid=15872, ctime=1446643476313, mtime=1446643476313, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15872))
2015-11-04 13:49:59,117 - kazoo.client - DEBUG - Sending request(xid=368): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-5', watcher=None)
2015-11-04 13:49:59,117 - kazoo.client - DEBUG - Received response(xid=368): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15873, mzxid=15873, ctime=1446643476322, mtime=1446643476322, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15873))
2015-11-04 13:49:59,118 - kazoo.client - DEBUG - Sending request(xid=369): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-6', watcher=None)
2015-11-04 13:49:59,119 - kazoo.client - DEBUG - Received response(xid=369): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15880, mzxid=15880, ctime=1446643476378, mtime=1446643476378, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15880))
2015-11-04 13:49:59,119 - kazoo.client - DEBUG - Sending request(xid=370): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-7', watcher=None)
2015-11-04 13:49:59,120 - kazoo.client - DEBUG - Received response(xid=370): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15871, mzxid=15871, ctime=1446643476304, mtime=1446643476304, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15871))
2015-11-04 13:49:59,120 - kazoo.client - DEBUG - Sending request(xid=371): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-8', watcher=None)
2015-11-04 13:49:59,121 - kazoo.client - DEBUG - Received response(xid=371): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15874, mzxid=15874, ctime=1446643476330, mtime=1446643476330, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15874))
2015-11-04 13:49:59,121 - kazoo.client - DEBUG - Sending request(xid=372): GetData(path='/consumers/aeneas_test_cons_3/owners/ln_2011_remaining_2/0-9', watcher=None)
2015-11-04 13:49:59,122 - kazoo.client - DEBUG - Received response(xid=372): ('verisk-pipeline-full-ln:b9d5f088-f0c4-4084-abe6-87887c82de7a', ZnodeStat(czxid=15876, mzxid=15876, ctime=1446643476346, mtime=1446643476346, version=0, cversion=0, aversion=0
, ephemeralOwner=94773402786530349, dataLength=60, numChildren=0, pzxid=15876))
[ ... similar messages hidden ... ]
2015-11-04 14:19:24,094 - kazoo.recipe.watchers - ERROR - unpack_from requires a buffer of at least 27758 bytes
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/kazoo/recipe/watchers.py", line 333, in _get_children
result = self._func(children)
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 532, in _consumers_changed
self._rebalance()
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 441, in _rebalance
self._setup_internal_consumer()
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 295, in _setup_internal_consumer
auto_start=start
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 162, in __init__
self._discover_offset_manager()
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 259, in _discover_offset_manager
self._offset_manager = self._cluster.get_offset_manager(self._consumer_group)
File "/usr/local/lib/python2.7/dist-packages/pykafka/cluster.py", line 295, in get_offset_manager
res = future.get(ConsumerMetadataResponse)
File "/usr/local/lib/python2.7/dist-packages/pykafka/handlers.py", line 62, in get
return response_cls(self.response)
File "/usr/local/lib/python2.7/dist-packages/pykafka/protocol.py", line 907, in __init__
response = struct_helpers.unpack_from(fmt, buff, 0)
File "/usr/local/lib/python2.7/dist-packages/pykafka/utils/struct_helpers.py", line 49, in unpack_from
output = _unpack(fmt, buff, offset, 1)[0]
File "/usr/local/lib/python2.7/dist-packages/pykafka/utils/struct_helpers.py", line 96, in _unpack
items.extend(struct.unpack_from('!' + ch, buff, offset))
error: unpack_from requires a buffer of at least 27758 bytes
2015-11-04 14:19:24,210 - pykafka.simpleconsumer - ERROR - Exception encountered in worker thread:
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 313, in fetcher
self.fetch()
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 646, in fetch
min_bytes=self._fetch_min_bytes
File "/usr/local/lib/python2.7/dist-packages/pykafka/broker.py", line 244, in fetch_messages
return future.get(FetchResponse)
File "/usr/local/lib/python2.7/dist-packages/pykafka/handlers.py", line 60, in get
raise self.error
2015-11-04 14:19:24,213 - kazoo.handlers.threading - ERROR - Exception in worker queue thread
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/kazoo/handlers/threading.py", line 99, in _thread_worker
func()
File "/usr/local/lib/python2.7/dist-packages/kazoo/handlers/threading.py", line 196, in <lambda>
self.callback_queue.put(lambda: callback.func(*callback.args))
File "/usr/local/lib/python2.7/dist-packages/kazoo/recipe/watchers.py", line 341, in _watcher
self._get_children(event)
File "/usr/local/lib/python2.7/dist-packages/kazoo/recipe/watchers.py", line 36, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/kazoo/recipe/watchers.py", line 333, in _get_children
result = self._func(children)
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 532, in _consumers_changed
self._rebalance()
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 441, in _rebalance
self._setup_internal_consumer()
File "/usr/local/lib/python2.7/dist-packages/pykafka/balancedconsumer.py", line 295, in _setup_internal_consumer
auto_start=start
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 162, in __init__
self._discover_offset_manager()
File "/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.py", line 259, in _discover_offset_manager
self._offset_manager = self._cluster.get_offset_manager(self._consumer_group)
File "/usr/local/lib/python2.7/dist-packages/pykafka/cluster.py", line 295, in get_offset_manager
res = future.get(ConsumerMetadataResponse)
File "/usr/local/lib/python2.7/dist-packages/pykafka/handlers.py", line 62, in get
return response_cls(self.response)
File "/usr/local/lib/python2.7/dist-packages/pykafka/protocol.py", line 907, in __init__
response = struct_helpers.unpack_from(fmt, buff, 0)
File "/usr/local/lib/python2.7/dist-packages/pykafka/utils/struct_helpers.py", line 49, in unpack_from
output = _unpack(fmt, buff, offset, 1)[0]
File "/usr/local/lib/python2.7/dist-packages/pykafka/utils/struct_helpers.py", line 96, in _unpack
items.extend(struct.unpack_from('!' + ch, buff, offset))
error: unpack_from requires a buffer of at least 27758 bytes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment