Skip to content

Instantly share code, notes, and snippets.

@briansorahan

briansorahan/logs

Created February 1, 2019 19:38
Show Gist options
  • Save briansorahan/258f08139f4d6c8ce8f934caefb97092 to your computer and use it in GitHub Desktop.
Save briansorahan/258f08139f4d6c8ce8f934caefb97092 to your computer and use it in GitHub Desktop.
Download ZIP
rdkafka debug logging
Raw
logs
%7|1549049645.355|MEMBERID|rdkafka#consumer-1| [thrd:app]: Group "reprocess": updating member id "(not-set)" -> ""
%7|1549049645.356|BRKREASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" management reassigned from broker (none) to :0/internal
%7|1549049645.356|CGRPSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed state init -> wait-broker (v1, join-state init)
%7|1549049645.356|BRKASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" management assigned to broker :0/internal
%7|1549049645.356|INIT|rdkafka#consumer-1| [thrd:app]: librdkafka v0.11.6 (0xb06ff) rdkafka#consumer-1 initialized (builtin.features 0xffff, debug 0x2504)
%7|1549049645.360|TOPIC|rdkafka#consumer-1| [thrd:app]: New local topic: diml.denormalized-dataset.errors
%7|1549049645.360|TOPPARNEW|rdkafka#consumer-1| [thrd:app]: NEW diml.denormalized-dataset.errors [-1] 0x4f074a0 (at rd_kafka_topic_new0:362)
%7|1549049645.667|STATE|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors changed state unknown -> exists
%7|1549049645.667|PARTCNT|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition count changed from 0 to 5
%7|1549049645.667|TOPPARNEW|rdkafka#consumer-1| [thrd:main]: NEW diml.denormalized-dataset.errors [0] 0x5c20b90 (at rd_kafka_topic_partition_cnt_update:589)
%7|1549049645.667|TOPPARNEW|rdkafka#consumer-1| [thrd:main]: NEW diml.denormalized-dataset.errors [1] 0x5c21070 (at rd_kafka_topic_partition_cnt_update:589)
%7|1549049645.667|TOPPARNEW|rdkafka#consumer-1| [thrd:main]: NEW diml.denormalized-dataset.errors [2] 0x5c21550 (at rd_kafka_topic_partition_cnt_update:589)
%7|1549049645.667|TOPPARNEW|rdkafka#consumer-1| [thrd:main]: NEW diml.denormalized-dataset.errors [3] 0x5c21a30 (at rd_kafka_topic_partition_cnt_update:589)
%7|1549049645.667|TOPPARNEW|rdkafka#consumer-1| [thrd:main]: NEW diml.denormalized-dataset.errors [4] 0x5c21f10 (at rd_kafka_topic_partition_cnt_update:589)
%7|1549049645.667|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 0 Leader 70206
%7|1549049645.667|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0]: delegate to broker (none) (rktp 0x5c20b90, term 0, ref 2, remove 0)
%7|1549049645.667|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0]: broker :0/internal is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.667|BRKMIGR|rdkafka#consumer-1| [thrd:main]: Migrating topic diml.denormalized-dataset.errors [0] 0x5c20b90 from (none) to :0/internal (sending PARTITION_JOIN to :0/internal)
%7|1549049645.667|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 1 Leader 70207
%7|1549049645.667|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [0]: joining broker (rktp 0x5c20b90)
%7|1549049645.667|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1]: delegate to broker 10.135.7.207:9092/70207 (rktp 0x5c21070, term 0, ref 2, remove 0)
%7|1549049645.667|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1]: broker 10.135.7.207:9092/70207 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.667|BRKMIGR|rdkafka#consumer-1| [thrd:main]: Migrating topic diml.denormalized-dataset.errors [1] 0x5c21070 from (none) to 10.135.7.207:9092/70207 (sending PARTITION_JOIN to 10.135.7.207:9092/70207)
%7|1549049645.667|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 2 Leader 2038
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2]: delegate to broker (none) (rktp 0x5c21550, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2]: broker :0/internal is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|BRKMIGR|rdkafka#consumer-1| [thrd:main]: Migrating topic diml.denormalized-dataset.errors [2] 0x5c21550 from (none) to :0/internal (sending PARTITION_JOIN to :0/internal)
%7|1549049645.668|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 3 Leader 70206
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [2]: joining broker (rktp 0x5c21550)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3]: delegate to broker (none) (rktp 0x5c21a30, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3]: broker :0/internal is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|BRKMIGR|rdkafka#consumer-1| [thrd:main]: Migrating topic diml.denormalized-dataset.errors [3] 0x5c21a30 from (none) to :0/internal (sending PARTITION_JOIN to :0/internal)
%7|1549049645.668|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 4 Leader 70207
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [3]: joining broker (rktp 0x5c21a30)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4]: delegate to broker 10.135.7.207:9092/70207 (rktp 0x5c21f10, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4]: broker 10.135.7.207:9092/70207 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|BRKMIGR|rdkafka#consumer-1| [thrd:main]: Migrating topic diml.denormalized-dataset.errors [4] 0x5c21f10 from (none) to 10.135.7.207:9092/70207 (sending PARTITION_JOIN to 10.135.7.207:9092/70207)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: diml.denormalized-dataset.errors [1]: delegate to broker 10.135.7.207:9092/70207 (rktp 0x5c21070, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: diml.denormalized-dataset.errors [1]: broker 10.135.7.207:9092/70207 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: diml.denormalized-dataset.errors [4]: delegate to broker 10.135.7.207:9092/70207 (rktp 0x5c21f10, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: diml.denormalized-dataset.errors [4]: broker 10.135.7.207:9092/70207 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|LEADER|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Mapped 2 partition(s) to broker
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Topic diml.denormalized-dataset.errors [1]: joining broker (rktp 0x5c21070)
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Topic diml.denormalized-dataset.errors [4]: joining broker (rktp 0x5c21f10)
%7|1549049645.668|TOPICUPD|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: Topic diml.denormalized-dataset.errors [2] migrated from broker -1 to 2038
%7|1549049645.668|METADATA|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: 1/1 requested topic(s) seen in metadata
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: diml.denormalized-dataset.errors [2]: delegate to broker 10.135.2.38:9092/2038 (rktp 0x5c21550, term 0, ref 2, remove 0)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: diml.denormalized-dataset.errors [2]: broker :0/internal no longer leader
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: diml.denormalized-dataset.errors [2]: broker 10.135.2.38:9092/2038 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.668|BRKMIGR|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: Migrating topic diml.denormalized-dataset.errors [2] 0x5c21550 from :0/internal to 10.135.2.38:9092/2038 (sending PARTITION_LEAVE to :0/internal)
%7|1549049645.668|LEADER|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Mapped 1 partition(s) to broker
%7|1549049645.668|TOPICUPD|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Topic diml.denormalized-dataset.errors [0] migrated from broker -1 to 70206
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [2]: leaving broker (0 messages in xmitq, next leader 10.135.2.38:9092/2038, rktp 0x5c21550)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [0]: delegate to broker 10.135.7.206:9092/70206 (rktp 0x5c20b90, term 0, ref 2, remove 0)
%7|1549049645.668|TOPBRK|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Topic diml.denormalized-dataset.errors [2]: joining broker (rktp 0x5c21550)
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [0]: broker :0/internal no longer leader
%7|1549049645.668|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [0]: broker 10.135.7.206:9092/70206 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.669|BRKMIGR|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Migrating topic diml.denormalized-dataset.errors [0] 0x5c20b90 from :0/internal to 10.135.7.206:9092/70206 (sending PARTITION_LEAVE to :0/internal)
%7|1549049645.669|TOPICUPD|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Topic diml.denormalized-dataset.errors [3] migrated from broker -1 to 70206
%7|1549049645.669|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [3]: delegate to broker 10.135.7.206:9092/70206 (rktp 0x5c21a30, term 0, ref 2, remove 0)
%7|1549049645.669|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [3]: broker :0/internal no longer leader
%7|1549049645.669|BRKDELGT|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: diml.denormalized-dataset.errors [3]: broker 10.135.7.206:9092/70206 is now leader for partition with 0 messages (0 bytes) queued
%7|1549049645.669|BRKMIGR|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Migrating topic diml.denormalized-dataset.errors [3] 0x5c21a30 from :0/internal to 10.135.7.206:9092/70206 (sending PARTITION_LEAVE to :0/internal)
%7|1549049645.669|LEADER|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Mapped 2 partition(s) to broker
%7|1549049645.669|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [0]: leaving broker (0 messages in xmitq, next leader 10.135.7.206:9092/70206, rktp 0x5c20b90)
%7|1549049645.669|TOPBRK|rdkafka#consumer-1| [thrd::0/internal]: :0/internal: Topic diml.denormalized-dataset.errors [3]: leaving broker (0 messages in xmitq, next leader 10.135.7.206:9092/70206, rktp 0x5c21a30)
%7|1549049645.669|TOPBRK|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Topic diml.denormalized-dataset.errors [0]: joining broker (rktp 0x5c20b90)
%7|1549049645.669|BRKREASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" management reassigned from broker :0/internal to 10.135.2.38:9092/2038
%7|1549049645.669|TOPBRK|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Topic diml.denormalized-dataset.errors [3]: joining broker (rktp 0x5c21a30)
%7|1549049645.669|BRKUNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" management unassigned from broker handle :0/internal
%7|1549049645.669|BRKASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" management assigned to broker 10.135.2.38:9092/2038
%7|1549049645.669|CGRPQUERY|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Group "reprocess": querying for coordinator: intervaled in state wait-broker
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 0 Leader 70206
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 1 Leader 70207
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 2 Leader 2038
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 3 Leader 70206
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 4 Leader 70207
%7|1549049645.767|METADATA|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: 1/1 requested topic(s) seen in metadata
%7|1549049645.768|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op SUBSCRIBE (v0) in state wait-broker (join state init, v1 vs 0)
%7|1549049645.768|SUBSCRIBE|rdkafka#consumer-1| [thrd:main]: Group "reprocess": subscribe to new subscription of 1 topics (join state init)
%7|1549049645.768|UNSUBSCRIBE|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unsubscribe from current unset subscription of 0 topics (leave group=no, join state init, v1)
%7|1549049645.768|GRPLEADER|rdkafka#consumer-1| [thrd:main]: Group "reprocess": resetting group leader info: unsubscribe
%7|1549049645.768|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state init -> wait-unassign (v1, state wait-broker)
%7|1549049645.768|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state wait-broker (join state wait-unassign): without new assignment: unassign (no previous assignment)
%7|1549049645.768|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state wait-unassign -> init (v1, state wait-broker)
%7|1549049645.770|CGRPCOORD|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Group "reprocess" coordinator is 10.135.2.38:9092 id 2038
%7|1549049645.770|CGRPCOORD|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changing coordinator -1 -> 2038
%7|1549049645.770|CGRPSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed state wait-broker -> wait-broker-transport (v1, join-state init)
%7|1549049645.770|CGRPSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed state wait-broker-transport -> up (v1, join-state init)
%7|1549049645.770|JOIN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": join with 0 (1) subscribed topic(s)
%7|1549049645.770|CGRPMETADATA|rdkafka#consumer-1| [thrd:main]: consumer join: metadata for subscription is up to date (2ms old)
%7|1549049645.770|SUBSCRIPTION|rdkafka#consumer-1| [thrd:main]: Group "reprocess": effective subscription list changed from 0 to 1 topic(s):
%7|1549049645.770|SUBSCRIPTION|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors with 5 partition(s)
%7|1549049645.770|JOIN|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Joining group "reprocess" with 1 subscribed topic(s)
%7|1549049645.770|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state init -> wait-join (v1, state up)
%7|1549049650.359|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit internal error: Local: No offset stored
%7|1549049650.359|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit for -1 partition(s): cgrp auto commit timer: returned: Local: No offset stored
%7|1549049650.359|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state up (join state wait-join): without new assignment: OffsetCommit done (__NO_OFFSET)
%7|1549049655.360|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit internal error: Local: No offset stored
%7|1549049655.360|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit for -1 partition(s): cgrp auto commit timer: returned: Local: No offset stored
%7|1549049655.360|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state up (join state wait-join): without new assignment: OffsetCommit done (__NO_OFFSET)
%7|1549049660.364|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit internal error: Local: No offset stored
%7|1549049660.364|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit for -1 partition(s): cgrp auto commit timer: returned: Local: No offset stored
%7|1549049660.364|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state up (join state wait-join): without new assignment: OffsetCommit done (__NO_OFFSET)
%7|1549049665.367|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit internal error: Local: No offset stored
%7|1549049665.367|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit for -1 partition(s): cgrp auto commit timer: returned: Local: No offset stored
%7|1549049665.367|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state up (join state wait-join): without new assignment: OffsetCommit done (__NO_OFFSET)
%7|1549049670.367|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit internal error: Local: No offset stored
%7|1549049670.367|COMMIT|rdkafka#consumer-1| [thrd:main]: OffsetCommit for -1 partition(s): cgrp auto commit timer: returned: Local: No offset stored
%7|1549049670.367|UNASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": unassign done in state up (join state wait-join): without new assignment: OffsetCommit done (__NO_OFFSET)
%7|1549049672.355|JOINGROUP|rdkafka#consumer-1| [thrd:main]: JoinGroup response: GenerationId 27, Protocol range, LeaderId rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b (me), my MemberId rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b, 1 members in group: (no error)
%7|1549049672.355|MEMBERID|rdkafka#consumer-1| [thrd:main]: Group "reprocess": updating member id "" -> "rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b"
%7|1549049672.355|JOINGROUP|rdkafka#consumer-1| [thrd:main]: Elected leader for group "reprocess" with 1 member(s)
%7|1549049672.355|GRPLEADER|rdkafka#consumer-1| [thrd:main]: Group "reprocess": resetting group leader info: JoinGroup response clean-up
%7|1549049672.355|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state wait-join -> wait-metadata (v1, state up)
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 0 Leader 70206
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 1 Leader 70207
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 2 Leader 2038
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 3 Leader 70206
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors partition 4 Leader 70207
%7|1549049672.496|METADATA|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: 1/1 requested topic(s) seen in metadata
%7|1549049672.496|ASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" running range assignment for 1 member(s):
%7|1549049672.496|ASSIGN|rdkafka#consumer-1| [thrd:main]: Member "rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b" (me) with 1 subscription(s):
%7|1549049672.496|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [-1]
%7|1549049672.496|ASSIGN|rdkafka#consumer-1| [thrd:main]: range: Topic diml.denormalized-dataset.errors with 5 partition(s) and 1 subscribing member(s)
%7|1549049672.496|ASSIGN|rdkafka#consumer-1| [thrd:main]: range: Member "rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b": assigned topic diml.denormalized-dataset.errors partitions 0..4
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess" range assignment for 1 member(s) finished in 0.154ms:
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: Member "rdkafka-c6868e09-40b7-4df7-9656-792f52efe92b" (me) assigned 5 partition(s):
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0]
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1]
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2]
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3]
%7|1549049672.497|ASSIGN|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4]
%7|1549049672.497|ASSIGNOR|rdkafka#consumer-1| [thrd:main]: Group "reprocess": "range" assignor run for 1 member(s)
%7|1549049672.497|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state wait-metadata -> wait-sync (v1, state up)
%7|1549049672.662|SYNCGROUP|rdkafka#consumer-1| [thrd:main]: SyncGroup response: Success (68 bytes of MemberState data)
%7|1549049672.662|ASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": delegating assign of 5 partition(s) to application rebalance callback on queue rd_kafka_cgrp_new: new assignment
%7|1549049672.662|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state wait-sync -> wait-assign-rebalance_cb (v1, state up)
%7|1549049672.662|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
2019/02/01 13:34:32 assigning partitions [diml.denormalized-dataset.errors[0]@beginning diml.denormalized-dataset.errors[1]@beginning diml.denormalized-dataset.errors[2]@beginning diml.denormalized-dataset.errors[3]@beginning diml.denormalized-dataset.errors[4]@beginning]
%7|1549049672.663|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op ASSIGN (v0) in state up (join state wait-assign-rebalance_cb, v1 vs 0)
%7|1549049672.663|ASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": new assignment of 5 partition(s) in join state wait-assign-rebalance_cb
%7|1549049672.663|DESP|rdkafka#consumer-1| [thrd:main]: Setting topic diml.denormalized-dataset.errors [0] partition as desired
%7|1549049672.663|DESP|rdkafka#consumer-1| [thrd:main]: Setting topic diml.denormalized-dataset.errors [1] partition as desired
%7|1549049672.663|DESP|rdkafka#consumer-1| [thrd:main]: Setting topic diml.denormalized-dataset.errors [2] partition as desired
%7|1549049672.663|DESP|rdkafka#consumer-1| [thrd:main]: Setting topic diml.denormalized-dataset.errors [3] partition as desired
%7|1549049672.663|DESP|rdkafka#consumer-1| [thrd:main]: Setting topic diml.denormalized-dataset.errors [4] partition as desired
%7|1549049672.663|BARRIER|rdkafka#consumer-1| [thrd:main]: Group "reprocess": rd_kafka_cgrp_assign:2301: new version barrier v2
%7|1549049672.663|ASSIGN|rdkafka#consumer-1| [thrd:main]: Group "reprocess": assigning 5 partition(s) in join state wait-assign-rebalance_cb
%7|1549049672.663|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state wait-assign-rebalance_cb -> assigned (v2, state up)
%7|1549049672.663|BARRIER|rdkafka#consumer-1| [thrd:main]: Group "reprocess": rd_kafka_cgrp_partitions_fetch_start0:1641: new version barrier v3
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: Group "reprocess": starting fetchers for 5 assigned partition(s) in join-state assigned (usable_offsets=no, v3, line 2346)
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: List with 5 partition(s):
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0] offset BEGINNING
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1] offset BEGINNING
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2] offset BEGINNING
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3] offset BEGINNING
%7|1549049672.663|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4] offset BEGINNING
%7|1549049672.663|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest: skipping diml.denormalized-dataset.errors [0] with valid offset BEGINNING
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest: skipping diml.denormalized-dataset.errors [1] with valid offset BEGINNING
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest: skipping diml.denormalized-dataset.errors [2] with valid offset BEGINNING
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest: skipping diml.denormalized-dataset.errors [3] with valid offset BEGINNING
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest: skipping diml.denormalized-dataset.errors [4] with valid offset BEGINNING
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetFetchRequest(v1) for 0/5 partition(s)
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: List with 5 partition(s):
2019/02/01 13:34:32 assigned partitions
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0] offset BEGINNING
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1] offset BEGINNING
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2] offset BEGINNING
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3] offset BEGINNING
%7|1549049672.664|OFFSETFETCH|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4] offset BEGINNING
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: Group "reprocess": rd_kafka_cgrp_partitions_fetch_start0:1641: new version barrier v4
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: Group "reprocess": starting fetchers for 5 assigned partition(s) in join-state assigned (usable_offsets=yes, v4, line 1573)
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: List with 5 partition(s):
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0] offset BEGINNING
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1] offset BEGINNING
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2] offset BEGINNING
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3] offset BEGINNING
%7|1549049672.664|FETCHSTART|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4] offset BEGINNING
%7|1549049672.664|CGRPJOINSTATE|rdkafka#consumer-1| [thrd:main]: Group "reprocess" changed join state assigned -> started (v4, state up)
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0]: rd_kafka_toppar_op_fetch_start:2193: new version barrier v2
%7|1549049672.664|CONSUMER|rdkafka#consumer-1| [thrd:main]: Start consuming diml.denormalized-dataset.errors [0] at offset BEGINNING (v2)
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1]: rd_kafka_toppar_op_fetch_start:2193: new version barrier v2
%7|1549049672.664|CONSUMER|rdkafka#consumer-1| [thrd:main]: Start consuming diml.denormalized-dataset.errors [1] at offset BEGINNING (v2)
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2]: rd_kafka_toppar_op_fetch_start:2193: new version barrier v2
%7|1549049672.664|CONSUMER|rdkafka#consumer-1| [thrd:main]: Start consuming diml.denormalized-dataset.errors [2] at offset BEGINNING (v2)
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3]: rd_kafka_toppar_op_fetch_start:2193: new version barrier v2
%7|1549049672.664|CONSUMER|rdkafka#consumer-1| [thrd:main]: Start consuming diml.denormalized-dataset.errors [3] at offset BEGINNING (v2)
%7|1549049672.664|BARRIER|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4]: rd_kafka_toppar_op_fetch_start:2193: new version barrier v2
%7|1549049672.664|CONSUMER|rdkafka#consumer-1| [thrd:main]: Start consuming diml.denormalized-dataset.errors [4] at offset BEGINNING (v2)
%7|1549049672.664|OP|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0] received op FETCH_START (v2) in fetch-state none (opv1)
%7|1549049672.664|FETCH|rdkafka#consumer-1| [thrd:main]: Start fetch for diml.denormalized-dataset.errors [0] in state none at offset BEGINNING (v2)
%7|1549049672.664|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [0] changed fetch state none -> offset-query
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [0]: offset reset (at offset BEGINNING) to BEGINNING: update: Success
%7|1549049672.664|OFFREQ|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: Partition diml.denormalized-dataset.errors [0]: querying for logical offset BEGINNING (opv 2)
%7|1549049672.664|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: OffsetRequest (v0, opv 0) for 1 topic(s) and 1 partition(s)
%7|1549049672.664|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [0] changed fetch state offset-query -> offset-wait
%7|1549049672.665|OP|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1] received op FETCH_START (v2) in fetch-state none (opv1)
%7|1549049672.665|FETCH|rdkafka#consumer-1| [thrd:main]: Start fetch for diml.denormalized-dataset.errors [1] in state none at offset BEGINNING (v2)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [1] changed fetch state none -> offset-query
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [1]: offset reset (at offset BEGINNING) to BEGINNING: update: Success
%7|1549049672.665|OFFREQ|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Partition diml.denormalized-dataset.errors [1]: querying for logical offset BEGINNING (opv 2)
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: OffsetRequest (v0, opv 0) for 1 topic(s) and 1 partition(s)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [1] changed fetch state offset-query -> offset-wait
%7|1549049672.665|OP|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2] received op FETCH_START (v2) in fetch-state none (opv1)
%7|1549049672.665|FETCH|rdkafka#consumer-1| [thrd:main]: Start fetch for diml.denormalized-dataset.errors [2] in state none at offset BEGINNING (v2)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [2] changed fetch state none -> offset-query
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [2]: offset reset (at offset BEGINNING) to BEGINNING: update: Success
%7|1549049672.665|OFFREQ|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Partition diml.denormalized-dataset.errors [2]: querying for logical offset BEGINNING (opv 2)
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetRequest (v0, opv 0) for 1 topic(s) and 1 partition(s)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [2] changed fetch state offset-query -> offset-wait
%7|1549049672.665|OP|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3] received op FETCH_START (v2) in fetch-state none (opv1)
%7|1549049672.665|FETCH|rdkafka#consumer-1| [thrd:main]: Start fetch for diml.denormalized-dataset.errors [3] in state none at offset BEGINNING (v2)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [3] changed fetch state none -> offset-query
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [3]: offset reset (at offset BEGINNING) to BEGINNING: update: Success
%7|1549049672.665|OFFREQ|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: Partition diml.denormalized-dataset.errors [3]: querying for logical offset BEGINNING (opv 2)
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: OffsetRequest (v0, opv 0) for 1 topic(s) and 1 partition(s)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [3] changed fetch state offset-query -> offset-wait
%7|1549049672.665|OP|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4] received op FETCH_START (v2) in fetch-state none (opv1)
%7|1549049672.665|FETCH|rdkafka#consumer-1| [thrd:main]: Start fetch for diml.denormalized-dataset.errors [4] in state none at offset BEGINNING (v2)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [4] changed fetch state none -> offset-query
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: diml.denormalized-dataset.errors [4]: offset reset (at offset BEGINNING) to BEGINNING: update: Success
%7|1549049672.665|OFFREQ|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Partition diml.denormalized-dataset.errors [4]: querying for logical offset BEGINNING (opv 2)
%7|1549049672.665|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: OffsetRequest (v0, opv 0) for 1 topic(s) and 1 partition(s)
%7|1549049672.665|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [4] changed fetch state offset-query -> offset-wait
%7|1549049672.665|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op PARTITION_JOIN in state up (join state started, v4) for diml.denormalized-dataset.errors [0]
%7|1549049672.665|PARTADD|rdkafka#consumer-1| [thrd:main]: Group "reprocess": add diml.denormalized-dataset.errors [0]
%7|1549049672.665|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op PARTITION_JOIN in state up (join state started, v4) for diml.denormalized-dataset.errors [1]
%7|1549049672.665|PARTADD|rdkafka#consumer-1| [thrd:main]: Group "reprocess": add diml.denormalized-dataset.errors [1]
%7|1549049672.665|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op PARTITION_JOIN in state up (join state started, v4) for diml.denormalized-dataset.errors [2]
%7|1549049672.665|PARTADD|rdkafka#consumer-1| [thrd:main]: Group "reprocess": add diml.denormalized-dataset.errors [2]
%7|1549049672.665|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op PARTITION_JOIN in state up (join state started, v4) for diml.denormalized-dataset.errors [3]
%7|1549049672.666|PARTADD|rdkafka#consumer-1| [thrd:main]: Group "reprocess": add diml.denormalized-dataset.errors [3]
%7|1549049672.666|CGRPOP|rdkafka#consumer-1| [thrd:main]: Group "reprocess" received op PARTITION_JOIN in state up (join state started, v4) for diml.denormalized-dataset.errors [4]
%7|1549049672.666|PARTADD|rdkafka#consumer-1| [thrd:main]: Group "reprocess": add diml.denormalized-dataset.errors [4]
%7|1549049672.803|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: Offset reply for topic diml.denormalized-dataset.errors [0] (v2 vs v2)
%7|1549049672.803|OFFSET|rdkafka#consumer-1| [thrd:main]: Offset BEGINNING request for diml.denormalized-dataset.errors [0] returned offset 1718242 (1718242)
%7|1549049672.803|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [0] changed fetch state offset-wait -> active
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [0] start fetching at offset 1718242
%7|1549049672.803|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Offset reply for topic diml.denormalized-dataset.errors [1] (v2 vs v2)
%7|1549049672.803|FETCHDEC|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Topic diml.denormalized-dataset.errors [0]: fetch decide: updating to version 2 (was 0) at offset 1718242 (was 0)
%7|1549049672.803|OFFSET|rdkafka#consumer-1| [thrd:main]: Offset BEGINNING request for diml.denormalized-dataset.errors [1] returned offset 1716811 (1716811)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Topic diml.denormalized-dataset.errors [0] in state active at offset 1718242 (0/100000 msgs, 0/1048576 kb queued, opv 2) is fetchable:
%7|1549049672.803|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [1] changed fetch state offset-wait -> active
%7|1549049672.803|FETCHADD|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Added diml.denormalized-dataset.errors [0] to fetch list (1 entries, opv 2)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [1] start fetching at offset 1716811
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1718242 (v2)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 1/1/2 toppar(s)
%7|1549049672.803|FETCHDEC|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: Topic diml.denormalized-dataset.errors [1]: fetch decide: updating to version 2 (was 0) at offset 1716811 (was 0)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Topic diml.denormalized-dataset.errors [1] in state active at offset 1716811 (0/100000 msgs, 0/1048576 kb queued, opv 2) is fetchable:
%7|1549049672.803|FETCHADD|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Added diml.denormalized-dataset.errors [1] to fetch list (1 entries, opv 2)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1716811 (v2)
%7|1549049672.803|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 1/1/2 toppar(s)
%7|1549049672.924|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Offset reply for topic diml.denormalized-dataset.errors [2] (v2 vs v2)
%7|1549049672.924|OFFSET|rdkafka#consumer-1| [thrd:main]: Offset BEGINNING request for diml.denormalized-dataset.errors [2] returned offset 1718421 (1718421)
%7|1549049672.924|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [2] changed fetch state offset-wait -> active
%7|1549049672.924|FETCH|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [2] start fetching at offset 1718421
%7|1549049672.924|FETCHDEC|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: Topic diml.denormalized-dataset.errors [2]: fetch decide: updating to version 2 (was 0) at offset 1718421 (was 0)
%7|1549049672.924|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Topic diml.denormalized-dataset.errors [2] in state active at offset 1718421 (0/100000 msgs, 0/1048576 kb queued, opv 2) is fetchable:
%7|1549049672.924|FETCHADD|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Added diml.denormalized-dataset.errors [2] to fetch list (1 entries, opv 2)
%7|1549049672.924|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1718421 (v2)
%7|1549049672.924|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049672.926|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.206:9092/70206: Offset reply for topic diml.denormalized-dataset.errors [3] (v2 vs v2)
%7|1549049672.926|OFFSET|rdkafka#consumer-1| [thrd:main]: Offset BEGINNING request for diml.denormalized-dataset.errors [3] returned offset 1716232 (1716232)
%7|1549049672.926|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [3] changed fetch state offset-wait -> active
%7|1549049672.926|FETCH|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [3] start fetching at offset 1716232
%7|1549049672.927|FETCHDEC|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: Topic diml.denormalized-dataset.errors [3]: fetch decide: updating to version 2 (was 0) at offset 1716232 (was 0)
%7|1549049672.927|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Topic diml.denormalized-dataset.errors [3] in state active at offset 1716232 (0/100000 msgs, 0/1048576 kb queued, opv 2) is fetchable:
%7|1549049672.927|FETCHADD|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Added diml.denormalized-dataset.errors [3] to fetch list (2 entries, opv 2)
%7|1549049672.927|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.7.207:9092/70207: Offset reply for topic diml.denormalized-dataset.errors [4] (v2 vs v2)
%7|1549049672.927|OFFSET|rdkafka#consumer-1| [thrd:main]: Offset BEGINNING request for diml.denormalized-dataset.errors [4] returned offset 1717823 (1717823)
%7|1549049672.927|PARTSTATE|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [4] changed fetch state offset-wait -> active
%7|1549049672.927|FETCH|rdkafka#consumer-1| [thrd:main]: Partition diml.denormalized-dataset.errors [4] start fetching at offset 1717823
%7|1549049672.927|FETCHDEC|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: Topic diml.denormalized-dataset.errors [4]: fetch decide: updating to version 2 (was 0) at offset 1717823 (was 0)
%7|1549049672.927|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Topic diml.denormalized-dataset.errors [4] in state active at offset 1717823 (0/100000 msgs, 0/1048576 kb queued, opv 2) is fetchable:
%7|1549049672.927|FETCHADD|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Added diml.denormalized-dataset.errors [4] to fetch list (2 entries, opv 2)
%7|1549049674.427|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049674.880|CONSUME|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Enqueue 512 message(s) (1034274 bytes, 512 ops) on diml.denormalized-dataset.errors [2] fetch queue (qlen 512, v2, last_offset 1718932, 0 ctrl msgs)
%7|1549049674.880|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1718933 (v2)
%7|1549049674.880|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049674.933|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 509 message(s) (1034135 bytes, 509 ops) on diml.denormalized-dataset.errors [1] fetch queue (qlen 509, v2, last_offset 1717319, 0 ctrl msgs)
%7|1549049674.933|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1717320 (v2)
%7|1549049674.933|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1717823 (v2)
%7|1549049674.933|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049675.024|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 516 message(s) (1033534 bytes, 516 ops) on diml.denormalized-dataset.errors [0] fetch queue (qlen 516, v2, last_offset 1718757, 0 ctrl msgs)
%7|1549049675.024|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1718758 (v2)
%7|1549049675.024|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1716232 (v2)
%7|1549049675.024|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [0]: stored offset 1718758, committed offset -1001
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [0]: setting stored offset 1718758 for commit
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [1]: stored offset 1717320, committed offset -1001
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [1]: setting stored offset 1717320 for commit
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [2]: stored offset 1718933, committed offset -1001
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [2]: setting stored offset 1718933 for commit
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [3]: stored offset -1001, committed offset -1001
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [3]: setting offset INVALID for commit
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [4]: stored offset -1001, committed offset -1001
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [4]: setting offset INVALID for commit
%7|1549049675.370|COMMIT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Committing offsets for 3 partition(s): cgrp auto commit timer
%7|1549049675.370|OFFSET|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Enqueue OffsetCommitRequest(v1, 3/5 partition(s))): cgrp auto commit timer
%7|1549049675.427|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049676.352|CONSUME|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Enqueue 563 message(s) (1033679 bytes, 563 ops) on diml.denormalized-dataset.errors [2] fetch queue (qlen 563, v2, last_offset 1719495, 0 ctrl msgs)
%7|1549049676.352|COMMIT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: OffsetCommit for 5 partition(s): cgrp auto commit timer: returned: Success
%7|1549049676.352|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719496 (v2)
%7|1549049676.352|COMMIT|rdkafka#consumer-1| [thrd:main]: All committed, call fetch_start.
%7|1549049676.352|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049676.428|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049676.904|CONSUME|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Enqueue 211 message(s) (392910 bytes, 211 ops) on diml.denormalized-dataset.errors [2] fetch queue (qlen 211, v2, last_offset 1719706, 0 ctrl msgs)
%7|1549049676.904|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049676.904|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049677.107|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049677.107|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
2019/02/01 13:34:37 reached end of partition 2
2019/02/01 13:34:37 partition counts map[int32]int64{0:516, 2:1286, 1:509}
%7|1549049677.325|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049677.325|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049677.431|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049677.484|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 566 message(s) (1033841 bytes, 566 ops) on diml.denormalized-dataset.errors [0] fetch queue (qlen 566, v2, last_offset 1719323, 0 ctrl msgs)
%7|1549049677.484|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 422 message(s) (858128 bytes, 422 ops) on diml.denormalized-dataset.errors [3] fetch queue (qlen 422, v2, last_offset 1716653, 0 ctrl msgs)
%7|1549049677.484|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1716654 (v2)
%7|1549049677.484|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1719324 (v2)
%7|1549049677.484|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
%7|1549049677.554|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049677.554|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049677.641|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 563 message(s) (1033367 bytes, 563 ops) on diml.denormalized-dataset.errors [1] fetch queue (qlen 563, v2, last_offset 1717882, 0 ctrl msgs)
%7|1549049677.641|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 514 message(s) (1034169 bytes, 514 ops) on diml.denormalized-dataset.errors [4] fetch queue (qlen 514, v2, last_offset 1718336, 0 ctrl msgs)
%7|1549049677.642|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1718337 (v2)
%7|1549049677.642|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1717883 (v2)
%7|1549049677.642|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049677.762|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049677.762|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049677.965|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049677.965|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049678.182|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049678.182|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049678.389|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049678.390|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049678.433|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049678.595|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049678.595|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049678.816|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049678.816|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049679.019|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049679.019|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049679.167|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 563 message(s) (1032596 bytes, 563 ops) on diml.denormalized-dataset.errors [3] fetch queue (qlen 563, v2, last_offset 1717216, 0 ctrl msgs)
%7|1549049679.167|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 220 message(s) (408348 bytes, 220 ops) on diml.denormalized-dataset.errors [0] fetch queue (qlen 220, v2, last_offset 1719543, 0 ctrl msgs)
%7|1549049679.167|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1719544 (v2)
%7|1549049679.167|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1717217 (v2)
%7|1549049679.167|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
%7|1549049679.221|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049679.221|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049679.290|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 561 message(s) (1032212 bytes, 561 ops) on diml.denormalized-dataset.errors [4] fetch queue (qlen 561, v2, last_offset 1718897, 0 ctrl msgs)
%7|1549049679.290|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 208 message(s) (389762 bytes, 208 ops) on diml.denormalized-dataset.errors [1] fetch queue (qlen 208, v2, last_offset 1718090, 0 ctrl msgs)
%7|1549049679.290|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1718091 (v2)
%7|1549049679.290|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1718898 (v2)
%7|1549049679.290|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049679.424|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049679.424|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049679.435|HEARTBEAT|rdkafka#consumer-1| [thrd:main]: 10.135.2.38:9092/2038: Heartbeat for group "reprocess" generation id 27
%7|1549049679.629|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049679.629|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049679.850|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049679.850|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
2019/02/01 13:34:39 reached end of partition 0
2019/02/01 13:34:39 partition counts map[int32]int64{3:985, 4:1075, 2:1286, 1:1280, 0:1302}
%7|1549049679.856|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Enqueue 298 message(s) (554748 bytes, 298 ops) on diml.denormalized-dataset.errors [3] fetch queue (qlen 298, v2, last_offset 1717514, 0 ctrl msgs)
%7|1549049679.856|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1717515 (v2)
%7|1549049679.856|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1719544 (v2)
%7|1549049679.856|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
2019/02/01 13:34:39 reached end of partition 1
2019/02/01 13:34:39 partition counts map[int32]int64{2:1286, 1:1280, 0:1302, 3:1283, 4:1075}
%7|1549049679.940|CONSUME|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Enqueue 254 message(s) (475792 bytes, 254 ops) on diml.denormalized-dataset.errors [4] fetch queue (qlen 254, v2, last_offset 1719151, 0 ctrl msgs)
%7|1549049679.940|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1719152 (v2)
%7|1549049679.940|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1718091 (v2)
%7|1549049679.940|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049680.058|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049680.058|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049680.058|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1719544 (v2)
%7|1549049680.058|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1717515 (v2)
%7|1549049680.058|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
2019/02/01 13:34:40 reached end of partition 3
2019/02/01 13:34:40 partition counts map[int32]int64{3:1283, 4:1329, 2:1286, 1:1280, 0:1302}
%7|1549049680.144|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1718091 (v2)
%7|1549049680.144|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1719152 (v2)
%7|1549049680.144|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049680.262|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [3] at offset 1717515 (v2)
%7|1549049680.262|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch topic diml.denormalized-dataset.errors [0] at offset 1719544 (v2)
%7|1549049680.263|FETCH|rdkafka#consumer-1| [thrd:10.135.7.206:9092/bootstrap]: 10.135.7.206:9092/70206: Fetch 2/2/2 toppar(s)
%7|1549049680.263|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch topic diml.denormalized-dataset.errors [2] at offset 1719707 (v2)
%7|1549049680.263|FETCH|rdkafka#consumer-1| [thrd:10.135.2.38:9092/bootstrap]: 10.135.2.38:9092/2038: Fetch 1/1/1 toppar(s)
%7|1549049680.350|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [4] at offset 1719152 (v2)
%7|1549049680.350|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch topic diml.denormalized-dataset.errors [1] at offset 1718091 (v2)
%7|1549049680.350|FETCH|rdkafka#consumer-1| [thrd:10.135.7.207:9092/bootstrap]: 10.135.7.207:9092/70207: Fetch 2/2/2 toppar(s)
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [0]: stored offset 1719544, committed offset 1718758
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [0]: setting stored offset 1719544 for commit
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [1]: stored offset 1718091, committed offset 1717320
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [1]: setting stored offset 1718091 for commit
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [2]: stored offset 1719707, committed offset 1718933
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [2]: setting stored offset 1719707 for commit
%7|1549049680.370|OFFSET|rdkafka#consumer-1| [thrd:main]: Topic diml.denormalized-dataset.errors [3]: stored offset 1717515, committed offset -1001
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment