Skip to content

Instantly share code, notes, and snippets.

@dehora

dehora/kafka-msg.txt

Last active August 10, 2016 22:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dehora/d54875a07fcd0af8b93c9a0aeb569c3b to your computer and use it in GitHub Desktop.
Save dehora/d54875a07fcd0af8b93c9a0aeb569c3b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
kafka-msg.txt
RequestMessage
+---------------+---------------+---------------+---------------+
| Size (int32) |
+---------------+---------------+---------------+---------------+
| ApiKey (int16) | ApiVersion (int16) |
+---------------+---------------+---------------+---------------+
| CorrelationId (int32) |
+---------------+---------------+---------------+---------------+
| ClientId (str, 0..)
...
+---------------+---------------+-------------------------------+
| Request(Metadata|Produce|Fetch|Offset|OffsetCommit|OffsetFetch)
...
+---------------+---------------+-------------------------------+
ResponseMessage
+---------------+---------------+---------------+---------------+
| Size (int32) |
+---------------+---------------+---------------+---------------+
| CorrelationId (int32) |
+---------------+---------------+-------------------------------+
| Res(Metadata|Produce|Fetch|Offset|OffsetCommit|OffsetFetch)
...
+---------------+---------------+-------------------------------+
On Wire Message
+-------+-------+----+----+---------------+
|Len(4) |Crc(4) |M(1)|A(1)| Timestamp(8) |
+-------+-------+----+----+---------------+-----------+
|KLen(4)| Key (N) ... ... |
+-------+---------------------------------------------+
|VLen(4)| Value (N) ... ... |
+-----------------------------------------------------+
On Disk Message
+---------------+-------+-------+--+--+---------------+
| Offset (8) |Len(4) |Crc(4) |M |A | Timestamp(8) |
+-------+-------+-------+-------+--+--+---------------+
|KLen(4)| Key (N) ... ... |
+-------+---------------------------------------------+
|VLen(4)| Value (N) ... ... |
+-----------------------------------------------------+
Message Send (Fetch)
+---------------+-------+
| Len (4) |Err(2) |
+-------+-------+-------+-----------------------------+
|On Wire Message 1 ... |
+-----------------------------------------------------+
|... |
+-----------------------------------------------------+
|On Wire Message N ... |
+-----------------------------------------------------+
MultiMessage Send (Fetch)
+---------------+-------+
| Len (4) |Err(2) |
+-------+-------+-------+-----------------------------+
|Message Send 1 ... |
+-----------------------------------------------------+
|... |
+-----------------------------------------------------+
|Message Send 2 ... |
+-----------------------------------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment