| Type | Compression Ratio | CPU Usage | Compressions Speed | Network Bandwidth Usage |
|---|---|---|---|---|
| Gzip | Highest | Highest | Slowest | Lowest |
| Snappy | Moderate | Moderate | Moderate | Moderate |
| Lz4 | Lowest | Lowest | Fastest | Highest |
| Zstd | Moderate | Moderate | Moderate | Moderate |
dmusicant-dk
dmusicant-dk
/ compression.md
Created
June 13, 2023 22:00
dmusicant-dk
/ segments_partitions.md
Created
June 13, 2023 21:53
| Details | Why / Benefits |
Partition |
|
dmusicant-dk
/ combined_;olicy.md
Created
June 13, 2023 21:48
Extra Credit
- Create a topic called
"compacted-expiring-topic"using thekafka-topicscommand - Make sure the topic has a combined cleanup policy and the proper retention and segment timings
- Essentially combine the configurations used in the previous two exercises
- Repeat the exercise steps from either 1.a.1 or 1.b.1, but make sure you set the
"generate-test-data.ps1"mode to"retention-policy-delete-publisher".
dmusicant-dk
/ compaction_dups_extra.md
Created
June 13, 2023 21:23
Extra Credit
Why do you think even with compaction, you can get duplicates?
Click to view the answer...
There are two key aspects to compaction that allow for duplicates:
-
The cleanup policy compact guarantees only that at least one message for each key will be available
dmusicant-dk
/ compaction_config.md
Created
June 13, 2023 20:58
| Setting | Description |
segment.ms |
The period of time after which Kafka will force the log to roll even if the segment file isn’t full |
dmusicant-dk
/ cleanup_policies.md
Created
June 13, 2023 19:10
| Description | Use Case |
Delete |
|
dmusicant-dk
/ producers_ex_3_endpoints.md
Created
June 13, 2023 18:40
| Method | Action | Return | Objects Used From DI |
/users |
|||
dmusicant-dk
/ producer_method.md
Created
June 13, 2023 17:37
ProduceUpdate(User user) |
Produces a JSON serialized user |
ProducerDelete(long userId) |
Produces a Null value for the userId key |
dmusicant-dk
/ serialization.md
Created
June 13, 2023 17:27
| Message Part | Type | Serializer |
Key |
long (Int64) |
dmusicant-dk
/ producer_ex_1_message.md
Created
June 13, 2023 17:03
Key |
String value of the loop iteration i |
Value |
String value of the exact time |
NewerOlder