Skip to content

Instantly share code, notes, and snippets.

View cdbartholomew's full-sized avatar

Chris Bartholomew cdbartholomew

13 followers · 3 following
View GitHub Profile
@cdbartholomew
cdbartholomew / table.csv
Created August 30, 2019 19:12
Kafka without fsync, 1 topic, 6 partition, 100 byte
Latency Type Average 50th 75th 95th 99th 99.9th 99.99th Maximum
Publishing (milliseconds) 4.475 3.657 5.814 7.474 8.349 139.389 205.085 213.136
End-to-end (milliseconds) 6.508 5.0 7.0 9.0 19.0 189.0 220.0 277.0
@cdbartholomew
cdbartholomew / table.csv
Created August 30, 2019 19:14
Kafka without fsync, 1 topic, 16 partition, 100 byte
Latency Type Average 50th 75th 95th 99th 99.9th 99.99th Maximum
Publishing (milliseconds) 8.479 8.152 8.781 9.635 10.656 169.557 211.642 234.369
End-to-end (milliseconds) 11.031 10.0 11.0 12.0 28.0 209.0 259.0 319.0
@cdbartholomew
cdbartholomew / table.csv
Created August 30, 2019 19:14
Kafka with fsync, 1 topic, 1 partition, 100 byte
Latency Type Average 50th 75th 95th 99th 99.9th 99.99th Maximum
Publishing (milliseconds) 6.652 6.747 7.277 8.032 8.641 22.416 194.108 219.741
End-to-end (milliseconds) 7.129 7.0 7.0 8.0 9.0 170.0 210.0 243.0
@cdbartholomew
cdbartholomew / table.csv
Created August 30, 2019 19:15
Kafka with fsync, 1 topic, 6 partition, 100 byte
Latency Type Average 50th 75th 95th 99th 99.9th 99.99th Maximum
Publishing (milliseconds) 11.125 10.823 11.33 12.081 13.517 132.025 212.062 225.853
End-to-end (milliseconds) 13.857 13.0 13.0 15.0 32.0 208.0 239.0 287.0
@cdbartholomew
cdbartholomew / table.csv
Created August 30, 2019 19:16
Kafka with fsync, 1 topic, 16 partition, 100 byte
Latency Type Average 50th 75th 95th 99th 99.9th 99.99th Maximum
Publishing (milliseconds) 18.454 17.935 19.815 22.075 23.404 123.801 222.137 290.615
End-to-end (milliseconds) 21.119 20.0 22.0 25.0 33.0 199.0 259.0 334.0
@cdbartholomew
cdbartholomew / 1topic-16partition-100b-ConsumeRate.svg
Last active December 11, 2019 19:44
Test
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@cdbartholomew
cdbartholomew / 1topic-6partition-100b-flush-End-to-endLatencyAvg.png
Last active December 11, 2019 19:40
Kafka/Pulsar Latency combined charts
1topic-6partition-100b-flush-End-to-endLatencyAvg.png
@cdbartholomew
cdbartholomew / sub_demo.py
Last active November 9, 2019 19:44
import pulsar,time,_pulsar
service_url = 'pulsar+ssl://uscentral1.azure.kafkaesque.io:6651'
trust_certs='/etc/ssl/certs/ca-bundle.crt'
token='***************************************************************************************************'
client = pulsar.Client(service_url,
authentication=pulsar.AuthenticationToken(token),
tls_trust_certs_file_path=trust_certs)
consumer = client.subscribe('persistent://azure-kafkaesque-io/local-uscentral1-azure/subscription-demo',
@cdbartholomew
cdbartholomew / sub_demo_shared.py
Last active November 9, 2019 20:27
import pulsar,time,_pulsar
service_url = 'pulsar+ssl://uscentral1.azure.kafkaesque.io:6651'
trust_certs='/etc/ssl/certs/ca-bundle.crt'
token='***********************************************************************************************'
client = pulsar.Client(service_url,
authentication=pulsar.AuthenticationToken(token),
tls_trust_certs_file_path=trust_certs)
consumer = client.subscribe('persistent://azure-kafkaesque-io/local-uscentral1-azure/subscription-demo',
@cdbartholomew
cdbartholomew / sub-demo-prod.py
Created November 9, 2019 19:42
import pulsar
service_url = 'pulsar+ssl://uscentral1.azure.kafkaesque.io:6651'
trust_certs='/etc/ssl/certs/ca-bundle.crt'
token='***************************************************************************'
client = pulsar.Client(service_url,
authentication=pulsar.AuthenticationToken(token),
tls_trust_certs_file_path=trust_certs)
producer = client.create_producer('persistent://azure-kafkaesque-io/local-uscentral1-azure/subscription-demo')