Skip to content

Instantly share code, notes, and snippets.

@rberger
Created January 9, 2015 22:46
Show Gist options
  • Save rberger/043c46a625d1287ebc1a to your computer and use it in GitHub Desktop.
Save rberger/043c46a625d1287ebc1a to your computer and use it in GitHub Desktop.
Kafka Performance test yammer metrics CsvReport always fails to create csv file
bin/kafka-run-class.sh kafka.tools.ProducerPerformance --topics ${topic_base_name}-part-1-rep-3 --messages 5000 --message-size 100 --request-num-acks -1 --broker-list ${kafka0}:${kafka_port},${kafka1}:${kafka_port},${kafka2}:${kafka_port} --batch-size 8196 --csv-reporter-enabled
start.time, end.time, compression, message.size, batch.size, total.data.sent.in.MB, MB.sec, total.data.sent.in.nMsg, nMsg.sec
java.io.IOException: Unable to create kafka_metrics/ProducerRequestSize.csv
at com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141)
at com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257)
at com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22)
at com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:194)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:22)
at com.yammer.metrics.core.Histogram.processWith(Histogram.java:231)
at com.yammer.metrics.reporting.CsvReporter.run(CsvReporter.java:163)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
java.io.IOException: Unable to create kafka_metrics/ProducerRequestSize.csv
at com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141)
at com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257)
at com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22)
at com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:194)
at com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:22)
at com.yammer.metrics.core.Histogram.processWith(Histogram.java:231)
at com.yammer.metrics.reporting.CsvReporter.run(CsvReporter.java:163)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2015-01-09 14:39:43:063, 2015-01-09 14:39:45:261, 0, 100, 8196, 0.48, 0.2169, 5000, 2274.7953
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment