Skip to content

Instantly share code, notes, and snippets.

@eshioji
Created June 3, 2015 09:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save eshioji/a35bda40e3961d59b740 to your computer and use it in GitHub Desktop.
Save eshioji/a35bda40e3961d59b740 to your computer and use it in GitHub Desktop.
wip
[root@strm02l1 ~]# storm jar /tmp/storm_perf_test-1.0.0-SNAPSHOT-jar-with-dependencies.jar com.yahoo.storm.perftest.Main --spoutParallel 4 --boltParallel 8 --maxSpoutPending 1000 --ackEnabled
Running: /usr/java/latest/bin/java -client -Dstorm.options= -Dstorm.home=/usr/share/storm-0.9.4 -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/bin -Dstorm.conf.file= -cp /usr/share/storm-0.9.4/lib/asm-4.0.jar:/usr/share/storm-0.9.4/lib/carbonite-1.4.0.jar:/usr/share/storm-0.9.4/lib/chill-java-0.3.5.jar:/usr/share/storm-0.9.4/lib/clj-stacktrace-0.2.2.jar:/usr/share/storm-0.9.4/lib/clj-time-0.4.1.jar:/usr/share/storm-0.9.4/lib/clojure-1.5.1.jar:/usr/share/storm-0.9.4/lib/clout-1.0.1.jar:/usr/share/storm-0.9.4/lib/commons-codec-1.6.jar:/usr/share/storm-0.9.4/lib/commons-exec-1.1.jar:/usr/share/storm-0.9.4/lib/commons-fileupload-1.2.1.jar:/usr/share/storm-0.9.4/lib/commons-io-2.4.jar:/usr/share/storm-0.9.4/lib/commons-lang-2.5.jar:/usr/share/storm-0.9.4/lib/commons-logging-1.1.3.jar:/usr/share/storm-0.9.4/lib/compojure-1.1.3.jar:/usr/share/storm-0.9.4/lib/core.incubator-0.1.0.jar:/usr/share/storm-0.9.4/lib/disruptor-2.10.1.jar:/usr/share/storm-0.9.4/lib/hiccup-0.3.6.jar:/usr/share/storm-0.9.4/lib/jackson-annotations-2.5.1.jar:/usr/share/storm-0.9.4/lib/jackson-core-2.5.1.jar:/usr/share/storm-0.9.4/lib/jackson-databind-2.5.1.jar:/usr/share/storm-0.9.4/lib/jetty-6.1.26.jar:/usr/share/storm-0.9.4/lib/jetty-util-6.1.26.jar:/usr/share/storm-0.9.4/lib/jgrapht-core-0.9.0.jar:/usr/share/storm-0.9.4/lib/jline-2.11.jar:/usr/share/storm-0.9.4/lib/joda-time-2.0.jar:/usr/share/storm-0.9.4/lib/json-simple-1.1.jar:/usr/share/storm-0.9.4/lib/kryo-2.21.jar:/usr/share/storm-0.9.4/lib/log4j-over-slf4j-1.6.6.jar:/usr/share/storm-0.9.4/lib/logback-classic-1.0.13.jar:/usr/share/storm-0.9.4/lib/logback-core-1.0.13.jar:/usr/share/storm-0.9.4/lib/logstash-logback-encoder-4.0.jar:/usr/share/storm-0.9.4/lib/math.numeric-tower-0.0.1.jar:/usr/share/storm-0.9.4/lib/minlog-1.2.jar:/usr/share/storm-0.9.4/lib/objenesis-1.2.jar:/usr/share/storm-0.9.4/lib/reflectasm-1.07-shaded.jar:/usr/share/storm-0.9.4/lib/ring-core-1.1.5.jar:/usr/share/storm-0.9.4/lib/ring-devel-0.3.11.jar:/usr/share/storm-0.9.4/lib/ring-jetty-adapter-0.3.11.jar:/usr/share/storm-0.9.4/lib/ring-servlet-0.3.11.jar:/usr/share/storm-0.9.4/lib/servlet-api-2.5.jar:/usr/share/storm-0.9.4/lib/slf4j-api-1.7.5.jar:/usr/share/storm-0.9.4/lib/snakeyaml-1.11.jar:/usr/share/storm-0.9.4/lib/storm-core-0.9.5-763-wip.jar:/usr/share/storm-0.9.4/lib/tools.cli-0.2.4.jar:/usr/share/storm-0.9.4/lib/tools.logging-0.2.3.jar:/usr/share/storm-0.9.4/lib/tools.macro-0.1.0.jar:/tmp/storm_perf_test-1.0.0-SNAPSHOT-jar-with-dependencies.jar:/usr/share/storm-0.9.4/conf:/usr/share/storm-0.9.4/bin -Dstorm.jar=/tmp/storm_perf_test-1.0.0-SNAPSHOT-jar-with-dependencies.jar com.yahoo.storm.perftest.Main --spoutParallel 4 --boltParallel 8 --maxSpoutPending 1000 --ackEnabled
400 [main] INFO com.yahoo.storm.perftest.Main - Adding in 4 spouts
413 [main] INFO com.yahoo.storm.perftest.Main - Adding in 8 bolts
530 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting jar...
536 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar /tmp/storm_perf_test-1.0.0-SNAPSHOT-jar-with-dependencies.jar to assigned location: /tmp/storm/nimbus/inbox/stormjar-7d515760-af2a-4c99-bf69-5e7dd02b7b86.jar
545 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded topology jar to assigned location: /tmp/storm/nimbus/inbox/stormjar-7d515760-af2a-4c99-bf69-5e7dd02b7b86.jar
545 [main] INFO backtype.storm.StormSubmitter - Submitting topology test_0 in distributed mode with conf {"topology.workers":3,"topology.acker.executors":1,"topology.debug":false,"topology.max.spout.pending":1000}
634 [main] INFO backtype.storm.StormSubmitter - Finished submitting topology: test_0
status topologies totalSlots slotsUsed totalExecutors executorsWithMetrics time time-diff ms transferred throughput (MB/s)
WAITING 1 4 0 13 0 1433324574689 0 0 0.0
WAITING 1 4 3 13 13 1433324604689 30000 1407740 4.475084940592448
WAITING 1 4 3 13 13 1433324634689 30000 2300260 7.312329610188802
RUNNING 1 4 3 13 13 1433324664690 30001 2350500 7.4717892094026555
RUNNING 1 4 3 13 13 1433324694689 29999 2501560 7.9525101601694015
RUNNING 1 4 3 13 13 1433324724689 30000 2468840 7.8482309977213545
RUNNING 1 4 3 13 13 1433324754689 30000 2388940 7.594235738118489
RUNNING 1 4 3 13 13 1433324784690 30001 2351720 7.4756673556844975
RUNNING 1 4 3 13 13 1433324814689 29999 2469640 7.8510358304261185
RUNNING 1 4 3 13 13 1433324844689 30000 2470400 7.853190104166667
RUNNING 1 4 3 13 13 1433324874689 30000 2415440 7.678476969401042
RUNNING 1 4 3 13 13 1433324904690 30001 2484500 7.897749538719803
RUNNING 1 4 3 13 13 1433324934689 29999 2330320 7.4081347145165255
RUNNING 1 4 3 13 13 1433324964689 30000 2344220 7.452074686686198
420640 [main] INFO com.yahoo.storm.perftest.Main - KILLING test_0
[root@strm02l1 ~]#
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment