Skip to content

Instantly share code, notes, and snippets.

@gphat

gphat/gist:1265516

Created October 5, 2011 20:00
Show Gist options
  • Save gphat/1265516 to your computer and use it in GitHub Desktop.
Save gphat/1265516 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
gphat@Corys-iMac ~/src/storm-starter (master) $ storm jar storm-starter-0.0.1-SNAPSHOT.jar storm.starter.WordCountTopology asshole.txt
Running: export STORM_JAR=storm-starter-0.0.1-SNAPSHOT.jar; java -client -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -cp /Users/gphat/src/storm/storm-0.5.4-SNAPSHOT.jar:/Users/gphat/src/storm/lib/clj-time-0.3.0.jar:/Users/gphat/src/storm/lib/clojure-1.2.0.jar:/Users/gphat/src/storm/lib/clojure-contrib-1.2.0.jar:/Users/gphat/src/storm/lib/clout-0.4.1.jar:/Users/gphat/src/storm/lib/commons-cli-1.2.jar:/Users/gphat/src/storm/lib/commons-codec-1.3.jar:/Users/gphat/src/storm/lib/commons-el-1.0.jar:/Users/gphat/src/storm/lib/commons-exec-1.1.jar:/Users/gphat/src/storm/lib/commons-fileupload-1.2.1.jar:/Users/gphat/src/storm/lib/commons-httpclient-3.0.1.jar:/Users/gphat/src/storm/lib/commons-io-1.4.jar:/Users/gphat/src/storm/lib/commons-lang-2.4.jar:/Users/gphat/src/storm/lib/commons-logging-1.0.4.jar:/Users/gphat/src/storm/lib/commons-logging-api-1.0.4.jar:/Users/gphat/src/storm/lib/commons-net-1.4.1.jar:/Users/gphat/src/storm/lib/compojure-0.6.4.jar:/Users/gphat/src/storm/lib/core.incubator-0.1.0.jar:/Users/gphat/src/storm/lib/hiccup-0.3.6.jar:/Users/gphat/src/storm/lib/jetty-6.1.26.jar:/Users/gphat/src/storm/lib/jetty-util-6.1.26.jar:/Users/gphat/src/storm/lib/jline-0.9.94.jar:/Users/gphat/src/storm/lib/joda-time-1.6.jar:/Users/gphat/src/storm/lib/json-simple-1.1.jar:/Users/gphat/src/storm/lib/junit-3.8.1.jar:/Users/gphat/src/storm/lib/jvyaml-1.0.0.jar:/Users/gphat/src/storm/lib/jzmq-2.1.0.jar:/Users/gphat/src/storm/lib/log4j-1.2.16.jar:/Users/gphat/src/storm/lib/oro-2.0.8.jar:/Users/gphat/src/storm/lib/ring-core-0.3.10.jar:/Users/gphat/src/storm/lib/ring-jetty-adapter-0.3.11.jar:/Users/gphat/src/storm/lib/ring-servlet-0.3.11.jar:/Users/gphat/src/storm/lib/servlet-api-2.5-20081211.jar:/Users/gphat/src/storm/lib/servlet-api-2.5.jar:/Users/gphat/src/storm/lib/slf4j-api-1.5.10.jar:/Users/gphat/src/storm/lib/slf4j-log4j12-1.5.10.jar:/Users/gphat/src/storm/lib/thriftjava-1.0.0.jar:/Users/gphat/src/storm/lib/tools.macro-0.1.0.jar:/Users/gphat/src/storm/lib/zookeeper-3.3.2.jar:storm-starter-0.0.1-SNAPSHOT.jar:/Users/gphat/.storm:/Users/gphat/src/storm/bin storm.starter.WordCountTopology asshole.txt
0 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
21 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
25 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
37 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
63 [main-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
103 [main] INFO backtype.storm.daemon.nimbus - Received topology submission for word-count with conf {"storm.id" "word-count-1-1317842608", "topology.max.task.parallelism" 3, "topology.debug" true}
201 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:1 timed out
202 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:2 timed out
202 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:3 timed out
203 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:4 timed out
203 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:5 timed out
204 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:6 timed out
205 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:7 timed out
205 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:8 timed out
206 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:9 timed out
206 [main] INFO backtype.storm.daemon.nimbus - Task word-count-1-1317842608:10 timed out
208 [main] INFO backtype.storm.daemon.nimbus - Reassigning word-count-1-1317842608 to 1 slots
232 [main] INFO backtype.storm.daemon.nimbus - Reassign ids: [1 2 3 4 5 6 7 8 9 10]
238 [main] INFO backtype.storm.daemon.nimbus - Available slots: (["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1] ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 2] ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 3] ["3e852950-1d0a-44e2-8d25-b715714b64cd" 4] ["3e852950-1d0a-44e2-8d25-b715714b64cd" 5] ["3e852950-1d0a-44e2-8d25-b715714b64cd" 6])
252 [main] INFO backtype.storm.daemon.nimbus - Setting new assignment for storm id word-count-1-1317842608: #:backtype.storm.daemon.common.Assignment{:master-code-dir "/var/folders/y_/ff7v33c954349phn59qdt3nh0000gn/T//886145d2-d9ba-4a53-ad51-30b1445c9407/nimbus/stormdist/word-count-1-1317842608", :node->host {"b11566aa-40d5-4d98-a164-8d28ac19d9a1" "10.0.1.39"}, :task->node+port {1 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 2 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 3 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 4 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 5 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 6 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 7 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 8 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 9 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1], 10 ["b11566aa-40d5-4d98-a164-8d28ac19d9a1" 1]}, :task->start-time-secs {1 1317842608, 2 1317842608, 3 1317842608, 4 1317842608, 5 1317842608, 6 1317842608, 7 1317842608, 8 1317842608, 9 1317842608, 10 1317842608}}
259 [main] INFO backtype.storm.daemon.nimbus - Activating word-count: word-count-1-1317842608
266 [Thread-7] INFO backtype.storm.daemon.supervisor - Downloading code for storm id word-count-1-1317842608 from /var/folders/y_/ff7v33c954349phn59qdt3nh0000gn/T//886145d2-d9ba-4a53-ad51-30b1445c9407/nimbus/stormdist/word-count-1-1317842608
266 [Thread-12] INFO backtype.storm.daemon.supervisor - Downloading code for storm id word-count-1-1317842608 from /var/folders/y_/ff7v33c954349phn59qdt3nh0000gn/T//886145d2-d9ba-4a53-ad51-30b1445c9407/nimbus/stormdist/word-count-1-1317842608
268 [Thread-7] INFO backtype.storm.daemon.supervisor - Finished downloading code for storm id word-count-1-1317842608 from /var/folders/y_/ff7v33c954349phn59qdt3nh0000gn/T//886145d2-d9ba-4a53-ad51-30b1445c9407/nimbus/stormdist/word-count-1-1317842608
268 [Thread-12] INFO backtype.storm.daemon.supervisor - Finished downloading code for storm id word-count-1-1317842608 from /var/folders/y_/ff7v33c954349phn59qdt3nh0000gn/T//886145d2-d9ba-4a53-ad51-30b1445c9407/nimbus/stormdist/word-count-1-1317842608
290 [Thread-8] INFO backtype.storm.daemon.supervisor - Launching worker with assignment #:backtype.storm.daemon.supervisor.LocalAssignment{:storm-id "word-count-1-1317842608", :task-ids (1 2 3 4 5 6 7 8 9 10)} for this supervisor b11566aa-40d5-4d98-a164-8d28ac19d9a1 on port 1 with id 1fdb0c52-d4f8-4489-a3c5-e07a6ab7b293
290 [Thread-8] INFO backtype.storm.daemon.worker - Launching worker for word-count-1-1317842608 on b11566aa-40d5-4d98-a164-8d28ac19d9a1:1 with id 1fdb0c52-d4f8-4489-a3c5-e07a6ab7b293
292 [Thread-8-EventThread] INFO backtype.storm.zookeeper - Zookeeper state update: :connected:none
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment