Skip to content

Instantly share code, notes, and snippets.

@fmw
Created June 28, 2013 10:46
Show Gist options
  • Save fmw/5883872 to your computer and use it in GitHub Desktop.
Save fmw/5883872 to your computer and use it in GitHub Desktop.
The relevant lines in nimbus.log:
2013-06-28 09:46:36 nimbus [INFO] Uploading file from client to /mnt/storm/nimbus/inbox/stormjar-95cc3086-2537-4a8d-bd52-4bfc2cefdac2.jar
2013-06-28 10:18:05 nimbus [INFO] Finished uploading file from client: /mnt/storm/nimbus/inbox/stormjar-95cc3086-2537-4a8d-bd52-4bfc2cefdac2.jar
The error:
Running: java -client -Dstorm.options= -Dstorm.home=/home/fmw/bin/storm-0.8.2 -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /home/fmw/bin/storm-0.8.2/storm-0.8.2.jar:/home/fmw/bin/storm-0.8.2/lib/commons-codec-1.4.jar:/home/fmw/bin/storm-0.8.2/lib/tools.logging-0.2.3.jar:/home/fmw/bin/storm-0.8.2/lib/minlog-1.2.jar:/home/fmw/bin/storm-0.8.2/lib/junit-3.8.1.jar:/home/fmw/bin/storm-0.8.2/lib/reflectasm-1.07-shaded.jar:/home/fmw/bin/storm-0.8.2/lib/curator-client-1.0.1.jar:/home/fmw/bin/storm-0.8.2/lib/kryo-2.17.jar:/home/fmw/bin/storm-0.8.2/lib/ring-jetty-adapter-0.3.11.jar:/home/fmw/bin/storm-0.8.2/lib/commons-logging-1.1.1.jar:/home/fmw/bin/storm-0.8.2/lib/joda-time-2.0.jar:/home/fmw/bin/storm-0.8.2/lib/commons-fileupload-1.2.1.jar:/home/fmw/bin/storm-0.8.2/lib/clojure-1.4.0.jar:/home/fmw/bin/storm-0.8.2/lib/tools.macro-0.1.0.jar:/home/fmw/bin/storm-0.8.2/lib/libthrift7-0.7.0.jar:/home/fmw/bin/storm-0.8.2/lib/httpcore-4.1.jar:/home/fmw/bin/storm-0.8.2/lib/clout-1.0.1.jar:/home/fmw/bin/storm-0.8.2/lib/core.incubator-0.1.0.jar:/home/fmw/bin/storm-0.8.2/lib/servlet-api-2.5.jar:/home/fmw/bin/storm-0.8.2/lib/ring-core-1.1.5.jar:/home/fmw/bin/storm-0.8.2/lib/disruptor-2.10.1.jar:/home/fmw/bin/storm-0.8.2/lib/httpclient-4.1.1.jar:/home/fmw/bin/storm-0.8.2/lib/jetty-6.1.26.jar:/home/fmw/bin/storm-0.8.2/lib/snakeyaml-1.9.jar:/home/fmw/bin/storm-0.8.2/lib/commons-lang-2.5.jar:/home/fmw/bin/storm-0.8.2/lib/hiccup-0.3.6.jar:/home/fmw/bin/storm-0.8.2/lib/ring-servlet-0.3.11.jar:/home/fmw/bin/storm-0.8.2/lib/slf4j-log4j12-1.5.8.jar:/home/fmw/bin/storm-0.8.2/lib/log4j-1.2.16.jar:/home/fmw/bin/storm-0.8.2/lib/commons-io-1.4.jar:/home/fmw/bin/storm-0.8.2/lib/asm-4.0.jar:/home/fmw/bin/storm-0.8.2/lib/jzmq-2.1.0.jar:/home/fmw/bin/storm-0.8.2/lib/commons-exec-1.1.jar:/home/fmw/bin/storm-0.8.2/lib/curator-framework-1.0.1.jar:/home/fmw/bin/storm-0.8.2/lib/jline-0.9.94.jar:/home/fmw/bin/storm-0.8.2/lib/math.numeric-tower-0.0.1.jar:/home/fmw/bin/storm-0.8.2/lib/carbonite-1.5.0.jar:/home/fmw/bin/storm-0.8.2/lib/json-simple-1.1.jar:/home/fmw/bin/storm-0.8.2/lib/slf4j-api-1.5.8.jar:/home/fmw/bin/storm-0.8.2/lib/zookeeper-3.3.3.jar:/home/fmw/bin/storm-0.8.2/lib/jgrapht-0.8.3.jar:/home/fmw/bin/storm-0.8.2/lib/guava-13.0.jar:/home/fmw/bin/storm-0.8.2/lib/jetty-util-6.1.26.jar:/home/fmw/bin/storm-0.8.2/lib/compojure-1.1.3.jar:/home/fmw/bin/storm-0.8.2/lib/servlet-api-2.5-20081211.jar:/home/fmw/bin/storm-0.8.2/lib/clj-time-0.4.1.jar:/home/fmw/bin/storm-0.8.2/lib/objenesis-1.2.jar:/home/fmw/bin/storm-0.8.2/lib/tools.cli-0.2.2.jar:target/mocra-0.1.0-SNAPSHOT-standalone.jar:/home/fmw/.storm:/home/fmw/bin/storm-0.8.2/bin -Dstorm.jar=target/mocra-0.1.0-SNAPSHOT-standalone.jar mocra.crawl -e remote
"Using environment :remote"
"Using a remote Storm cluster"
0 [main] INFO backtype.storm.StormSubmitter - Jar not uploaded to master yet. Submitting jar...
290 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar target/mocra-0.1.0-SNAPSHOT-standalone.jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-95cc3086-2537-4a8d-bd52-4bfc2cefdac2.jar
1889907 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded topology jar to assigned location: /mnt/storm/nimbus/inbox/stormjar-95cc3086-2537-4a8d-bd52-4bfc2cefdac2.jar
1889907 [main] INFO backtype.storm.StormSubmitter - Submitting topology mocra-test-crawl-0 in distributed mode with conf {"topology.workers":3,"topology.debug":true}
2822888 [main] ERROR org.apache.zookeeper.server.NIOServerCnxn - Thread Thread[main,5,main] died
java.lang.RuntimeException: org.apache.thrift7.transport.TTransportException: java.net.SocketException: Connection timed out
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:94)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:40)
at mocra.crawl$crawl_remote_BANG_.invoke(crawl.clj:255)
at mocra.crawl$crawl_BANG_.invoke(crawl.clj:277)
at mocra.crawl$_main.doInvoke(crawl.clj:289)
at clojure.lang.RestFn.applyTo(RestFn.java:137)
at mocra.crawl.main(Unknown Source)
Caused by: org.apache.thrift7.transport.TTransportException: java.net.SocketException: Connection timed out
at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift7.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
at org.apache.thrift7.transport.TFramedTransport.read(TFramedTransport.java:101)
at org.apache.thrift7.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift7.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at org.apache.thrift7.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at org.apache.thrift7.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift7.TServiceClient.receiveBase(TServiceClient.java:69)
at backtype.storm.generated.Nimbus$Client.recv_submitTopology(Nimbus.java:145)
at backtype.storm.generated.Nimbus$Client.submitTopology(Nimbus.java:129)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:80)
... 6 more
Caused by: java.net.SocketException: Connection timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at org.apache.thrift7.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
... 17 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment