Skip to content

Instantly share code, notes, and snippets.

@shwang
Last active July 10, 2016 20:13
Show Gist options
  • Save shwang/e0690bd4bfeeb57ad335b8a1bc3365b7 to your computer and use it in GitHub Desktop.
Save shwang/e0690bd4bfeeb57ad335b8a1bc3365b7 to your computer and use it in GitHub Desktop.
quilt: sparkPI fail
quilt@ip-172-31-15-137:~$ swarm logs ip-172-31-10-159/sharp_kalam
16/07/10 18:12:33 INFO Worker: Registered signal handlers for [TERM, HUP, INT]
16/07/10 18:12:34 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/07/10 18:12:34 INFO SecurityManager: Changing view acls to: root
16/07/10 18:12:34 INFO SecurityManager: Changing modify acls to: root
16/07/10 18:12:34 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); users with modify permissions: Set(root)
16/07/10 18:12:34 INFO Utils: Successfully started service 'sparkWorker' on port 45590.
16/07/10 18:12:34 INFO Worker: Starting Spark worker 10.0.155.142:45590 with 8 cores, 30.4 GB RAM
16/07/10 18:12:34 INFO Worker: Running Spark version 1.6.1
16/07/10 18:12:34 INFO Worker: Spark home: /spark
16/07/10 18:12:44 INFO Utils: Successfully started service 'WorkerUI' on port 8081.
16/07/10 18:12:44 INFO WorkerWebUI: Started WorkerWebUI at http://10.0.155.142:8081
16/07/10 18:12:44 INFO Worker: Connecting to master spark-ms-0.q:7077...
16/07/10 18:12:47 WARN Worker: Failed to connect to master spark-ms-0.q:7077
java.io.IOException: Failed to connect to spark-ms-0.q/10.0.4.66:7077
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:216)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:167)
at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:200)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:187)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:183)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.NoRouteToHostException: No route to host: spark-ms-0.q/10.0.4.66:7077
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:224)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:289)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
... 1 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment