Skip to content

Instantly share code, notes, and snippets.

@kyrozetera
Created November 4, 2016 15:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kyrozetera/c163a9b83ef840bf692de26ab5967d9e to your computer and use it in GitHub Desktop.
Save kyrozetera/c163a9b83ef840bf692de26ab5967d9e to your computer and use it in GitHub Desktop.
ChannelException with Alluxio on Lambda using EPOLL channel
io.netty.channel.ChannelException: Unable to create Channel from class class io.netty.channel.epoll.EpollSocketChannel: java.io.IOException
java.io.IOException: io.netty.channel.ChannelException: Unable to create Channel from class class io.netty.channel.epoll.EpollSocketChannel
at alluxio.client.netty.NettyUnderFileSystemFileWriter.write(NettyUnderFileSystemFileWriter.java:103)
at alluxio.client.file.UnderFileSystemFileOutStream.writeToWorker(UnderFileSystemFileOutStream.java:161)
at alluxio.client.file.UnderFileSystemFileOutStream.flush(UnderFileSystemFileOutStream.java:85)
at alluxio.client.file.UnderFileSystemFileOutStream.close(UnderFileSystemFileOutStream.java:75)
at alluxio.client.file.FileOutStream.close(FileOutStream.java:162)
at com.koddi.etl.lambda.SparkLauncher.writeFileToAlluxio(SparkLauncher.scala:127)
at com.koddi.etl.lambda.SparkLauncher$$anonfun$handleRequest$1.apply(SparkLauncher.scala:55)
at com.koddi.etl.lambda.SparkLauncher$$anonfun$handleRequest$1.apply(SparkLauncher.scala:46)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at com.koddi.etl.lambda.SparkLauncher.handleRequest(SparkLauncher.scala:46)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
Caused by: io.netty.channel.ChannelException: Unable to create Channel from class class io.netty.channel.epoll.EpollSocketChannel
at io.netty.bootstrap.AbstractBootstrap$BootstrapChannelFactory.newChannel(AbstractBootstrap.java:455)
at io.netty.bootstrap.AbstractBootstrap.initAndRegister(AbstractBootstrap.java:306)
at io.netty.bootstrap.Bootstrap.doConnect(Bootstrap.java:134)
at io.netty.bootstrap.Bootstrap.connect(Bootstrap.java:116)
at alluxio.client.netty.NettyUnderFileSystemFileWriter.write(NettyUnderFileSystemFileWriter.java:72)
... 14 more
Caused by: io.netty.channel.ChannelException: java.io.IOException: socketStreamFd() failed: Operation not permitted
at io.netty.channel.epoll.Native.socketStreamFd(Native.java:401)
at io.netty.channel.epoll.EpollSocketChannel.<init>(EpollSocketChannel.java:53)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at java.lang.Class.newInstance(Class.java:442)
at io.netty.bootstrap.AbstractBootstrap$BootstrapChannelFactory.newChannel(AbstractBootstrap.java:453)
... 18 more
Caused by: java.io.IOException: socketStreamFd() failed: Operation not permitted
at io.netty.channel.epoll.Native.newIOException(Native.java:127)
... 26 more
@kyrozetera
Copy link
Author

This can be avoided by using the NIO channel instead. In alluxio-site.properties:

alluxio.user.network.netty.channel=NIO

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment