Skip to content

Instantly share code, notes, and snippets.

@oravecz
Created June 13, 2011 19:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save oravecz/1023471 to your computer and use it in GitHub Desktop.
Save oravecz/1023471 to your computer and use it in GitHub Desktop.
19:05:39,891 INFO main ontext.ContextLoader: 187 - Root WebApplicationContext: initialization started
19:05:39,996 INFO main ebApplicationContext: 456 - Refreshing Root WebApplicationContext: startup date [Mon Jun 13 19:05:39 UTC 2011]; root of context hierarchy
19:05:40,115 INFO main BeanDefinitionReader: 315 - Loading XML bean definitions from class path resource [spring-context.xml]
19:05:41,339 INFO main BeanDefinitionReader: 315 - Loading XML bean definitions from class path resource [spring-security.xml]
19:05:41,670 INFO main icationConfigBuilder: 338 - No login page configured. The default internal one will be used. Use the 'login-page' attribute to set the URL of the login page.
19:05:41,677 INFO main BeanDefinitionParser: 187 - Checking sorted filter chain: [Root bean: class [org.springframework.security.web.context.SecurityContextPersistenceFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 300, Root bean: class [org.springframework.security.web.authentication.logout.LogoutFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 400, Root bean: class [org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 800, Root bean: class [org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1000, Root bean: class [org.springframework.security.web.authentication.www.BasicAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1200, Root bean: class [org.springframework.security.web.savedrequest.RequestCacheAwareFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1300, Root bean: class [org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1400, Root bean: class [org.springframework.security.web.authentication.AnonymousAuthenticationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1600, Root bean: class [org.springframework.security.web.session.SessionManagementFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1700, Root bean: class [org.springframework.security.web.access.ExceptionTranslationFilter]; scope=; abstract=false; lazyInit=false; autowireMode=0; dependencyCheck=0; autowireCandidate=true; primary=false; factoryBeanName=null; factoryMethodName=null; initMethodName=null; destroyMethodName=null, order = 1800, <org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0>, order = 1900]
19:05:41,972 INFO main laceholderConfigurer: 177 - Loading properties file from class path resource [server.properties]
19:05:42,106 INFO main tListableBeanFactory: 549 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@d22462: defining beans [systemPlaceholderConfigurer,configParams,mailSender,elasticSearchConfiguration,esServer,esDataStore,delegatingStore,mapStoreManager,hzServer,backup,baseReflector,baseReflector$child#0,baseReflector$child#1,baseReflector$child#2,baseReflector$child#3,baseReflector$child#4,baseReflector$child#5,baseReflector$child#6,baseReflector$child#7,baseReflector$child#8,baseReflector$child#9,baseReflector$child#10,baseReflector$child#11,baseReflector$child#12,baseReflector$child#13,baseReflector$child#14,cronJobs,myScheduler,org.springframework.scheduling.support.MethodInvokingRunnable#0,org.springframework.scheduling.support.MethodInvokingRunnable#1,org.springframework.scheduling.config.ScheduledTaskRegistrar#0,org.springframework.security.web.PortMapperImpl#0,org.springframework.security.web.context.HttpSessionSecurityContextRepository#0,org.springframework.security.web.authentication.session.SessionFixationProtectionStrategy#0,org.springframework.security.authentication.ProviderManager#0,org.springframework.security.access.vote.AffirmativeBased#0,org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0,org.springframework.security.web.access.DefaultWebInvocationPrivilegeEvaluator#0,org.springframework.security.authentication.AnonymousAuthenticationProvider#0,org.springframework.security.web.savedrequest.HttpSessionRequestCache#0,org.springframework.security.web.authentication.www.BasicAuthenticationEntryPoint#0,org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter#0,org.springframework.security.config.http.UserDetailsServiceInjectionBeanPostProcessor#0,org.springframework.security.filterChainProxy,restUserDetailsService,org.springframework.security.authentication.dao.DaoAuthenticationProvider#0,org.springframework.security.authentication.DefaultAuthenticationEventPublisher#0,org.springframework.security.authenticationManager]; root of factory hierarchy
19:05:42,205 INFO main ropertiesFactoryBean: 177 - Loading properties file from class path resource [elasticsearch-server.properties]
19:05:42,254 INFO main .ElasticSearchServer: 47 - Starting the Elastic Search server node
19:05:42,415 INFO main g.elasticsearch.node: 78 - [Martha Johansson] {elasticsearch/0.16.2}[1105]: initializing ...
19:05:42,476 INFO main lasticsearch.plugins: 78 - [Martha Johansson] loaded [cloud-aws]
19:05:46,241 DEBUG main csearch.cache.memory: 70 - [Martha Johansson] using bytebuffer cache with small_buffer_size [1kb], large_buffer_size [1mb], small_cache_size [10mb], large_cache_size [500mb], direct [true]
19:05:46,254 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [cached], type [cached], keep_alive [5m]
19:05:46,258 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [index], type [cached], keep_alive [5m]
19:05:46,258 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [search], type [cached], keep_alive [5m]
19:05:46,259 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [percolate], type [cached], keep_alive [5m]
19:05:46,260 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [management], type [scaling], min [1], size [20], keep_alive [5m]
19:05:46,263 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [merge], type [scaling], min [1], size [20], keep_alive [5m]
19:05:46,263 DEBUG main ticsearch.threadpool: 70 - [Martha Johansson] creating thread_pool [snapshot], type [scaling], min [1], size [5], keep_alive [5m]
19:05:46,317 DEBUG main y.zen.ping.multicast: 70 - [Martha Johansson] using group [224.2.2.4], with port [54328], ttl [3], and address [null]
19:05:46,323 DEBUG main ery.zen.ping.unicast: 70 - [Martha Johansson] using initial hosts []
19:05:46,324 DEBUG main search.discovery.ec2: 70 - [Martha Johansson] using initial_ping_timeout [30s]
19:05:46,329 DEBUG main rch.discovery.zen.fd: 70 - [Martha Johansson] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
19:05:46,332 DEBUG main rch.discovery.zen.fd: 70 - [Martha Johansson] [node ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
19:05:46,608 TRACE main rg.elasticsearch.env: 62 - [Martha Johansson] obtaining node lock on /var/local/es/data/elasticsearch-dev/nodes/0 ...
19:05:46,612 DEBUG main rg.elasticsearch.env: 70 - [Martha Johansson] using node location [/var/local/es/data/elasticsearch-dev/nodes/0], local_node_id [0]
19:05:46,974 DEBUG main r.routing.allocation: 70 - [Martha Johansson] using node_concurrent_recoveries [2], node_initial_primaries_recoveries [4]
19:05:46,974 DEBUG main r.routing.allocation: 70 - [Martha Johansson] using [allow_rebalance] with [indices_all_active]
19:05:46,975 DEBUG main r.routing.allocation: 70 - [Martha Johansson] using [cluster_concurrent_rebalance] with [2]
19:05:46,997 DEBUG main ticsearch.monitor.os: 70 - [Martha Johansson] Using probe [org.elasticsearch.monitor.os.JmxOsProbe@1461b5b] with refresh_interval [5s]
19:05:46,998 DEBUG main arch.monitor.process: 70 - [Martha Johansson] Using probe [org.elasticsearch.monitor.process.JmxProcessProbe@ef9525] with refresh_interval [5s]
19:05:46,998 DEBUG main arch.monitor.network: 70 - [Martha Johansson] Using probe [org.elasticsearch.monitor.network.JmxNetworkProbe@56acfa] with refresh_interval [5s]
19:05:47,047 DEBUG main arch.monitor.network: 70 - [Martha Johansson] net_info
host [domU-12-31-39-0A-8E-33]
eth0 display_name [eth0]
address [/fe80:0:0:0:1031:39ff:fe0a:8e33%2] [/10.211.141.189]
mtu [1500] multicast [true] ptp [false] loopback [false] up [true] virtual [false]
lo display_name [lo]
address [/0:0:0:0:0:0:0:1%1] [/127.0.0.1]
mtu [16436] multicast [false] ptp [false] loopback [true] up [true] virtual [false]
19:05:47,047 TRACE main arch.monitor.network: 62 - [Martha Johansson] ifconfig
NA
19:05:47,716 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute TotalNumberOfRequests[r=true,w=false,is=false,type=long]
19:05:47,716 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute BoundAddress[r=true,w=false,is=false,type=java.lang.String]
19:05:47,716 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute PublishAddress[r=true,w=false,is=false,type=java.lang.String]
19:05:47,718 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute TcpNoDelay[r=true,w=false,is=false,type=java.lang.Boolean]
19:05:47,718 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute NumberOfOutboundConnections[r=true,w=false,is=false,type=long]
19:05:47,718 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute Port[r=true,w=false,is=false,type=java.lang.String]
19:05:47,718 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute WorkerCount[r=true,w=false,is=false,type=int]
19:05:47,718 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute TcpReceiveBufferSize[r=true,w=false,is=false,type=java.lang.String]
19:05:47,719 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute ReuseAddress[r=true,w=false,is=false,type=java.lang.Boolean]
19:05:47,719 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute ConnectTimeout[r=true,w=false,is=false,type=java.lang.String]
19:05:47,719 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute TcpKeepAlive[r=true,w=false,is=false,type=java.lang.Boolean]
19:05:47,719 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute PublishHost[r=true,w=false,is=false,type=java.lang.String]
19:05:47,719 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute TcpSendBufferSize[r=true,w=false,is=false,type=java.lang.String]
19:05:47,720 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Attribute BindHost[r=true,w=false,is=false,type=java.lang.String]
19:05:47,765 DEBUG main index.shard.recovery: 70 - [Martha Johansson] using concurrent_streams [5], file_chunk_size [100kb], translog_size [100kb], translog_ops [1000], and compress [true]
19:05:47,766 DEBUG main earch.indices.memory: 70 - [Martha Johansson] using index_buffer_size [116mb], with min_shard_index_buffer_size [4mb], max_shard_index_buffer_size [512mb], shard_inactive_time [30m]
19:05:47,815 DEBUG main indices.cache.filter: 70 - [Martha Johansson] using [node] filter cache with size [232mb]
19:05:47,816 DEBUG main ticsearch.gateway.s3: 70 - [Martha Johansson] using bucket [ppkc-es-gateway-dev], region [null], chunk_size [100mb], concurrent_streams [5]
19:05:48,516 TRACE main ticsearch.gateway.s3: 62 - [Martha Johansson] [findLatestMetadata]: Processing [metadata-75]
19:05:48,811 DEBUG main ticsearch.gateway.s3: 70 - [Martha Johansson] Latest metadata found at index [75]
19:05:48,845 INFO main g.elasticsearch.node: 78 - [Martha Johansson] {elasticsearch/0.16.2}[1105]: initialized
19:05:48,845 INFO main .ElasticSearchServer: 64 - Starting the Elastic Search server node with these settings:
19:05:48,845 INFO main .ElasticSearchServer: 69 - cloud.aws.access_key : AKIAJWQRTNTMFXIMX3WA
19:05:48,846 INFO main .ElasticSearchServer: 69 - cloud.aws.secret_key : <HIDDEN>
19:05:48,846 INFO main .ElasticSearchServer: 69 - cluster.name : elasticsearch-dev
19:05:48,846 INFO main .ElasticSearchServer: 69 - discovery.ec2.ping_timeout : 30s
19:05:48,846 INFO main .ElasticSearchServer: 69 - discovery.type : ec2
19:05:48,846 INFO main .ElasticSearchServer: 69 - gateway.s3.bucket : ppkc-es-gateway-dev
19:05:48,846 INFO main .ElasticSearchServer: 69 - gateway.type : s3
19:05:48,846 INFO main .ElasticSearchServer: 69 - http.enabled : true
19:05:48,847 INFO main .ElasticSearchServer: 69 - http.port : 9311
19:05:48,847 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.filter.0 : lowercase
19:05:48,847 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.tokenizer : uax_url_email
19:05:48,847 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email.type : custom
19:05:48,847 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.lowercase : true
19:05:48,847 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.pattern : [@.]
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.stopwords : _none_
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_regex.type : pattern
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.filter.0 : lowercase
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.tokenizer : letter
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.email_split.type : custom
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.filter.0 : lowercase
19:05:48,848 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.tokenizer : keyword
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.lowercase_keyword.type : custom
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.char_filter.0 : html_strip
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.0 : standard
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.1 : lowercase
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.2 : stop
19:05:48,849 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.filter.3 : porterStem
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.tokenizer : standard
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.analysis.analyzer.porter_standard.type : custom
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.mapping._id.indexed : true
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.store.fs.memory.direct : true
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.store.memory.direct : true
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.store.memory.warm_cache : true
19:05:48,850 INFO main .ElasticSearchServer: 69 - index.store.type : niofs
19:05:48,851 INFO main .ElasticSearchServer: 69 - name : Martha Johansson
19:05:48,851 INFO main .ElasticSearchServer: 69 - network.host : 0.0.0.0
19:05:48,851 INFO main .ElasticSearchServer: 69 - node.data : true
19:05:48,851 INFO main .ElasticSearchServer: 69 - path.conf : /usr/share/tomcat6/webapps/ROOT//WEB-INF/config
19:05:48,851 INFO main .ElasticSearchServer: 69 - path.data : /var/local/es/data
19:05:48,851 INFO main .ElasticSearchServer: 69 - path.data_with_cluster : /var/local/es/data/elasticsearch-dev
19:05:48,851 INFO main .ElasticSearchServer: 69 - path.home : /var/local/es
19:05:48,852 INFO main .ElasticSearchServer: 69 - path.logs : /var/local/es/logs
19:05:48,852 INFO main .ElasticSearchServer: 69 - path.work : /var/local/es/work
19:05:48,852 INFO main .ElasticSearchServer: 69 - path.work_with_cluster : /var/local/es/work/elasticsearch-dev
19:05:48,853 INFO main .ElasticSearchServer: 69 - transport.tcp.port : 9310
19:05:48,853 INFO main g.elasticsearch.node: 78 - [Martha Johansson] {elasticsearch/0.16.2}[1105]: starting ...
19:05:48,942 DEBUG main .NioProviderMetadata: 70 - Using the autodetected NIO constraint level: 0
19:05:49,032 DEBUG main arch.transport.netty: 70 - [Martha Johansson] Bound to address [/0:0:0:0:0:0:0:0:9310]
19:05:49,034 INFO main sticsearch.transport: 78 - [Martha Johansson] bound_address {inet[/0:0:0:0:0:0:0:0:9310]}, publish_address {inet[/10.211.141.189:9310]}
19:05:49,040 TRACE main sticsearch.discovery: 62 - [Martha Johansson] waiting for 30s for the initial state to be set by the discovery
19:05:49,237 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] building dynamic unicast discovery nodes...
19:05:49,241 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] adding i-c767d9a9, address 10.91.25.118, transport_address inet[/10.91.25.118:9310]
19:05:49,241 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] adding i-7164da1f, address 10.122.62.201, transport_address inet[/10.122.62.201:9310]
19:05:49,241 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] adding i-5b553335, address 10.254.91.0, transport_address inet[/10.254.91.0:9310]
19:05:49,241 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] adding i-4bcbbc25, address 10.210.79.34, transport_address inet[/10.210.79.34:9310]
19:05:49,241 TRACE thread-1 search.discovery.ec2: 62 - [Martha Johansson] adding i-45cbbc2b, address 10.211.141.189, transport_address inet[/10.211.141.189:9310]
19:05:49,241 DEBUG thread-1 search.discovery.ec2: 70 - [Martha Johansson] using dynamic discovery nodes [[#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]], [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]], [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]], [#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]], [#cloud-i-45cbbc2b-0][inet[/10.211.141.189:9310]]]
19:05:49,804 TRACE thread-2 ery.zen.ping.unicast: 66 - [Martha Johansson] [1] failed to connect to [#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.91.25.118:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
19:05:49,804 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x009ed5d6]]
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:05:49,871 DEBUG thread-6 arch.transport.netty: 70 - [Martha Johansson] Connected to node [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]]
19:05:49,875 TRACE thread-6 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] connecting to [Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]], disconnect[false]
19:05:49,943 TRACE ker #1-2 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] received response from [Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]: [ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}]
19:06:10,873 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x00618565]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,873 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x009576fd]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,874 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01e06b12]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,874 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x009ff588]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,875 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01b0d2d0]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,875 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01d33eef]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,876 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01c8f644]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,876 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01664f1a]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,876 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x007cdc58]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:10,877 TRACE thread-4 ery.zen.ping.unicast: 66 - [Martha Johansson] [1] failed to connect to [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.254.91.0:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
19:06:10,880 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x00749ebc]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:19,041 WARN main sticsearch.discovery: 86 - [Martha Johansson] waited for 30s and no initial state was set by the discovery
19:06:19,041 INFO main sticsearch.discovery: 78 - [Martha Johansson] elasticsearch-dev/YeoIUl_RSkCgt2A5wRLZVg
19:06:19,041 DEBUG main lasticsearch.gateway: 70 - [Martha Johansson] can't wait on start for (possibly) reading state from gateway, will do it asynchronously
19:06:19,044 INFO main g.elasticsearch.http: 78 - [Martha Johansson] bound_address {inet[/0:0:0:0:0:0:0:0:9311]}, publish_address {inet[/10.211.141.189:9311]}
19:06:19,044 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Registered org.elasticsearch.jmx.ResourceDMBean@cac877 under org.elasticsearch:service=transport
19:06:19,045 TRACE main rg.elasticsearch.jmx: 62 - [Martha Johansson] Registered org.elasticsearch.jmx.ResourceDMBean@12f2b32 under org.elasticsearch:service=transport,transportType=netty
19:06:19,045 INFO main g.elasticsearch.node: 78 - [Martha Johansson] {elasticsearch/0.16.2}[1105]: started
19:06:19,365 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] building dynamic unicast discovery nodes...
19:06:19,366 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] adding i-c767d9a9, address 10.91.25.118, transport_address inet[/10.91.25.118:9310]
19:06:19,366 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] adding i-7164da1f, address 10.122.62.201, transport_address inet[/10.122.62.201:9310]
19:06:19,366 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] adding i-5b553335, address 10.254.91.0, transport_address inet[/10.254.91.0:9310]
19:06:19,366 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] adding i-4bcbbc25, address 10.210.79.34, transport_address inet[/10.210.79.34:9310]
19:06:19,366 TRACE thread-4 search.discovery.ec2: 62 - [Martha Johansson] adding i-45cbbc2b, address 10.211.141.189, transport_address inet[/10.211.141.189:9310]
19:06:19,367 DEBUG thread-4 search.discovery.ec2: 70 - [Martha Johansson] using dynamic discovery nodes [[#cloud-i-c767d9a9-0][inet[/10.91.25.118:9310]], [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]], [#cloud-i-5b553335-0][inet[/10.254.91.0:9310]], [#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]], [#cloud-i-45cbbc2b-0][inet[/10.211.141.189:9310]]]
19:06:19,413 TRACE thread-4 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] connecting to [Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]], disconnect[false]
19:06:19,464 TRACE ker #1-1 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] received response from [Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]: [ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}]
19:06:31,877 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x0085f3d6]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,877 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01ce08c7]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,878 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01d4f279]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,878 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x01a2760f]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,878 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x003ba002]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,879 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x0077622b]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,879 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x004b7c69]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:31,879 TRACE thread-3 ery.zen.ping.unicast: 66 - [Martha Johansson] [1] failed to connect to [#cloud-i-7164da1f-0][inet[/10.122.62.201:9310]]
org.elasticsearch.transport.ConnectTransportException: [][inet[/10.122.62.201:9310]] connect_timeout[30s]
at org.elasticsearch.transport.netty.NettyTransport.connectToChannels(NettyTransport.java:514)
at org.elasticsearch.transport.netty.NettyTransport.connectToNode(NettyTransport.java:475)
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:126)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing$3.run(UnicastZenPing.java:198)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
... 3 more
19:06:31,881 TRACE boss #1 arch.transport.netty: 66 - [Martha Johansson] (Ignoring) Exception caught on netty layer [[id: 0x016fb2f8]]
java.net.ConnectException: Connection timed out
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.connect(NioClientSocketPipelineSink.java:384)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.processSelectedKeys(NioClientSocketPipelineSink.java:354)
at org.elasticsearch.common.netty.channel.socket.nio.NioClientSocketPipelineSink$Boss.run(NioClientSocketPipelineSink.java:276)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:44)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
19:06:33,086 DEBUG thread-5 arch.transport.netty: 70 - [Martha Johansson] Connected to node [[#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]]]
19:06:33,086 TRACE thread-5 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] connecting to [#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]], disconnect[true]
19:06:33,088 TRACE ker #1-2 ery.zen.ping.unicast: 62 - [Martha Johansson] [1] received response from [#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]]: [ping_response{target [[Crusader][NPnZk3_ITg6dn_fhW2Ogsg][inet[/10.210.79.34:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Crusader][NPnZk3_ITg6dn_fhW2Ogsg][inet[/10.210.79.34:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Martha Johansson][YeoIUl_RSkCgt2A5wRLZVg][inet[/10.211.141.189:9310]]], master [null], cluster_name[elasticsearch-dev]}, ping_response{target [[Crusader][NPnZk3_ITg6dn_fhW2Ogsg][inet[/10.210.79.34:9310]]], master [null], cluster_name[elasticsearch-dev]}]
19:06:33,090 DEBUG ker #1-2 arch.transport.netty: 70 - [Martha Johansson] Disconnected from [[#cloud-i-4bcbbc25-0][inet[/10.210.79.34:9310]]]
19:06:49,055 INFO main tListableBeanFactory: 422 - Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@d22462: defining beans [systemPlaceholderConfigurer,configParams,mailSender,elasticSearchConfiguration,esServer,esDataStore,delegatingStore,mapStoreManager,hzServer,backup,baseReflector,baseReflector$child#0,baseReflector$child#1,baseReflector$child#2,baseReflector$child#3,baseReflector$child#4,baseReflector$child#5,baseReflector$child#6,baseReflector$child#7,baseReflector$child#8,baseReflector$child#9,baseReflector$child#10,baseReflector$child#11,baseReflector$child#12,baseReflector$child#13,baseReflector$child#14,cronJobs,myScheduler,org.springframework.scheduling.support.MethodInvokingRunnable#0,org.springframework.scheduling.support.MethodInvokingRunnable#1,org.springframework.scheduling.config.ScheduledTaskRegistrar#0,org.springframework.security.web.PortMapperImpl#0,org.springframework.security.web.context.HttpSessionSecurityContextRepository#0,org.springframework.security.web.authentication.session.SessionFixationProtectionStrategy#0,org.springframework.security.authentication.ProviderManager#0,org.springframework.security.access.vote.AffirmativeBased#0,org.springframework.security.web.access.intercept.FilterSecurityInterceptor#0,org.springframework.security.web.access.DefaultWebInvocationPrivilegeEvaluator#0,org.springframework.security.authentication.AnonymousAuthenticationProvider#0,org.springframework.security.web.savedrequest.HttpSessionRequestCache#0,org.springframework.security.web.authentication.www.BasicAuthenticationEntryPoint#0,org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter#0,org.springframework.security.config.http.UserDetailsServiceInjectionBeanPostProcessor#0,org.springframework.security.filterChainProxy,restUserDetailsService,org.springframework.security.authentication.dao.DaoAuthenticationProvider#0,org.springframework.security.authentication.DefaultAuthenticationEventPublisher#0,org.springframework.security.authenticationManager]; root of factory hierarchy
19:06:49,055 ERROR main ontext.ContextLoader: 220 - Context initialization failed
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'esServer' defined in class path resource [spring-context.xml]: Invocation of init method failed; nested exception is org.elasticsearch.discovery.MasterNotDiscoveredException:
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1412)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:291)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:288)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:190)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:574)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:895)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:425)
at org.springframework.web.context.ContextLoader.createWebApplicationContext(ContextLoader.java:276)
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:197)
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:47)
at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4135)
at org.apache.catalina.core.StandardContext.start(StandardContext.java:4630)
at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791)
at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771)
at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:546)
at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:905)
at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:740)
at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:500)
at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277)
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321)
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:785)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:445)
at org.apache.catalina.core.StandardService.start(StandardService.java:519)
at org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
at org.apache.catalina.startup.Catalina.start(Catalina.java:581)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: org.elasticsearch.discovery.MasterNotDiscoveredException:
at org.elasticsearch.action.support.master.TransportMasterNodeOperationAction$3.onTimeout(TransportMasterNodeOperationAction.java:162)
at org.elasticsearch.cluster.service.InternalClusterService$NotifyTimeout.run(InternalClusterService.java:289)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
log4j:WARN No appenders could be found for logger (org.elasticsearch.monitor.jvm).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Exception in thread "qtp13115887-34" java.lang.NoClassDefFoundError: org/eclipse/jetty/io/nio/SelectorManager$SelectSet$2
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:756)
at org.eclipse.jetty.io.nio.SelectorManager.doSelect(SelectorManager.java:195)
at org.eclipse.jetty.client.SelectConnector.run(SelectConnector.java:180)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:436)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.ClassNotFoundException: org.eclipse.jetty.io.nio.SelectorManager$SelectSet$2
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1645)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1491)
... 5 more
Exception in thread "elasticsearch[cached]-pool-1-thread-7" java.lang.NullPointerException
at org.elasticsearch.cluster.node.DiscoveryNodes.iterator(DiscoveryNodes.java:65)
at org.elasticsearch.cluster.node.DiscoveryNodes.iterator(DiscoveryNodes.java:42)
at org.elasticsearch.cluster.service.InternalClusterService$ReconnectToNodes.run(InternalClusterService.java:299)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Exception in thread "elasticsearch[cached]-pool-1-thread-6" java.lang.NoClassDefFoundError: org/elasticsearch/transport/TransportService$TimeoutInfoHolder
at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:325)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.ClassNotFoundException: org.elasticsearch.transport.TransportService$TimeoutInfoHolder
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1645)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1491)
... 4 more
Exception in thread "elasticsearch[cached]-pool-1-thread-1" com.amazonaws.AmazonClientException: Unable to calculate a request signature: null
at com.amazonaws.auth.AbstractAWSSigner.sign(AbstractAWSSigner.java:68)
at com.amazonaws.auth.AbstractAWSSigner.sign(AbstractAWSSigner.java:51)
at com.amazonaws.auth.QueryStringSigner.sign(QueryStringSigner.java:79)
at com.amazonaws.auth.QueryStringSigner.sign(QueryStringSigner.java:46)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:5002)
at com.amazonaws.services.ec2.AmazonEC2Client.describeInstances(AmazonEC2Client.java:2268)
at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider.buildDynamicNodes(AwsEc2UnicastHostsProvider.java:91)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPings(UnicastZenPing.java:175)
at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.ping(UnicastZenPing.java:156)
at org.elasticsearch.discovery.zen.ping.ZenPingService.ping(ZenPingService.java:129)
at org.elasticsearch.discovery.zen.ping.ZenPingService.pingAndWait(ZenPingService.java:111)
at org.elasticsearch.discovery.zen.ZenDiscovery.findMaster(ZenDiscovery.java:485)
at org.elasticsearch.discovery.zen.ZenDiscovery.innterJoinCluster(ZenDiscovery.java:242)
at org.elasticsearch.discovery.zen.ZenDiscovery.access$500(ZenDiscovery.java:62)
at org.elasticsearch.discovery.zen.ZenDiscovery$1.run(ZenDiscovery.java:227)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.NullPointerException
at org.apache.commons.codec.binary.Base64.encodeBase64(Base64.java:287)
at org.apache.commons.codec.binary.Base64.encodeBase64(Base64.java:178)
at com.amazonaws.auth.AbstractAWSSigner.sign(AbstractAWSSigner.java:65)
... 17 more
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment