gistfile1.txt

13:42:48,928 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-405,shared=gatein-udp) perf11-20618: not member of view [perf12-19308|36]; discarding it
13:42:48,952 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-406,shared=gatein-udp) perf11-47165: not member of view [perf12-46484|35]; discarding it
13:42:48,963 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-407,shared=gatein-udp) perf11-6574: not member of view [perf12-62182|35]; discarding it
13:42:49,460 WARNING [org.jgroups.protocols.pbcast.GMS] (Incoming-291,shared=gatein-udp) perf11-62585: not member of view [perf12-27325|38]; discarding it
13:42:52,492 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-410,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|36] [perf11-6574, perf12-62182], subgroups=[perf12-62182|35] [perf12-62182], [perf11-6574|34] [perf11-6574]
13:42:54,489 WARNING [org.jgroups.protocols.pbcast.GMS] (Incoming-292,shared=gatein-udp) perf11-62585: failed to collect all ACKs (expected=2) for view [perf11-62585|39] after 2000ms, missing ACKs from [perf12-27325]
13:42:54,495 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-409,shared=gatein-udp) perf11-6574: failed to collect all ACKs (expected=2) for view [perf11-6574|36] after 2000ms, missing ACKs from [perf12-62182]
13:42:54,626 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-418,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf12-19308|37] [perf12-19308, perf11-20618], subgroups=[perf12-19308|35] [perf11-20618], [perf12-19308|36] [perf12-19308]
13:42:54,632 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-417,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-47165|36] [perf11-47165, perf12-46484], subgroups=[perf11-47165|34] [perf11-47165], [perf12-46484|35] [perf12-46484]
13:42:56,610 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-415,shared=gatein-udp) perf11-20618: failed to collect all ACKs (expected=2) for view [perf12-19308|37] after 2000ms, missing ACKs from [perf12-19308]
13:42:56,620 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-416,shared=gatein-udp) perf11-47165: failed to collect all ACKs (expected=2) for view [perf11-47165|36] after 2000ms, missing ACKs from [perf12-46484]
13:45:13,837 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-488,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-20618|38] [perf11-20618]
13:45:13,964 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-487,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-47165|37] [perf11-47165]
13:45:13,837 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-489,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-6574|37] [perf11-6574]
13:45:18,514 WARN  [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-494,shared=gatein-udp) JGRP000011: perf11-47165: dropped message 28 from non-member perf12-46484 (view=[perf11-47165|37] [perf11-47165])
13:45:18,772 WARNING [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-311,shared=gatein-udp) [JGRP00011] perf11-62585: dropped message 37 from non-member perf12-27325 (view=[perf11-62585|40] [perf11-62585])
13:45:18,778 WARN  [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-496,shared=gatein-udp) JGRP000011: perf11-6574: dropped message 30 from non-member perf12-62182 (view=[perf11-6574|37] [perf11-6574])
13:45:18,783 WARN  [org.jgroups.protocols.pbcast.NAKACK2] (Incoming-497,shared=gatein-udp) JGRP000011: perf11-20618: dropped message 51 from non-member perf12-19308 (view=[perf11-20618|38] [perf11-20618])
13:45:18,798 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-499,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-47165|39] [perf11-47165, perf12-46484], subgroups=[perf11-47165|37] [perf11-47165], [perf12-46484|38] [perf12-46484]
13:45:20,644 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-502,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|39] [perf11-6574, perf12-62182], subgroups=[perf12-62182|38] [perf12-62182], [perf11-6574|37] [perf11-6574]
13:45:25,903 WARN  [org.jgroups.protocols.UDP] (Timer-2,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:26,169 WARN  [org.jgroups.protocols.UDP] (OOB-735,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:26,180 WARN  [org.jgroups.protocols.UDP] (OOB-717,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:26,181 WARN  [org.jgroups.protocols.UDP] (OOB-727,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:26,182 WARN  [org.jgroups.protocols.UDP] (OOB-716,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:25,921 WARN  [org.jgroups.protocols.UDP] (FD_SOCK pinger,gatein-cluster_portal,perf11-6574) null: no physical address for perf12-62182, dropping message
13:45:26,181 WARN  [org.jgroups.protocols.UDP] (TransferQueueBundler,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:26,885 WARN  [org.jgroups.protocols.UDP] (OOB-745,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:26,889 WARN  [org.jgroups.protocols.UDP] (OOB-746,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:26,894 WARN  [org.jgroups.protocols.UDP] (Timer-4,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:27,191 WARN  [org.jgroups.protocols.UDP] (OOB-747,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:27,191 WARN  [org.jgroups.protocols.UDP] (OOB-748,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:28,116 WARN  [org.jgroups.protocols.UDP] (OOB-752,shared=gatein-udp) null: no physical address for perf12-19308, dropping message
13:45:29,117 WARN  [org.jgroups.protocols.UDP] (OOB-751,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:29,117 WARN  [org.jgroups.protocols.UDP] (OOB-754,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:29,196 WARN  [org.jgroups.protocols.UDP] (OOB-775,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:29,197 WARN  [org.jgroups.protocols.UDP] (OOB-777,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:29,479 WARN  [org.jgroups.protocols.UDP] (Timer-1,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:30,123 WARN  [org.jgroups.protocols.UDP] (OOB-782,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:30,198 WARN  [org.jgroups.protocols.UDP] (OOB-785,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:31,196 WARN  [org.jgroups.protocols.UDP] (OOB-786,shared=gatein-udp) null: no physical address for perf12-62182, dropping message
13:45:41,794 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-517,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|40] [perf11-6574], subgroups=[perf11-6574|39] [perf11-6574]
13:45:48,863 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-520,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf12-19308|41] [perf12-19308, perf11-20618], subgroups=[perf11-20618|38] [perf11-20618], [perf12-19308|40] [perf12-19308]
13:45:31,219 ERROR [org.infinispan.topology.ClusterTopologyManagerImpl] (transport-thread-9,perf11) ISPN000196: Failed to recover cluster state after the current node became the coordinator: java.util.concurrent.ExecutionException: org.infinispan.CacheException: org.jgroups.TimeoutException: TimeoutException
        at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262) [rt.jar:1.7.0_09]
        at java.util.concurrent.FutureTask.get(FutureTask.java:119) [rt.jar:1.7.0_09]
        at org.infinispan.topology.ClusterTopologyManagerImpl.executeOnClusterSync(ClusterTopologyManagerImpl.java:571) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.topology.ClusterTopologyManagerImpl.recoverClusterStatus(ClusterTopologyManagerImpl.java:426) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.topology.ClusterTopologyManagerImpl.handleNewView(ClusterTopologyManagerImpl.java:234) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.topology.ClusterTopologyManagerImpl$ClusterViewListener$1.run(ClusterTopologyManagerImpl.java:625) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_09]
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) [rt.jar:1.7.0_09]
        at java.util.concurrent.FutureTask.run(FutureTask.java:166) [rt.jar:1.7.0_09]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09]
        at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09]
Caused by: org.infinispan.CacheException: org.jgroups.TimeoutException: TimeoutException
        at org.infinispan.util.Util.rewrapAsCacheException(Util.java:542) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:153) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.invokeRemotely(JGroupsTransport.java:518) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.topology.ClusterTopologyManagerImpl$2.call(ClusterTopologyManagerImpl.java:552) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.topology.ClusterTopologyManagerImpl$2.call(ClusterTopologyManagerImpl.java:549) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        ... 5 more
Caused by: org.jgroups.TimeoutException: TimeoutException
        at org.jgroups.util.Promise._getResultWithTimeout(Promise.java:145)
        at org.jgroups.util.Promise.getResultWithTimeout(Promise.java:40)
        at org.jgroups.util.AckCollector.waitForAllAcks(AckCollector.java:93)
        at org.jgroups.protocols.RSVP$Entry.block(RSVP.java:287)
        at org.jgroups.protocols.RSVP.down(RSVP.java:118)
        at org.jgroups.protocols.pbcast.STATE_TRANSFER.down(STATE_TRANSFER.java:238)
        at org.jgroups.stack.ProtocolStack.down(ProtocolStack.java:1030)
        at org.jgroups.JChannel.down(JChannel.java:722)
        at org.jgroups.blocks.MessageDispatcher$ProtocolAdapter.down(MessageDispatcher.java:618)
        at org.jgroups.blocks.RequestCorrelator.sendRequest(RequestCorrelator.java:174)
        at org.jgroups.blocks.GroupRequest.sendRequest(GroupRequest.java:360)
        at org.jgroups.blocks.GroupRequest.sendRequest(GroupRequest.java:103)
        at org.jgroups.blocks.Request.execute(Request.java:83)
        at org.jgroups.blocks.MessageDispatcher.cast(MessageDispatcher.java:337)
        at org.jgroups.blocks.MessageDispatcher.castMessage(MessageDispatcher.java:249)
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.processCalls(CommandAwareRpcDispatcher.java:333) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        at org.infinispan.remoting.transport.jgroups.CommandAwareRpcDispatcher.invokeRemoteCommands(CommandAwareRpcDispatcher.java:146) [infinispan-core-5.2.10.Final-redhat-1.jar:5.2.10.Final-redhat-1]
        ... 8 more

13:46:00,669 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-524,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|41] [perf11-6574, perf12-62182], subgroups=[perf12-62182|38] [perf12-62182], [perf11-6574|40] [perf11-6574]
13:47:07,707 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-540,shared=gatein-udp) perf11-47165: not member of view [perf12-46484|40]; discarding it
13:47:07,706 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-537,shared=gatein-udp) perf11-20618: not member of view [perf12-19308|42]; discarding it
13:47:07,708 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-538,shared=gatein-udp) perf11-6574: not member of view [perf12-62182|42]; discarding it
13:47:07,710 WARNING [org.jgroups.protocols.pbcast.GMS] (Incoming-336,shared=gatein-udp) perf11-62585: not member of view [perf12-27325|43]; discarding it
13:47:09,607 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-542,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-6574|43] [perf11-6574]
13:47:09,607 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-541,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-47165|41] [perf11-47165]
13:47:09,646 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-545,shared=gatein-udp) ISPN000094: Received new cluster view: [perf11-20618|43] [perf11-20618]
13:47:17,623 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-549,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf12-19308|44] [perf12-19308, perf11-20618], subgroups=[perf11-20618|43] [perf11-20618], [perf12-19308|42] [perf12-19308]
13:47:25,170 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-553,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-47165|42] [perf11-47165, perf12-46484], subgroups=[perf11-47165|41] [perf11-47165], [perf12-46484|40] [perf12-46484]
13:47:27,256 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-556,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|44] [perf11-6574, perf12-62182], subgroups=[perf12-62182|42] [perf12-62182], [perf11-6574|43] [perf11-6574]
13:49:22,481 WARNING [org.jgroups.protocols.pbcast.GMS] (Incoming-362,shared=gatein-udp) perf11-62585: not member of view [perf12-27325|46]; discarding it
13:49:22,495 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-578,shared=gatein-udp) perf11-6574: not member of view [perf12-62182|45]; discarding it
13:49:22,501 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-580,shared=gatein-udp) perf11-20618: not member of view [perf12-19308|45]; discarding it
13:49:22,501 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-581,shared=gatein-udp) perf11-47165: not member of view [perf12-46484|43]; discarding it
13:49:25,427 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-583,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-6574|46] [perf11-6574, perf12-62182], subgroups=[perf12-62182|45] [perf12-62182], [perf11-6574|44] [perf11-6574]
13:49:25,450 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-585,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf11-47165|44] [perf11-47165, perf12-46484], subgroups=[perf11-47165|42] [perf11-47165], [perf12-46484|43] [perf12-46484]
13:49:27,428 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-582,shared=gatein-udp) perf11-6574: failed to collect all ACKs (expected=2) for view [perf11-6574|46] after 2000ms, missing ACKs from [perf12-62182]
13:49:27,449 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-584,shared=gatein-udp) perf11-47165: failed to collect all ACKs (expected=2) for view [perf11-47165|44] after 2000ms, missing ACKs from [perf12-46484]
13:49:31,020 INFO  [org.infinispan.remoting.transport.jgroups.JGroupsTransport] (Incoming-599,shared=gatein-udp) ISPN000093: Received new, MERGED cluster view: MergeView::[perf12-19308|46] [perf12-19308, perf11-20618], subgroups=[perf12-19308|44] [perf11-20618], [perf12-19308|45] [perf12-19308]
13:49:33,019 WARN  [org.jgroups.protocols.pbcast.GMS] (Incoming-598,shared=gatein-udp) perf11-20618: failed to collect all ACKs (expected=2) for view [perf12-19308|46] after 2000ms, missing ACKs from [perf12-19308]