Skip to content

Instantly share code, notes, and snippets.

@Zhengquan

Zhengquan/instance_b_info.log

Last active March 23, 2016 07:54
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Zhengquan/2f2e1d1dd819482da39a to your computer and use it in GitHub Desktop.
Save Zhengquan/2f2e1d1dd819482da39a to your computer and use it in GitHub Desktop.
Download ZIP
Logs for EventStore instance B
Raw
instance_b_info.log
[PID:05828:013 2016.03.22 09:08:42.948 INFO Application ] Exiting with exit code: 0.
Exit reason: Shutdown with exiting from process was requested.
[PID:05828:013 2016.03.22 09:08:42.917 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] IS SHUT DOWN!!! SWEET DREAMS!!!
[PID:05828:009 2016.03.22 09:08:42.480 TRACE InMemoryBus ] SLOW BUS MSG [SubscriptionsBus]: BecomeShuttingDown - 62ms. Handler: SubscriptionsService.
[PID:05828:013 2016.03.22 09:08:42.449 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] All Services Shutdown.
[PID:05828:013 2016.03.22 09:08:42.449 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'Storage Chaser' has shut down.
[PID:05828:013 2016.03.22 09:08:42.433 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'Master Replication Service' has shut down.
[PID:05828:013 2016.03.22 09:08:42.418 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [10.10.13.101:2116])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811705/88988812354/88988812116/E259@88988811878:{afc1c45c-50dd-4762-b179-141ff961ea95} | 2016-03-22 09:08:42.296
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [ShuttingDown, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812753/88988812753/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:42.418
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811705/88988811878/88988811878/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:42.101
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811705/88988812354/88988812116/E259@88988811878:{afc1c45c-50dd-4762-b179-141ff961ea95} | 2016-03-22 09:08:42.296
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [ShuttingDown, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812753/88988812753/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:42.418
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <DEAD> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811705/88988811878/88988811878/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:42.418
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:08:42.418 TRACE GossipServiceBase ] Looks like node [10.10.13.101:2116] is DEAD (TCP connection lost).
[PID:05828:013 2016.03.22 09:08:42.418 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'HttpServer [http://10.10.13.102:2113/]' has shut down.
[PID:05828:013 2016.03.22 09:08:42.418 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'HttpServer [https://147.42.14.101:2114/]' has shut down.
[PID:05828:013 2016.03.22 09:08:42.418 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'StorageReader' has shut down.
[PID:05828:013 2016.03.22 09:08:42.418 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] Service 'StorageWriter' has shut down.
[PID:05828:013 2016.03.22 09:08:42.418 TRACE QueuedHandlerMRES ] SLOW QUEUE MSG [MainQueue]: RequestShutdown - 114ms. Q: 0/9.
[PID:05828:013 2016.03.22 09:08:42.418 INFO TcpConnectionManager] Connection 'master-secure' [10.10.13.101:2116, {0d78f295-5f13-4658-a762-44bcbae96308}] closed: Success.
[PID:05828:013 2016.03.22 09:08:42.418 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:42.418: S10.10.13.101:2116, L10.10.13.102:50712, {0d78f295-5f13-4658-a762-44bcbae96308}]:
Received bytes: 2990, Sent bytes: 694
Send calls: 1, callbacks: 1
Receive calls: 6, callbacks: 5
Close reason: [Success] Node state changed to ShuttingDown. Closing replication connection.
[PID:05828:013 2016.03.22 09:08:42.418 TRACE TcpConnectionManager] Closing connection 'master-secure' [10.10.13.101:2116, L10.10.13.102:50712, {0d78f295-5f13-4658-a762-44bcbae96308}] cleanly. Reason: Node state changed to ShuttingDown. Closing replication connection.
[PID:05828:013 2016.03.22 09:08:42.418 TRACE InMemoryBus ] SLOW BUS MSG [MainBus]: BecomeShuttingDown - 50ms. Handler: HttpService.
[PID:05828:013 2016.03.22 09:08:42.335 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] IS SHUTTING DOWN!!! FAREWELL, WORLD...
[PID:05828:010 2016.03.22 09:08:42.335 TRACE StorageWriterService] Blocking message DataChunkBulk in StorageWriterService. Message:
DataChunkBulk message: MasterId: c532c941-4817-4064-92f4-92ddcdde98fe, SubscriptionId: 310e33ec-5a58-4dee-bbd0-8fc154beb124, ChunkStartNumber: 331, ChunkEndNumber: 331, SubscriptionPosition: 88988812039, DataBytes length: 315, CompleteChunk: False
[PID:05828:010 2016.03.22 09:08:42.335 TRACE StorageWriterService] Blocking message DataChunkBulk in StorageWriterService. Message:g
DataChunkBulk message: MasterId: c532c941-4817-4064-92f4-92ddcdde98fe, SubscriptionId: 310e33ec-5a58-4dee-bbd0-8fc154beb124, ChunkStartNumber: 331, ChunkEndNumber: 331, SubscriptionPosition: 88988811015, DataBytes length: 1024, CompleteChunk: False
[PID:05828:010 2016.03.22 09:08:42.319 TRACE StorageWriterService] Blocking message DataChunkBulk in StorageWriterService. Message:
DataChunkBulk message: MasterId: c532c941-4817-4064-92f4-92ddcdde98fe, SubscriptionId: 310e33ec-5a58-4dee-bbd0-8fc154beb124, ChunkStartNumber: 331, ChunkEndNumber: 331, SubscriptionPosition: 88988809991, DataBytes length: 1024, CompleteChunk: False
[PID:05828:013 2016.03.22 09:08:42.304 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.282
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Clone, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812753/88988812753/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:42.304
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811705/88988811878/88988811878/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:42.101
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811705/88988812354/88988812116/E259@88988811878:{afc1c45c-50dd-4762-b179-141ff961ea95} | 2016-03-22 09:08:42.296
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Clone, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812753/88988812753/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:42.304
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811705/88988811878/88988811878/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:42.101
--------------------------------------------------------------------------------
[PID:05828:010 2016.03.22 09:08:42.304 INFO ClusterStorageWriter] OFFLINE TRUNCATION IS NEEDED (SubscribedAt 88988809991 (0x14B8257B07) <= LastCommitPosition 88988811590 (0x14B8258146)). SHUTTING DOWN NODE.
[PID:05828:029 2016.03.22 09:08:42.304 INFO TcpConnectionManager] Connection 'external-secure' [147.42.11.23:53251, {720663fe-63f1-40ab-b2d2-3adae35e08c1}] closed: Success.
[PID:05828:029 2016.03.22 09:08:42.304 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:42.304: S147.42.11.23:53251, L147.42.14.101:2115, {720663fe-63f1-40ab-b2d2-3adae35e08c1}]:
Received bytes: 12249193, Sent bytes: 109657872
Send calls: 84468, callbacks: 84468
Receive calls: 84487, callbacks: 84487
Close reason: [Success] Socket closed.
[PID:05828:013 2016.03.22 09:08:42.304 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] IS CLONE!!! SPARTA!!! MASTER IS [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]
[PID:05828:013 2016.03.22 09:08:42.304 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] CLONE ASSIGNMENT RECEIVED FROM [10.10.13.101:2111,10.10.13.101:2116,{c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:42.304 DEBUG ElectionsService ] ELECTIONS: (V=453) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.288 INFO ElectionsService ] ELECTIONS: (V=453) DONE. ELECTED MASTER = [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988811705,W=88988812116,C=88988812116,E259@88988811878:{afc1c45c-50dd-4762-b179-141ff961ea95}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812753,C=88988812753,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) ACCEPT FROM [10.10.13.103:2113,{625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) PROPOSAL FROM [10.10.13.103:2113,{625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988811705,W=88988812116,C=88988812116,E259@88988811878:{afc1c45c-50dd-4762-b179-141ff961ea95}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812753,C=88988812753,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) SHIFT TO REG_NONLEADER.
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) PREPARE FROM [10.10.13.103:2113, {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}].
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) VIEWCHANGE FROM [10.10.13.103:2113, {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}].
[PID:05828:010 2016.03.22 09:08:42.288 INFO ClusterStorageWriter] Master [10.10.13.101:2116,{c532c941-4817-4064-92f4-92ddcdde98fe}] subscribed us at 88988809991 (0x14B8257B07), which is less than our writer checkpoint 88988812753 (0x14B82585D1). TRUNCATION IS NEEDED!
[PID:05828:010 2016.03.22 09:08:42.288 INFO ClusterStorageWriter] === SUBSCRIBED to [10.10.13.101:2116,{c532c941-4817-4064-92f4-92ddcdde98fe}] at 88988809991 (0x14B8257B07). SubscriptionId: {310e33ec-5a58-4dee-bbd0-8fc154beb124}.
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:08:42.288 DEBUG ElectionsService ] ELECTIONS: (V=453) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:42.288 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] IS CATCHING UP!!! BANZAI!!! MASTER IS [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]
[PID:05828:030 2016.03.22 09:08:42.288 INFO TcpConnectionManager] Connection 'external-secure' [147.42.11.18:58559, {a2e7e1e8-b8c6-44c7-b204-8f633017e154}] closed: Success.
[PID:05828:030 2016.03.22 09:08:42.288 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:42.288: S147.42.11.18:58559, L147.42.14.101:2115, {a2e7e1e8-b8c6-44c7-b204-8f633017e154}]:
Received bytes: 6613289, Sent bytes: 651155376
Send calls: 103215, callbacks: 103215
Receive calls: 103218, callbacks: 103218
Close reason: [Success] Socket closed.
[PID:05828:030 2016.03.22 09:08:42.194 INFO TcpConnectionSsl ] [S10.10.13.101:2116, L10.10.13.102:50712]:
Cipher: Aes128 strength 128
Hash: Sha1 strength 160
Key exchange: RsaKeyX strength 2048
Protocol: Tls
Is authenticated: True as server? False
IsSigned: True
Is Encrypted: True
Can read: True, write True
Can timeout: True
Certificate revocation list checked: False
Local certificate is null.
Remote certificate was issued to CN=eventstore-prod.company.local and is valid from 12/01/2016 00:40:17 until 12/01/2018 00:50:17.
[PID:05828:017 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptionEventReaders is not empty after all the projections have been killed
[PID:05828:017 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _eventReaders is not empty after all the projections have been killed
[PID:05828:016 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptionEventReaders is not empty after all the projections have been killed
[PID:05828:017 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptions is not empty after all the projections have been killed
[PID:05828:016 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _eventReaders is not empty after all the projections have been killed
[PID:05828:017 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _projections is not empty after all the projections have been killed
[PID:05828:016 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptions is not empty after all the projections have been killed
[PID:05828:016 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _projections is not empty after all the projections have been killed
[PID:05828:015 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptionEventReaders is not empty after all the projections have been killed
[PID:05828:015 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _eventReaders is not empty after all the projections have been killed
[PID:05828:015 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _subscriptions is not empty after all the projections have been killed
[PID:05828:015 2016.03.22 09:08:42.132 INFO ProjectionCoreServic] _projections is not empty after all the projections have been killed
[PID:05828:036 2016.03.22 09:08:42.101 INFO TcpConnectionManager] Connection 'master-secure' ({0d78f295-5f13-4658-a762-44bcbae96308}) to [10.10.13.101:2116] established.
[PID:05828:013 2016.03.22 09:08:42.101 INFO ReplicaService ] Subscribing at LogPosition: 88988812753 (0x14B82585D1) to MASTER [10.10.13.101:2116, {c532c941-4817-4064-92f4-92ddcdde98fe}] as replica with SubscriptionId: {310e33ec-5a58-4dee-bbd0-8fc154beb124}, ConnectionId: {0d78f295-5f13-4658-a762-44bcbae96308}, LocalEndPoint: [10.10.13.102:50712], Epochs:
E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}
E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4}
E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}
E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}
E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}
E252@88851099266:{17b3c4bd-657c-4198-8a0a-fd9f77315b90}
E251@88850843295:{2ff9af10-fe13-42c1-a920-cc6a7dfbedac}
E250@88848144181:{63db5a24-8710-4ab4-acad-c7ccfa07ef17}
E249@88848062423:{6bb59a6b-98f1-41b3-abf7-8b783123e209}
E248@88847944151:{a0291f45-1a7f-4515-8559-ef750de26604}
E247@88847912288:{bca61b3d-4e55-4759-94f9-70333acdeec0}
E246@88847834867:{8e78b4aa-c05e-4dbe-a33c-9e9065deedf2}
E245@88847812605:{c3cc782a-3d71-4352-9c6c-38d2fb42b454}
E244@88847469753:{b1d83050-7ceb-4a9f-a7cf-5166d376f5e8}
E243@88847463572:{519a2577-037a-4412-8513-c474319cfd65}
E242@88847462204:{56b45f03-0446-4433-a8ec-1fc564de367d}
E241@88847461966:{3eed6184-bbbb-4a49-9ce2-8966a16e6636}
E240@88847434651:{29e8a800-9309-4f2e-9d16-8aaf91c16a6a}
E239@88847316574:{dd198c62-3ac2-46d8-a394-a199cc9e0af0}
E238@88847000846:{4c177624-6649-405f-8ea7-df28dd6ca4c5}...
.
[PID:05828:013 2016.03.22 09:08:42.085 DEBUG ElectionsService ] ELECTIONS: (V=452) ACCEPT FROM [10.10.13.103:2113,{625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.070 INFO ClusterVNodeControll] ========== [10.10.13.102:2113] PRE-REPLICA STATE, WAITING FOR CHASER TO CATCH UP... MASTER IS [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]
[PID:05828:013 2016.03.22 09:08:42.070 INFO ElectionsService ] ELECTIONS: (V=452) DONE. ELECTED MASTER = [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988811705,W=88988811878,C=88988811878,E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812753,C=88988812753,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}]).
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) PROPOSAL FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988811705,W=88988811878,C=88988811878,E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812753,C=88988812753,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) SHIFT TO REG_NONLEADER.
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) PREPARE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: (V=452) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS.
[PID:05828:013 2016.03.22 09:08:42.070 DEBUG ClusterVNodeControll] There are FEW MASTERS according to gossip, need to start elections. MASTER: [InstanceId: {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}, InternalTcp: 10.10.13.102:2111, InternalSecureTcp: 10.10.13.102:2116, ExternalTcp: 147.42.14.101:2112, ExternalSecureTcp: 147.42.14.101:2115, InternalHttp: 10.10.13.102:2113, ExternalHttp: 147.42.14.101:2114].
GOSSIP:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.282
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812753/88988812753/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:42.070
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811705/88988811878/88988811878/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:42.084
[PID:05828:013 2016.03.22 09:08:41.758 DEBUG ElectionsService ] ELECTIONS: (V=451) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:08:41.758 DEBUG ElectionsService ] ELECTIONS: (V=451) SENDING PROPOSAL CANDIDATE: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812649,C=88988812649,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}), ME: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812649,C=88988812649,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:41.758 DEBUG ElectionsService ] ELECTIONS: (V=451) SHIFT TO REG_LEADER.
[PID:05828:013 2016.03.22 09:08:41.758 DEBUG ElectionsService ] ELECTIONS: (V=451) PREPARE_OK FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988811186,W=88988811359,C=88988811359,E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87}).
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) PREPARE_OK FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988811590,W=88988812649,C=88988812649,E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316}).
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) SHIFT TO PREPARE PHASE.
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ElectionsService ] ELECTIONS: (V=451) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:41.742 DEBUG ClusterVNodeControll] There are FEW MASTERS according to gossip, need to start elections. MASTER: [InstanceId: {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}, InternalTcp: 10.10.13.102:2111, InternalSecureTcp: 10.10.13.102:2116, ExternalTcp: 147.42.14.101:2112, ExternalSecureTcp: 147.42.14.101:2115, InternalHttp: 10.10.13.102:2113, ExternalHttp: 147.42.14.101:2114].
GOSSIP:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.282
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812649/88988812649/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:41.742
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.755
[PID:05828:013 2016.03.22 09:08:41.742 TRACE QueuedHandlerMRES ] SLOW QUEUE MSG [MainQueue]: GossipUpdated - 452ms. Q: 0/18.
[PID:05828:013 2016.03.22 09:08:41.290 DEBUG ClusterVNodeControll] There are FEW MASTERS according to gossip, need to start elections. MASTER: [InstanceId: {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}, InternalTcp: 10.10.13.102:2111, InternalSecureTcp: 10.10.13.102:2116, ExternalTcp: 147.42.14.101:2112, ExternalSecureTcp: 147.42.14.101:2115, InternalHttp: 10.10.13.102:2113, ExternalHttp: 147.42.14.101:2114].
GOSSIP:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.282
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812545/88988812545/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:41.290
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.084
[PID:05828:013 2016.03.22 09:08:41.290 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988798272/88988799528/88988799528/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.454
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988805081/88988805718/88988805718/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.463
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <DEAD> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988801767/88988802205/88988802205/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.837
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.282
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988811590/88988812545/88988812545/E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} | 2016-03-22 09:08:41.290
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Master, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988811186/88988811359/88988811359/E258@88988809991:{e392ad92-1d92-47aa-9bcf-0debc33afa87} | 2016-03-22 09:08:41.084
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:08:40.837 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [10.10.13.101:2111])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988798272/88988799528/88988799528/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.454
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988805081/88988805718/88988805718/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.463
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988801767/88988802205/88988802205/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.351
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988798272/88988799528/88988799528/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.454
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988805081/88988805718/88988805718/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.463
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <DEAD> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988801767/88988802205/88988802205/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.837
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:08:40.837 TRACE GossipServiceBase ] Looks like node [10.10.13.101:2111] is DEAD (TCP connection lost).
[PID:05828:022 2016.03.22 09:08:40.822 INFO TcpConnectionManager] Connection 'internal-secure' [10.10.13.101:64090, {45791cdb-59a5-434f-8fb1-24b9e64f75a6}] closed: Success.
[PID:05828:022 2016.03.22 09:08:40.806 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:40.806: S10.10.13.101:64090, L10.10.13.102:2116, {45791cdb-59a5-434f-8fb1-24b9e64f75a6}]:
Received bytes: 16465366, Sent bytes: 160435560
Send calls: 298150, callbacks: 298150
Receive calls: 349186, callbacks: 349186
Close reason: [Success] Socket closed.
[PID:05828:013 2016.03.22 09:08:40.806 DEBUG ElectionsService ] ELECTIONS: (V=450) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:08:40.806 DEBUG ElectionsService ] ELECTIONS: (V=450) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:08:40.806 DEBUG ElectionsService ] ELECTIONS: (V=450) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:08:40.806 DEBUG ElectionsService ] ELECTIONS: (V=450) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:010 2016.03.22 09:08:40.494 DEBUG EpochManager ] === Update Last Epoch E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} (previous epoch at 88988362947).
[PID:05828:010 2016.03.22 09:08:40.494 DEBUG EpochManager ] === Writing E257@88988805718:{16994d92-0059-494f-a5a7-80eff4f04316} (previous epoch at 88988362947).
[PID:05828:013 2016.03.22 09:08:40.494 INFO ElectionsService ] ELECTIONS: (V=449) DONE. ELECTED MASTER = [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988805081,W=88988805718,C=88988805718,E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988805081,W=88988805718,C=88988805718,E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4}).
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) PROPOSAL FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988805081,W=88988805718,C=88988805718,E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988805081,W=88988805718,C=88988805718,E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4}).
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) SHIFT TO REG_NONLEADER.
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) PREPARE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:08:40.494 DEBUG ElectionsService ] ELECTIONS: (V=449) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:08:40.317 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988758976/88988778541/88988778541/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.725
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988798272/88988800048/88988800048/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.052
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988798272/88988800048/88988800048/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.070
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988758976/88988778853/88988778853/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.267
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988801767/88988802101/88988802101/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.317
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988798272/88988800048/88988800048/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:40.070
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:08:39.725 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [10.10.13.103:2111])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988758976/88988778541/88988778541/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:35.017
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988798272/88988799840/88988799840/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.413
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988798272/88988799840/88988799840/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.410
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988758976/88988778541/88988778541/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.725
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988798272/88988799840/88988799840/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.413
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988798272/88988799840/88988799840/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:08:39.410
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:08:39.725 TRACE GossipServiceBase ] Looks like node [10.10.13.103:2111] is DEAD (TCP connection lost).
[PID:05828:011 2016.03.22 09:08:39.709 INFO TcpConnectionManager] Connection 'internal-secure' [10.10.13.103:60218, {4b930abc-55c5-4830-b6a1-b4687f501f38}] closed: Success.
[PID:05828:011 2016.03.22 09:08:39.709 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:39.709: S10.10.13.103:60218, L10.10.13.102:2116, {4b930abc-55c5-4830-b6a1-b4687f501f38}]:
Received bytes: 51058, Sent bytes: 583098
Send calls: 906, callbacks: 906
Receive calls: 746, callbacks: 745
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 704
[PID:05828:011 2016.03.22 09:08:39.709 TRACE TcpConnectionManager] Closing connection 'internal-secure' [10.10.13.103:60218, L10.10.13.102:2116, {4b930abc-55c5-4830-b6a1-b4687f501f38}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 704
[PID:05828:036 2016.03.22 09:08:38.477 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:59275, {97b4ca68-ca5b-4ca4-b366-fc5d03b24816}] closed: SocketError.
[PID:05828:036 2016.03.22 09:08:38.461 INFO TcpConnectionSsl ] [S50.56.142.170:59275, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:08:38.461 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:38.461: S50.56.142.170:59275, L147.42.14.101:2115, {97b4ca68-ca5b-4ca4-b366-fc5d03b24816}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:08:38.461 INFO TcpConnectionSsl ] [S50.56.142.170:59275, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:08:38.461 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:59275, L147.42.14.101:2115, {97b4ca68-ca5b-4ca4-b366-fc5d03b24816}].
[PID:05828:022 2016.03.22 09:08:19.363 INFO TcpConnectionSsl ] [S78.136.44.23:50749, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:022 2016.03.22 09:08:19.363 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:50749, {b3d741cb-4495-4c54-bfb3-23276b32f714}] closed: SocketError.
[PID:05828:022 2016.03.22 09:08:19.363 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:19.363: S78.136.44.23:50749, L147.42.14.101:2115, {b3d741cb-4495-4c54-bfb3-23276b32f714}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:022 2016.03.22 09:08:19.363 INFO TcpConnectionSsl ] [S78.136.44.23:50749, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:08:19.363 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:50749, L147.42.14.101:2115, {b3d741cb-4495-4c54-bfb3-23276b32f714}].
[PID:05828:036 2016.03.22 09:08:13.168 INFO TcpConnectionSsl ] [S50.57.61.7:58820, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:08:13.168 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:58820, {16960174-a9b1-45bd-947c-e7ca70696a35}] closed: SocketError.
[PID:05828:036 2016.03.22 09:08:13.168 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:08:13.168: S50.57.61.7:58820, L147.42.14.101:2115, {16960174-a9b1-45bd-947c-e7ca70696a35}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:08:13.168 INFO TcpConnectionSsl ] [S50.57.61.7:58820, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:08:13.168 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:58820, L147.42.14.101:2115, {16960174-a9b1-45bd-947c-e7ca70696a35}].
[PID:05828:029 2016.03.22 09:07:42.441 INFO TcpConnectionSsl ] [S147.42.11.25:63736, L147.42.14.101:2115]:
Cipher: Aes128 strength 128
Hash: Sha1 strength 160
Key exchange: RsaKeyX strength 2048
Protocol: Tls
Is authenticated: True as server? True
IsSigned: True
Is Encrypted: True
Can read: True, write True
Can timeout: True
Certificate revocation list checked: True
Local certificate was issued to CN=eventstore-prod.company.local and is valid from 12/01/2016 00:40:17 until 12/01/2018 00:50:17.
Remote certificate is null.
[PID:05828:036 2016.03.22 09:07:42.441 INFO TcpService ] External TCP connection accepted: [Secure, 147.42.11.25:63736, L147.42.14.101:2115, {ce116e04-aae0-4dbe-abbb-f47b89b25e35}].
[PID:05828:011 2016.03.22 09:07:41.614 INFO TcpConnectionManager] Connection 'external-secure' [147.42.0.50:49581, {f1db68f7-b96a-47c8-b006-a1ff408d1fea}] closed: Success.
[PID:05828:011 2016.03.22 09:07:41.614 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:41.614: S147.42.0.50:49581, L147.42.14.101:2115, {f1db68f7-b96a-47c8-b006-a1ff408d1fea}]:
Received bytes: 834580, Sent bytes: 375070
Send calls: 10545, callbacks: 10545
Receive calls: 10535, callbacks: 10534
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 10529
[PID:05828:011 2016.03.22 09:07:41.614 TRACE TcpConnectionManager] Closing connection 'external-secure' [147.42.0.50:49581, L147.42.14.101:2115, {f1db68f7-b96a-47c8-b006-a1ff408d1fea}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 10529
[PID:05828:013 2016.03.22 09:07:40.969 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.592
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363913/88988363913/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.891
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.564
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.951
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988364121/88988364121/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.969
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.564
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:40.610 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.751
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.876
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.877
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Clone, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.592
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.610
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988362204/88988363809/88988363809/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:40.564
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:39.876 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.101:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.751
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.876
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988359106/88988359444/88988359444/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.550
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.751
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.876
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.877
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:39.783 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.751
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988362947/88988362947/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.658
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988359106/88988359444/88988359444/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.550
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.751
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988363289/88988363289/E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} | 2016-03-22 09:07:39.783
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988359106/88988359444/88988359444/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.550
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:39.751 INFO MasterReplicationSer] Subscribed replica [10.10.13.103:2111,S:5a0e96ef-5079-43ab-822b-67cb9e897c87] for data send at 88988291045 (0x14B81D8FE5).
[PID:05828:013 2016.03.22 09:07:39.736 INFO MasterReplicationSer] SUBSCRIBE REQUEST from [10.10.13.103:2111,C:{4b930abc-55c5-4830-b6a1-b4687f501f38},S:{5a0e96ef-5079-43ab-822b-67cb9e897c87},88988291045(0x14B81D8FE5),E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}, E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}, E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}, E252@88851099266:{17b3c4bd-657c-4198-8a0a-fd9f77315b90}, E251@88850843295:{2ff9af10-fe13-42c1-a920-cc6a7dfbedac}, E250@88848144181:{63db5a24-8710-4ab4-acad-c7ccfa07ef17}, E249@88848062423:{6bb59a6b-98f1-41b3-abf7-8b783123e209}, E248@88847944151:{a0291f45-1a7f-4515-8559-ef750de26604}, E247@88847912288:{bca61b3d-4e55-4759-94f9-70333acdeec0}, E246@88847834867:{8e78b4aa-c05e-4dbe-a33c-9e9065deedf2}, E245@88847812605:{c3cc782a-3d71-4352-9c6c-38d2fb42b454}, E244@88847469753:{b1d83050-7ceb-4a9f-a7cf-5166d376f5e8}, E243@88847463572:{519a2577-037a-4412-8513-c474319cfd65}, E242@88847462204:{56b45f03-0446-4433-a8ec-1fc564de367d}, E241@88847461966:{3eed6184-bbbb-4a49-9ce2-8966a16e6636}, E240@88847434651:{29e8a800-9309-4f2e-9d16-8aaf91c16a6a}, E239@88847316574:{dd198c62-3ac2-46d8-a394-a199cc9e0af0}, E238@88847000846:{4c177624-6649-405f-8ea7-df28dd6ca4c5}, E237@88846875893:{6dbe855c-407b-4efd-af7c-454a118ede95}, E236@88846874095:{7988472b-49c3-4591-8d18-ea7b602c0783}]...
[PID:05828:029 2016.03.22 09:07:39.736 INFO TcpConnectionSsl ] [S10.10.13.103:60218, L10.10.13.102:2116]:
Cipher: Aes128 strength 128
Hash: Sha1 strength 160
Key exchange: RsaKeyX strength 2048
Protocol: Tls
Is authenticated: True as server? True
IsSigned: True
Is Encrypted: True
Can read: True, write True
Can timeout: True
Certificate revocation list checked: True
Local certificate was issued to CN=eventstore-prod.company.local and is valid from 12/01/2016 00:40:17 until 12/01/2018 00:50:17.
Remote certificate is null.
[PID:05828:013 2016.03.22 09:07:39.705 DEBUG ElectionsService ] ELECTIONS: (V=448) ACCEPT FROM [10.10.13.103:2113,{625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:010 2016.03.22 09:07:39.673 DEBUG EpochManager ] === Update Last Epoch E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} (previous epoch at 88988257735).
[PID:05828:010 2016.03.22 09:07:39.658 DEBUG EpochManager ] === Writing E256@88988362947:{954e26dd-7936-4406-b023-ef1556d819e4} (previous epoch at 88988257735).
[PID:05828:013 2016.03.22 09:07:39.658 INFO ElectionsService ] ELECTIONS: (V=448) DONE. ELECTED MASTER = [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) SENDING PROPOSAL CANDIDATE: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}), ME: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) SHIFT TO REG_LEADER.
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) PREPARE_OK FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) PREPARE_OK FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988362204,W=88988362947,C=88988362947,E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5}).
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) SHIFT TO PREPARE PHASE.
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:07:39.658 DEBUG ElectionsService ] ELECTIONS: (V=448) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:07:39.642 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:34.527
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988359444/88988360295/88988360295/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.520
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988359106/88988359444/88988359444/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.550
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988290473/88988291045/88988291045/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.587
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988362204/88988362947/88988362947/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.642
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988359106/88988359444/88988359444/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:39.550
--------------------------------------------------------------------------------
[PID:05828:036 2016.03.22 09:07:39.595 INFO TcpService ] Internal TCP connection accepted: [Secure, 10.10.13.103:60218, L10.10.13.102:2116, {4b930abc-55c5-4830-b6a1-b4687f501f38}].
[PID:05828:013 2016.03.22 09:07:39.341 DEBUG ElectionsService ] ELECTIONS: (V=447) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:07:39.341 DEBUG ElectionsService ] ELECTIONS: (V=447) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:07:39.341 DEBUG ElectionsService ] ELECTIONS: (V=447) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:07:39.341 DEBUG ElectionsService ] ELECTIONS: (V=447) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:036 2016.03.22 09:07:38.421 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:65309, {3196f4a6-5f87-469e-b9f4-a685bb8dd33a}] closed: SocketError.
[PID:05828:036 2016.03.22 09:07:38.421 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:38.421: S50.56.142.170:65309, L147.42.14.101:2115, {3196f4a6-5f87-469e-b9f4-a685bb8dd33a}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:07:38.421 INFO TcpConnectionSsl ] [S50.56.142.170:65309, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:07:38.421 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:65309, L147.42.14.101:2115, {3196f4a6-5f87-469e-b9f4-a685bb8dd33a}].
[PID:05828:036 2016.03.22 09:07:38.421 INFO TcpConnectionSsl ] [S50.56.142.170:65309, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:013 2016.03.22 09:07:34.527 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [10.10.13.103:2111])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:29.602
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988288813/88988289120/88988289120/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:33.825
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988267178/88988268442/88988268442/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:32.492
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:34.527
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988288813/88988289120/88988289120/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:33.825
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988267178/88988268442/88988268442/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:32.492
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:34.527 TRACE GossipServiceBase ] Looks like node [10.10.13.103:2111] is DEAD (TCP connection lost).
[PID:05828:011 2016.03.22 09:07:34.511 INFO TcpConnectionManager] Connection 'internal-secure' [10.10.13.103:60214, {fce312c9-3310-428f-937e-df612d2a7d30}] closed: Success.
[PID:05828:011 2016.03.22 09:07:34.511 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:34.511: S10.10.13.103:60214, L10.10.13.102:2116, {fce312c9-3310-428f-937e-df612d2a7d30}]:
Received bytes: 694, Sent bytes: 93810
Send calls: 82, callbacks: 82
Receive calls: 2, callbacks: 1
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 1
[PID:05828:011 2016.03.22 09:07:34.511 TRACE TcpConnectionManager] Closing connection 'internal-secure' [10.10.13.103:60214, L10.10.13.102:2116, {fce312c9-3310-428f-937e-df612d2a7d30}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 1
[PID:05828:013 2016.03.22 09:07:29.789 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.101:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:29.602
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988260942/88988261565/88988261565/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:29.789
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988257402/88988257735/88988257735/E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f} | 2016-03-22 09:07:29.461
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:29.602
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988260942/88988261565/88988261565/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:29.789
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988260942/88988261565/88988261565/E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} | 2016-03-22 09:07:29.789
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:29.586 INFO MasterReplicationSer] Subscribed replica [10.10.13.103:2111,S:fc897411-0c8d-4a6c-be26-68af696d6046] for data send at 88988222041 (0x14B81C8259).
[PID:05828:013 2016.03.22 09:07:29.586 INFO MasterReplicationSer] SUBSCRIBE REQUEST from [10.10.13.103:2111,C:{fce312c9-3310-428f-937e-df612d2a7d30},S:{fc897411-0c8d-4a6c-be26-68af696d6046},88988222041(0x14B81C8259),E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}, E252@88851099266:{17b3c4bd-657c-4198-8a0a-fd9f77315b90}, E251@88850843295:{2ff9af10-fe13-42c1-a920-cc6a7dfbedac}, E250@88848144181:{63db5a24-8710-4ab4-acad-c7ccfa07ef17}, E249@88848062423:{6bb59a6b-98f1-41b3-abf7-8b783123e209}, E248@88847944151:{a0291f45-1a7f-4515-8559-ef750de26604}, E247@88847912288:{bca61b3d-4e55-4759-94f9-70333acdeec0}, E246@88847834867:{8e78b4aa-c05e-4dbe-a33c-9e9065deedf2}, E245@88847812605:{c3cc782a-3d71-4352-9c6c-38d2fb42b454}, E244@88847469753:{b1d83050-7ceb-4a9f-a7cf-5166d376f5e8}, E243@88847463572:{519a2577-037a-4412-8513-c474319cfd65}, E242@88847462204:{56b45f03-0446-4433-a8ec-1fc564de367d}, E241@88847461966:{3eed6184-bbbb-4a49-9ce2-8966a16e6636}, E240@88847434651:{29e8a800-9309-4f2e-9d16-8aaf91c16a6a}, E239@88847316574:{dd198c62-3ac2-46d8-a394-a199cc9e0af0}, E238@88847000846:{4c177624-6649-405f-8ea7-df28dd6ca4c5}, E237@88846875893:{6dbe855c-407b-4efd-af7c-454a118ede95}, E236@88846874095:{7988472b-49c3-4591-8d18-ea7b602c0783}, E235@88846860676:{64561e79-0a45-48ee-a2cb-c323fa1922ca}, E234@88846789365:{bd683373-3ddf-4036-a420-d4ea08cbf21d}]...
[PID:05828:036 2016.03.22 09:07:29.586 INFO TcpConnectionSsl ] [S10.10.13.103:60214, L10.10.13.102:2116]:
Cipher: Aes128 strength 128
Hash: Sha1 strength 160
Key exchange: RsaKeyX strength 2048
Protocol: Tls
Is authenticated: True as server? True
IsSigned: True
Is Encrypted: True
Can read: True, write True
Can timeout: True
Certificate revocation list checked: True
Local certificate was issued to CN=eventstore-prod.company.local and is valid from 12/01/2016 00:40:17 until 12/01/2018 00:50:17.
Remote certificate is null.
[PID:05828:010 2016.03.22 09:07:29.539 DEBUG EpochManager ] === Update Last Epoch E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} (previous epoch at 88988254606).
[PID:05828:013 2016.03.22 09:07:29.539 DEBUG ElectionsService ] ELECTIONS: (V=446) ACCEPT FROM [10.10.13.103:2113,{625acf3f-d4cb-474f-b8f4-e3f1f71ccdac}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:010 2016.03.22 09:07:29.539 DEBUG EpochManager ] === Writing E255@88988257735:{81acdb19-3200-4c53-af92-ee92419a66d5} (previous epoch at 88988254606).
[PID:05828:013 2016.03.22 09:07:29.539 INFO ElectionsService ] ELECTIONS: (V=446) DONE. ELECTED MASTER = [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988257402,W=88988257735,C=88988257735,E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988257402,W=88988257735,C=88988257735,E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}).
[PID:05828:013 2016.03.22 09:07:29.539 DEBUG ElectionsService ] ELECTIONS: (V=446) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:29.539 DEBUG ElectionsService ] ELECTIONS: (V=446) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:29.539 DEBUG ElectionsService ] ELECTIONS: (V=446) PROPOSAL FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988257402,W=88988257735,C=88988257735,E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988257402,W=88988257735,C=88988257735,E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f}).
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) SHIFT TO REG_NONLEADER.
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) PREPARE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:07:29.508 DEBUG ElectionsService ] ELECTIONS: (V=446) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:036 2016.03.22 09:07:29.493 INFO TcpService ] Internal TCP connection accepted: [Secure, 10.10.13.103:60214, L10.10.13.102:2116, {fce312c9-3310-428f-937e-df612d2a7d30}].
[PID:05828:013 2016.03.22 09:07:29.446 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.101:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988206789/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.210
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988252940/88988254086/88988254086/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:28.786
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988246890/88988247838/88988247838/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:27.772
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988206789/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.210
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988257402/88988257735/88988257735/E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f} | 2016-03-22 09:07:29.446
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988257402/88988257735/88988257735/E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f} | 2016-03-22 09:07:29.461
--------------------------------------------------------------------------------
[PID:05828:010 2016.03.22 09:07:29.176 DEBUG EpochManager ] === Update Last Epoch E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f} (previous epoch at 88875969263).
[PID:05828:010 2016.03.22 09:07:29.176 DEBUG EpochManager ] === Writing E254@88988254606:{e9da09d3-758a-4f3d-b7c6-df848055703f} (previous epoch at 88875969263).
[PID:05828:013 2016.03.22 09:07:29.161 INFO ElectionsService ] ELECTIONS: (V=445) DONE. ELECTED MASTER = [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}). ME=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}).
[PID:05828:013 2016.03.22 09:07:29.161 DEBUG ElectionsService ] ELECTIONS: (V=445) ACCEPT FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:29.161 DEBUG ElectionsService ] ELECTIONS: (V=445) ACCEPT FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}] M=[10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}]).
[PID:05828:013 2016.03.22 09:07:29.161 DEBUG ElectionsService ] ELECTIONS: (V=445) SENDING PROPOSAL CANDIDATE: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}), ME: [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}).
[PID:05828:013 2016.03.22 09:07:29.161 DEBUG ElectionsService ] ELECTIONS: (V=445) SHIFT TO REG_LEADER.
[PID:05828:013 2016.03.22 09:07:29.161 DEBUG ElectionsService ] ELECTIONS: (V=445) PREPARE_OK FROM [10.10.13.101:2113,{c532c941-4817-4064-92f4-92ddcdde98fe}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}).
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) PREPARE_OK FROM [10.10.13.102:2113,{a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}](L=88988252940,W=88988254606,C=88988254606,E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77}).
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) SHIFT TO PREPARE PHASE.
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) MAJORITY OF VIEWCHANGE.
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) VIEWCHANGE FROM [10.10.13.102:2113, {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f}].
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) SHIFT TO LEADER ELECTION.
[PID:05828:013 2016.03.22 09:07:29.145 DEBUG ElectionsService ] ELECTIONS: (V=445) VIEWCHANGE FROM [10.10.13.101:2113, {c532c941-4817-4064-92f4-92ddcdde98fe}].
[PID:05828:030 2016.03.22 09:07:25.880 INFO TcpConnectionSsl ] [S147.42.0.50:65367, L147.42.14.101:2115]:
Cipher: Aes128 strength 128
Hash: Sha1 strength 160
Key exchange: RsaKeyX strength 2048
Protocol: Tls
Is authenticated: True as server? True
IsSigned: True
Is Encrypted: True
Can read: True, write True
Can timeout: True
Certificate revocation list checked: True
Local certificate was issued to CN=eventstore-prod.company.local and is valid from 12/01/2016 00:40:17 until 12/01/2018 00:50:17.
Remote certificate is null.
[PID:05828:036 2016.03.22 09:07:25.677 INFO TcpService ] External TCP connection accepted: [Secure, 147.42.0.50:65367, L147.42.14.101:2115, {3ee8a21e-4459-4ef4-aa3e-9536d62dd9d5}].
[PID:05828:013 2016.03.22 09:07:24.129 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip received from [10.10.13.103:2113])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988205957/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.094
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988237848/88988239008/88988239008/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.739
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988237848/88988239008/88988239008/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.751
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988206789/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.210
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988237848/88988239528/88988239528/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:24.129
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988237848/88988239008/88988239008/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.751
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:23.094 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (TCP connection lost to [10.10.13.103:2111])
Old:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <LIVE> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988205957/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:16.440
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:22.735
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:22.733
New:
VND {625acf3f-d4cb-474f-b8f4-e3f1f71ccdac} <DEAD> [Slave, 10.10.13.103:2111, 10.10.13.103:2116, 147.42.14.102:2112, 147.42.14.102:2115, 10.10.13.103:2113, 147.42.14.102:2114] 88988204701/88988206789/88988205957/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:23.094
VND {a4c1bdc0-2643-4512-b4b9-3a3d5c08cc4f} <LIVE> [Master, 10.10.13.102:2111, 10.10.13.102:2116, 147.42.14.101:2112, 147.42.14.101:2115, 10.10.13.102:2113, 147.42.14.101:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:22.735
VND {c532c941-4817-4064-92f4-92ddcdde98fe} <LIVE> [Slave, 10.10.13.101:2111, 10.10.13.101:2116, 147.42.14.100:2112, 147.42.14.100:2115, 10.10.13.101:2113, 147.42.14.100:2114] 88988217983/88988222041/88988222041/E253@88875969263:{49ea5944-d050-4696-9f58-3e2323b9ae77} | 2016-03-22 09:07:22.733
--------------------------------------------------------------------------------
[PID:05828:013 2016.03.22 09:07:23.094 TRACE GossipServiceBase ] Looks like node [10.10.13.103:2111] is DEAD (TCP connection lost).
[PID:05828:011 2016.03.22 09:07:23.079 INFO TcpConnectionManager] Connection 'internal-secure' [10.10.13.103:55996, {07fafe25-7b4e-4649-acf5-531d14280cb0}] closed: Success.
[PID:05828:011 2016.03.22 09:07:23.079 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:23.079: S10.10.13.103:55996, L10.10.13.102:2116, {07fafe25-7b4e-4649-acf5-531d14280cb0}]:
Received bytes: 12767478, Sent bytes: 129753606
Send calls: 231192, callbacks: 231192
Receive calls: 260686, callbacks: 260685
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 256291
[PID:05828:011 2016.03.22 09:07:23.079 TRACE TcpConnectionManager] Closing connection 'internal-secure' [10.10.13.103:55996, L10.10.13.102:2116, {07fafe25-7b4e-4649-acf5-531d14280cb0}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 256291
[PID:05828:036 2016.03.22 09:07:19.374 INFO TcpConnectionSsl ] [S78.136.44.23:64429, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:07:19.374 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:64429, {9a94201f-7ff2-4b94-8cf9-f57d7f2959bf}] closed: SocketError.
[PID:05828:036 2016.03.22 09:07:19.374 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:19.374: S78.136.44.23:64429, L147.42.14.101:2115, {9a94201f-7ff2-4b94-8cf9-f57d7f2959bf}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:07:19.374 INFO TcpConnectionSsl ] [S78.136.44.23:64429, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:07:19.359 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:64429, L147.42.14.101:2115, {9a94201f-7ff2-4b94-8cf9-f57d7f2959bf}].
[PID:05828:036 2016.03.22 09:07:13.149 INFO TcpConnectionSsl ] [S50.57.61.7:47335, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:07:13.149 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:47335, {191f599d-7d21-4391-b90a-9f5cccfe2152}] closed: SocketError.
[PID:05828:036 2016.03.22 09:07:13.149 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:07:13.157: S50.57.61.7:47335, L147.42.14.101:2115, {191f599d-7d21-4391-b90a-9f5cccfe2152}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:07:13.149 INFO TcpConnectionSsl ] [S50.57.61.7:47335, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:07:13.149 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:47335, L147.42.14.101:2115, {191f599d-7d21-4391-b90a-9f5cccfe2152}].
[PID:05828:036 2016.03.22 09:06:38.452 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:50860, {c85ac8bd-69e6-4792-8a83-713d944d863b}] closed: SocketError.
[PID:05828:036 2016.03.22 09:06:38.452 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:06:38.452: S50.56.142.170:50860, L147.42.14.101:2115, {c85ac8bd-69e6-4792-8a83-713d944d863b}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:06:38.452 INFO TcpConnectionSsl ] [S50.56.142.170:50860, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:38.452 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:50860, L147.42.14.101:2115, {c85ac8bd-69e6-4792-8a83-713d944d863b}].
[PID:05828:036 2016.03.22 09:06:38.452 INFO TcpConnectionSsl ] [S50.56.142.170:50860, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:19.378 INFO TcpConnectionSsl ] [S78.136.44.23:57539, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:19.378 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:57539, {690c11b2-68df-45d9-aa11-452811e22a99}] closed: SocketError.
[PID:05828:036 2016.03.22 09:06:19.378 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:06:19.378: S78.136.44.23:57539, L147.42.14.101:2115, {690c11b2-68df-45d9-aa11-452811e22a99}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:06:19.378 INFO TcpConnectionSsl ] [S78.136.44.23:57539, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:19.378 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:57539, L147.42.14.101:2115, {690c11b2-68df-45d9-aa11-452811e22a99}].
[PID:05828:036 2016.03.22 09:06:13.187 INFO TcpConnectionSsl ] [S50.57.61.7:56253, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:13.187 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:56253, {44c5dff5-dbfd-4022-bcdd-d6584377ce48}] closed: SocketError.
[PID:05828:036 2016.03.22 09:06:13.187 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:06:13.187: S50.57.61.7:56253, L147.42.14.101:2115, {44c5dff5-dbfd-4022-bcdd-d6584377ce48}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:06:13.187 INFO TcpConnectionSsl ] [S50.57.61.7:56253, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:06:13.187 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:56253, L147.42.14.101:2115, {44c5dff5-dbfd-4022-bcdd-d6584377ce48}].
[PID:05828:036 2016.03.22 09:05:38.441 INFO TcpConnectionSsl ] [S50.56.142.170:56943, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:38.441 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:56943, {9c29aacd-bf94-449d-ad03-4e692d831c10}] closed: SocketError.
[PID:05828:036 2016.03.22 09:05:38.441 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:05:38.441: S50.56.142.170:56943, L147.42.14.101:2115, {9c29aacd-bf94-449d-ad03-4e692d831c10}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:05:38.441 INFO TcpConnectionSsl ] [S50.56.142.170:56943, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:38.441 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:56943, L147.42.14.101:2115, {9c29aacd-bf94-449d-ad03-4e692d831c10}].
[PID:05828:036 2016.03.22 09:05:19.377 INFO TcpConnectionSsl ] [S78.136.44.23:50620, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:19.377 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:50620, {d702ed27-37a7-4f26-a9ea-44baafe2a654}] closed: SocketError.
[PID:05828:036 2016.03.22 09:05:19.377 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:05:19.377: S78.136.44.23:50620, L147.42.14.101:2115, {d702ed27-37a7-4f26-a9ea-44baafe2a654}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:05:19.377 INFO TcpConnectionSsl ] [S78.136.44.23:50620, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:19.377 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:50620, L147.42.14.101:2115, {d702ed27-37a7-4f26-a9ea-44baafe2a654}].
[PID:05828:036 2016.03.22 09:05:13.183 INFO TcpConnectionSsl ] [S50.57.61.7:65258, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:13.183 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:65258, {fdac3571-f816-468f-94d0-a4cafa93405d}] closed: SocketError.
[PID:05828:036 2016.03.22 09:05:13.183 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:05:13.183: S50.57.61.7:65258, L147.42.14.101:2115, {fdac3571-f816-468f-94d0-a4cafa93405d}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:05:13.183 INFO TcpConnectionSsl ] [S50.57.61.7:65258, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:05:13.183 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:65258, L147.42.14.101:2115, {fdac3571-f816-468f-94d0-a4cafa93405d}].
[PID:05828:035 2016.03.22 09:04:51.168 TRACE QueuedHandlerThreadP] SLOW QUEUE MSG [StorageReaderQueue #2]: ReadStreamEventsForward - 564ms. Q: 0/6.
[PID:05828:036 2016.03.22 09:04:38.436 INFO TcpConnectionSsl ] [S50.56.142.170:62961, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:04:38.436 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:62961, {89d5468b-0768-4f92-8fcf-eb63530c5ce6}] closed: SocketError.
[PID:05828:036 2016.03.22 09:04:38.436 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:04:38.436: S50.56.142.170:62961, L147.42.14.101:2115, {89d5468b-0768-4f92-8fcf-eb63530c5ce6}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:04:38.436 INFO TcpConnectionSsl ] [S50.56.142.170:62961, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:04:38.436 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:62961, L147.42.14.101:2115, {89d5468b-0768-4f92-8fcf-eb63530c5ce6}].
[PID:05828:036 2016.03.22 09:04:19.376 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:64253, {ace00225-c217-4a49-92e8-a830dcb0edec}] closed: SocketError.
[PID:05828:036 2016.03.22 09:04:19.376 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:04:19.376: S78.136.44.23:64253, L147.42.14.101:2115, {ace00225-c217-4a49-92e8-a830dcb0edec}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:04:19.376 INFO TcpConnectionSsl ] [S78.136.44.23:64253, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:04:19.376 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:64253, L147.42.14.101:2115, {ace00225-c217-4a49-92e8-a830dcb0edec}].
[PID:05828:036 2016.03.22 09:04:19.376 INFO TcpConnectionSsl ] [S78.136.44.23:64253, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:006 2016.03.22 09:04:13.200 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:53580, {e4fd75fd-c0a3-4442-9cb4-9076285bf4c8}] closed: SocketError.
[PID:05828:006 2016.03.22 09:04:13.200 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:04:13.200: S50.57.61.7:53580, L147.42.14.101:2115, {e4fd75fd-c0a3-4442-9cb4-9076285bf4c8}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:006 2016.03.22 09:04:13.200 INFO TcpConnectionSsl ] [S50.57.61.7:53580, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:04:13.200 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:53580, L147.42.14.101:2115, {e4fd75fd-c0a3-4442-9cb4-9076285bf4c8}].
[PID:05828:006 2016.03.22 09:04:13.200 INFO TcpConnectionSsl ] [S50.57.61.7:53580, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:38.453 INFO TcpConnectionSsl ] [S50.56.142.170:48523, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:38.453 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:48523, {7e00e8f2-1c98-4283-84a1-d4e9c98fa444}] closed: SocketError.
[PID:05828:036 2016.03.22 09:03:38.453 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:03:38.453: S50.56.142.170:48523, L147.42.14.101:2115, {7e00e8f2-1c98-4283-84a1-d4e9c98fa444}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:03:38.453 INFO TcpConnectionSsl ] [S50.56.142.170:48523, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:38.453 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:48523, L147.42.14.101:2115, {7e00e8f2-1c98-4283-84a1-d4e9c98fa444}].
[PID:05828:036 2016.03.22 09:03:19.376 INFO TcpConnectionSsl ] [S78.136.44.23:57385, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:19.376 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:57385, {1ddcf029-aff0-4b21-9710-ea95e501017e}] closed: SocketError.
[PID:05828:036 2016.03.22 09:03:19.376 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:03:19.376: S78.136.44.23:57385, L147.42.14.101:2115, {1ddcf029-aff0-4b21-9710-ea95e501017e}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:03:19.376 INFO TcpConnectionSsl ] [S78.136.44.23:57385, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:19.376 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:57385, L147.42.14.101:2115, {1ddcf029-aff0-4b21-9710-ea95e501017e}].
[PID:05828:036 2016.03.22 09:03:13.178 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:62576, {c1caf425-b000-4ebc-aa78-2d0816a2a407}] closed: SocketError.
[PID:05828:036 2016.03.22 09:03:13.178 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:03:13.178: S50.57.61.7:62576, L147.42.14.101:2115, {c1caf425-b000-4ebc-aa78-2d0816a2a407}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:03:13.178 INFO TcpConnectionSsl ] [S50.57.61.7:62576, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:03:13.178 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:62576, L147.42.14.101:2115, {c1caf425-b000-4ebc-aa78-2d0816a2a407}].
[PID:05828:036 2016.03.22 09:03:13.178 INFO TcpConnectionSsl ] [S50.57.61.7:62576, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:38.445 INFO TcpConnectionSsl ] [S50.56.142.170:54549, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:38.445 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:54549, {19221287-13ea-4e35-8899-81eabc625216}] closed: SocketError.
[PID:05828:036 2016.03.22 09:02:38.445 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:02:38.445: S50.56.142.170:54549, L147.42.14.101:2115, {19221287-13ea-4e35-8899-81eabc625216}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:02:38.445 INFO TcpConnectionSsl ] [S50.56.142.170:54549, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:38.445 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:54549, L147.42.14.101:2115, {19221287-13ea-4e35-8899-81eabc625216}].
[PID:05828:036 2016.03.22 09:02:19.366 INFO TcpConnectionSsl ] [S78.136.44.23:50486, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:19.366 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:50486, {15fa314f-a6d2-416b-9a0d-3be9ab646377}] closed: SocketError.
[PID:05828:036 2016.03.22 09:02:19.366 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:02:19.366: S78.136.44.23:50486, L147.42.14.101:2115, {15fa314f-a6d2-416b-9a0d-3be9ab646377}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:02:19.366 INFO TcpConnectionSsl ] [S78.136.44.23:50486, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:19.366 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:50486, L147.42.14.101:2115, {15fa314f-a6d2-416b-9a0d-3be9ab646377}].
[PID:05828:036 2016.03.22 09:02:13.172 INFO TcpConnectionSsl ] [S50.57.61.7:51107, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:13.172 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:51107, {e28781f4-55f8-4778-882f-1c92705d8e14}] closed: SocketError.
[PID:05828:036 2016.03.22 09:02:13.172 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:02:13.172: S50.57.61.7:51107, L147.42.14.101:2115, {e28781f4-55f8-4778-882f-1c92705d8e14}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:02:13.172 INFO TcpConnectionSsl ] [S50.57.61.7:51107, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:02:13.172 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:51107, L147.42.14.101:2115, {e28781f4-55f8-4778-882f-1c92705d8e14}].
[PID:05828:007 2016.03.22 09:01:38.441 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:60681, {31be1726-e3c4-4367-a444-a838bb822b7e}] closed: SocketError.
[PID:05828:007 2016.03.22 09:01:38.441 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:01:38.441: S50.56.142.170:60681, L147.42.14.101:2115, {31be1726-e3c4-4367-a444-a838bb822b7e}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:007 2016.03.22 09:01:38.441 INFO TcpConnectionSsl ] [S50.56.142.170:60681, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:38.441 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:60681, L147.42.14.101:2115, {31be1726-e3c4-4367-a444-a838bb822b7e}].
[PID:05828:007 2016.03.22 09:01:38.441 INFO TcpConnectionSsl ] [S50.56.142.170:60681, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:19.380 INFO TcpConnectionSsl ] [S78.136.44.23:64159, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:19.380 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:64159, {213e601d-33c2-4946-99f8-7485ba5ff7da}] closed: SocketError.
[PID:05828:036 2016.03.22 09:01:19.380 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:01:19.380: S78.136.44.23:64159, L147.42.14.101:2115, {213e601d-33c2-4946-99f8-7485ba5ff7da}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:01:19.380 INFO TcpConnectionSsl ] [S78.136.44.23:64159, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:19.380 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:64159, L147.42.14.101:2115, {213e601d-33c2-4946-99f8-7485ba5ff7da}].
[PID:05828:036 2016.03.22 09:01:13.188 INFO TcpConnectionSsl ] [S50.57.61.7:59962, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:13.188 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:59962, {a7f4fd67-e726-4358-b776-fc042dfe65f5}] closed: SocketError.
[PID:05828:036 2016.03.22 09:01:13.188 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:01:13.188: S50.57.61.7:59962, L147.42.14.101:2115, {a7f4fd67-e726-4358-b776-fc042dfe65f5}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:01:13.188 INFO TcpConnectionSsl ] [S50.57.61.7:59962, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:01:13.188 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:59962, L147.42.14.101:2115, {a7f4fd67-e726-4358-b776-fc042dfe65f5}].
[PID:05828:029 2016.03.22 09:00:38.472 INFO TcpConnectionSsl ] [S50.56.142.170:46159, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:029 2016.03.22 09:00:38.472 INFO TcpConnectionManager] Connection 'external-secure' [50.56.142.170:46159, {d7908fce-f80d-4244-bc7d-49c4b76f8a38}] closed: SocketError.
[PID:05828:029 2016.03.22 09:00:38.472 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:00:38.472: S50.56.142.170:46159, L147.42.14.101:2115, {d7908fce-f80d-4244-bc7d-49c4b76f8a38}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:029 2016.03.22 09:00:38.472 INFO TcpConnectionSsl ] [S50.56.142.170:46159, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:00:38.472 INFO TcpService ] External TCP connection accepted: [Secure, 50.56.142.170:46159, L147.42.14.101:2115, {d7908fce-f80d-4244-bc7d-49c4b76f8a38}].
[PID:05828:015 2016.03.22 09:00:37.330 TRACE CoreProjectionCheckp] Writing checkpoint for $ce-workrecord at $ce-immigrationworkrecord: 189064; $ce-taxworkrecord: 7401043; $ce-socialsecurityworkrecord: 51452; $ce-briefingworkrecord: 431925; with expected version number 2014
[PID:05828:036 2016.03.22 09:00:19.378 INFO TcpConnectionSsl ] [S78.136.44.23:57204, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:00:19.378 INFO TcpConnectionManager] Connection 'external-secure' [78.136.44.23:57204, {4898a6cf-e31d-4070-8f34-30d9455fad1b}] closed: SocketError.
[PID:05828:036 2016.03.22 09:00:19.378 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:00:19.378: S78.136.44.23:57204, L147.42.14.101:2115, {4898a6cf-e31d-4070-8f34-30d9455fad1b}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:00:19.378 INFO TcpConnectionSsl ] [S78.136.44.23:57204, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:00:19.378 INFO TcpService ] External TCP connection accepted: [Secure, 78.136.44.23:57204, L147.42.14.101:2115, {4898a6cf-e31d-4070-8f34-30d9455fad1b}].
[PID:05828:036 2016.03.22 09:00:13.184 INFO TcpConnectionSsl ] [S50.57.61.7:48403, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:00:13.184 INFO TcpConnectionManager] Connection 'external-secure' [50.57.61.7:48403, {d7aab377-4c30-49e7-b78e-ba0e02a7fa5f}] closed: SocketError.
[PID:05828:036 2016.03.22 09:00:13.184 INFO TcpConnectionSsl ] ES TcpConnectionSsl closed [09:00:13.184: S50.57.61.7:48403, L147.42.14.101:2115, {d7aab377-4c30-49e7-b78e-ba0e02a7fa5f}]:
Received bytes: 0, Sent bytes: 0
Send calls: 0, callbacks: 0
Receive calls: 0, callbacks: 0
Close reason: [SocketError] Authentication failed because the remote party has closed the transport stream.
[PID:05828:036 2016.03.22 09:00:13.184 INFO TcpConnectionSsl ] [S50.57.61.7:48403, L147.42.14.101:2115]: Exception on EndAuthenticateAsServer.
System.IO.IOException: Authentication failed because the remote party has closed the transport stream.
at System.Net.Security.SslState.EndProcessAuthentication(IAsyncResult result)
at EventStore.Transport.Tcp.TcpConnectionSsl.OnEndAuthenticateAsServer(IAsyncResult ar) in c:\EventStore\src\EventStore.Transport.Tcp\TcpConnectionSsl.cs:line 154
[PID:05828:036 2016.03.22 09:00:13.184 INFO TcpService ] External TCP connection accepted: [Secure, 50.57.61.7:48403, L147.42.14.101:2115, {d7aab377-4c30-49e7-b78e-ba0e02a7fa5f}].
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment