Skip to content

Instantly share code, notes, and snippets.

@trbngr

trbngr/10.75.132.66-2113-cluster-node.log Secret

Created February 18, 2015 19:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save trbngr/4cc634aaab914f85b2d0 to your computer and use it in GitHub Desktop.
Save trbngr/4cc634aaab914f85b2d0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
10.75.132.66-2113-cluster-node.log
[PID:07864:001 2015.02.18 18:54:30.153 INFO ProgramBase`1 ]
ES VERSION: 3.0.1.0 (release-oss-v3.0.1/7fa876c111888dd5980dbd86d126e6abe13b05ab, Thu, 23 Oct 2014 22:27:04 +0100)
OS: Unknown (Unix 3.16.0.29)
RUNTIME: 3.8.0 ((detached/45d0ba1) (64-bit)
GC: 2 GENERATIONS
LOGS: /var/log/eventstore
HELP: False (<DEFAULT>)
VERSION: False (<DEFAULT>)
LOG: /var/log/eventstore (Config File)
CONFIG: /var/lib/eventstore/eventstore.config (Command Line)
DEFINES: <empty> (<DEFAULT>)
WHAT IF: False (<DEFAULT>)
INT IP: 10.75.132.66 (Config File)
EXT IP: 10.75.132.66 (Config File)
INT HTTP PORT: 2112 (<DEFAULT>)
EXT HTTP PORT: 2113 (<DEFAULT>)
INT TCP PORT: 1112 (<DEFAULT>)
INT SECURE TCP PORT: 0 (<DEFAULT>)
EXT TCP PORT: 1113 (<DEFAULT>)
EXT SECURE TCP PORT: 0 (<DEFAULT>)
INT TCP HEARTBEAT TIMEOUT: 700 (<DEFAULT>)
EXT TCP HEARTBEAT TIMEOUT: 1000 (<DEFAULT>)
INT TCP HEARTBEAT INTERVAL: 700 (<DEFAULT>)
EXT TCP HEARTBEAT INTERVAL: 2000 (<DEFAULT>)
FORCE: False (<DEFAULT>)
CLUSTER SIZE: 3 (Config File)
NODE PRIORITY: 0 (<DEFAULT>)
MIN FLUSH DELAY MS: 2 (<DEFAULT>)
COMMIT COUNT: -1 (<DEFAULT>)
PREPARE COUNT: -1 (<DEFAULT>)
ADMIN ON EXT: True (<DEFAULT>)
STATS ON EXT: True (<DEFAULT>)
GOSSIP ON EXT: True (<DEFAULT>)
DISABLE SCAVENGE MERGING: False (<DEFAULT>)
DISCOVER VIA DNS: true (Config File)
CLUSTER DNS: eventstore-ncus.eventday.com (Config File)
CLUSTER GOSSIP PORT: 2113 (Config File)
GOSSIP SEED: <empty> (<DEFAULT>)
STATS PERIOD SEC: 30 (<DEFAULT>)
CACHED CHUNKS: -1 (<DEFAULT>)
CHUNKS CACHE SIZE: 536871424 (<DEFAULT>)
MAX MEM TABLE SIZE: 1000000 (<DEFAULT>)
DB: /var/lib/eventstore/db (Config File)
MEM DB: False (<DEFAULT>)
SKIP DB VERIFY: False (<DEFAULT>)
RUN PROJECTIONS: All (Config File)
PROJECTION THREADS: 3 (<DEFAULT>)
WORKER THREADS: 5 (<DEFAULT>)
HTTP PREFIXES: [ http://*:2113/ ] (Config File)
ENABLE TRUSTED AUTH: False (<DEFAULT>)
CERTIFICATE STORE LOCATION: <empty> (<DEFAULT>)
CERTIFICATE STORE NAME: <empty> (<DEFAULT>)
CERTIFICATE SUBJECT NAME: <empty> (<DEFAULT>)
CERTIFICATE THUMBPRINT: <empty> (<DEFAULT>)
CERTIFICATE FILE: <empty> (<DEFAULT>)
CERTIFICATE PASSWORD: <empty> (<DEFAULT>)
USE INTERNAL SSL: False (<DEFAULT>)
SSL TARGET HOST: n/a (<DEFAULT>)
SSL VALIDATE SERVER: True (<DEFAULT>)
AUTHENTICATION TYPE: internal (<DEFAULT>)
PREPARE TIMEOUT MS: 2000 (<DEFAULT>)
COMMIT TIMEOUT MS: 2000 (<DEFAULT>)
UNSAFE DISABLE FLUSH TO DISK: False (<DEFAULT>)
GOSSIP INTERVAL MS: 1000 (<DEFAULT>)
GOSSIP ALLOWED DIFFERENCE MS: 60000 (<DEFAULT>)
GOSSIP TIMEOUT MS: 500 (<DEFAULT>)
[PID:07864:001 2015.02.18 18:54:30.189 INFO ProgramBase`1 ] Quorum size set to 2
[PID:07864:001 2015.02.18 18:54:30.194 INFO ProgramBase`1 ] Can't find plugins path: plugins
[PID:07864:001 2015.02.18 18:54:30.233 INFO ProgramBase`1 ]
INSTANCE ID: f51127cd-6578-414d-a07f-ad1012d43aa3
DATABASE: /var/lib/eventstore/db
WRITER CHECKPOINT: 0 (0x0)
CHASER CHECKPOINT: 0 (0x0)
EPOCH CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
TRUNCATE CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
[PID:07864:001 2015.02.18 18:54:30.432 TRACE MessageHierarchy ] MessageHierarchy initialization took 00:00:00.1530865.
[PID:07864:001 2015.02.18 18:54:30.531 TRACE TFChunk ] CACHED TFChunk #0-0 (chunk-000000.000000) in 00:00:00.0023705.
[PID:07864:001 2015.02.18 18:54:30.689 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/projections
[PID:07864:001 2015.02.18 18:54:30.690 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/v8/Prelude ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Prelude
[PID:07864:001 2015.02.18 18:54:30.690 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/resources ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/web-resources/js
[PID:07864:001 2015.02.18 18:54:30.691 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.691 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.692 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.694 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.694 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.694 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.707 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07864:001 2015.02.18 18:54:30.707 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.708 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07864:001 2015.02.18 18:54:30.708 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.708 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07864:001 2015.02.18 18:54:30.709 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07864:001 2015.02.18 18:54:30.709 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07864:001 2015.02.18 18:54:30.709 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07864:010 2015.02.18 18:54:30.740 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] SYSTEM INIT...
[PID:07864:010 2015.02.18 18:54:30.772 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.132.66:1113.
[PID:07864:010 2015.02.18 18:54:30.775 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.132.66:1112.
[PID:07864:015 2015.02.18 18:54:30.804 INFO IndexCommitter ] TableIndex initialization...
[PID:07864:015 2015.02.18 18:54:30.812 INFO IndexCommitter ] ReadIndex building...
[PID:07864:015 2015.02.18 18:54:30.814 DEBUG IndexCommitter ] ReadIndex rebuilding done: total processed 0 records, time elapsed: 00:00:00.0009540.
[PID:07864:010 2015.02.18 18:54:30.834 INFO HttpAsyncServer ] Starting HTTP server on [http://*:2113/]...
[PID:07864:010 2015.02.18 18:54:30.838 INFO HttpAsyncServer ] HTTP server is up and listening on [http://*:2113/]
[PID:07864:010 2015.02.18 18:54:30.861 TRACE InMemoryBus ] SLOW BUS MSG [MainBus]: SystemInit - 62ms. Handler: HttpService.
[PID:07864:010 2015.02.18 18:54:30.861 INFO HttpAsyncServer ] Starting HTTP server on [http://10.75.132.66:2112/]...
[PID:07864:010 2015.02.18 18:54:30.862 INFO HttpAsyncServer ] HTTP server is up and listening on [http://10.75.132.66:2112/]
[PID:07864:010 2015.02.18 18:54:30.889 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: SystemInit - 154ms. Q: 0/7.
[PID:07864:010 2015.02.18 18:54:30.891 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] Service 'StorageWriter' initialized.
[PID:07864:010 2015.02.18 18:54:30.891 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] Service 'StorageReader' initialized.
[PID:07864:010 2015.02.18 18:54:30.892 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] Service 'StorageChaser' initialized.
[PID:07864:010 2015.02.18 18:54:30.925 TRACE GossipServiceBase ] CLUSTER HAS CHANGED
Old:
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:30.862
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:30.862
--------------------------------------------------------------------------------
[PID:07864:010 2015.02.18 18:54:30.929 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] SYSTEM START...
[PID:07864:010 2015.02.18 18:54:30.933 INFO ClusterVNodeControll] ========== [10.75.132.66:2112] IS UNKNOWN!!! WHOA!!!
[PID:07864:010 2015.02.18 18:54:30.973 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS.
[PID:07864:010 2015.02.18 18:54:30.974 DEBUG ElectionsService ] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:30.975 DEBUG ElectionsService ] ELECTIONS: (V=0) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:010 2015.02.18 18:54:31.626 TRACE GossipServiceBase ] Looks like node [65.52.18.4:2113] is DEAD (Gossip send failed).
[PID:07864:010 2015.02.18 18:54:31.627 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.4:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:31.567
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:31.626
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:31.567
--------------------------------------------------------------------------------
[PID:07864:010 2015.02.18 18:54:31.980 DEBUG ElectionsService ] ELECTIONS: (V=0) TIMED OUT! (S=ElectingLeader, M=).
[PID:07864:010 2015.02.18 18:54:31.980 DEBUG ElectionsService ] ELECTIONS: (V=1) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:31.980 DEBUG ElectionsService ] ELECTIONS: (V=1) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:010 2015.02.18 18:54:32.212 TRACE GossipServiceBase ] Looks like node [65.52.18.0:2113] is DEAD (Gossip send failed).
[PID:07864:010 2015.02.18 18:54:32.212 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.0:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:31.626
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:30.894
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:32.203
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:31.626
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:32.212
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:32.203
--------------------------------------------------------------------------------
[PID:07864:010 2015.02.18 18:54:32.716 TRACE GossipServiceBase ] Looks like node [65.52.17.181:2113] is DEAD (Gossip send failed).
[PID:07864:010 2015.02.18 18:54:32.716 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.17.181:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:31.626
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:32.212
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:30.894
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:32.620
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:54:31.626
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:54:32.212
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:54:32.716
VND {f51127cd-6578-414d-a07f-ad1012d43aa3} <LIVE> [Unknown, 10.75.132.66:1112, n/a, 10.75.132.66:1113, n/a, 10.75.132.66:2112, 10.75.132.66:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:54:32.620
--------------------------------------------------------------------------------
[PID:07864:010 2015.02.18 18:54:32.984 DEBUG ElectionsService ] ELECTIONS: (V=1) TIMED OUT! (S=ElectingLeader, M=).
[PID:07864:010 2015.02.18 18:54:32.984 DEBUG ElectionsService ] ELECTIONS: (V=2) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:32.984 DEBUG ElectionsService ] ELECTIONS: (V=2) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:022 2015.02.18 18:54:33.299 INFO TcpService ] External TCP connection accepted: [Normal, 10.75.132.10:50268, L10.75.132.66:1113, {5311fc49-b05c-4117-b8e4-c289c7e77732}].
[PID:07864:021 2015.02.18 18:54:33.299 INFO TcpService ] Internal TCP connection accepted: [Normal, 10.75.132.10:50269, L10.75.132.66:1112, {634258c1-bb6b-45cb-89e6-26776ef77fdc}].
[PID:07864:010 2015.02.18 18:54:33.995 DEBUG ElectionsService ] ELECTIONS: (V=2) TIMED OUT! (S=ElectingLeader, M=).
[PID:07864:010 2015.02.18 18:54:33.996 DEBUG ElectionsService ] ELECTIONS: (V=3) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:33.996 DEBUG ElectionsService ] ELECTIONS: (V=3) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:010 2015.02.18 18:54:35.008 DEBUG ElectionsService ] ELECTIONS: (V=3) TIMED OUT! (S=ElectingLeader, M=).
[PID:07864:010 2015.02.18 18:54:35.008 DEBUG ElectionsService ] ELECTIONS: (V=4) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:35.008 DEBUG ElectionsService ] ELECTIONS: (V=4) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:010 2015.02.18 18:54:36.019 DEBUG ElectionsService ] ELECTIONS: (V=4) TIMED OUT! (S=ElectingLeader, M=).
[PID:07864:010 2015.02.18 18:54:36.020 DEBUG ElectionsService ] ELECTIONS: (V=5) SHIFT TO LEADER ELECTION.
[PID:07864:010 2015.02.18 18:54:36.020 DEBUG ElectionsService ] ELECTIONS: (V=5) VIEWCHANGE FROM [10.75.132.66:2112, {f51127cd-6578-414d-a07f-ad1012d43aa3}].
[PID:07864:008 2015.02.18 18:54:36.370 TRACE TcpConnectionManager] Closing connection 'internal-normal' [10.75.132.10:50269, L10.75.132.66:1112, {634258c1-bb6b-45cb-89e6-26776ef77fdc}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 0
[PID:07864:008 2015.02.18 18:54:36.408 INFO TcpConnection ] ES TcpConnection closed [18:54:36.375: N10.75.132.10:50269, L10.75.132.66:1112, {634258c1-bb6b-45cb-89e6-26776ef77fdc}]:
Received bytes: 0, Sent bytes: 22
Send calls: 1, callbacks: 1
Receive calls: 1, callbacks: 0
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 0
Raw
10.75.176.46-2113-cluster-node.log
[PID:07955:001 2015.02.18 18:53:00.139 INFO ProgramBase`1 ]
ES VERSION: 3.0.1.0 (release-oss-v3.0.1/7fa876c111888dd5980dbd86d126e6abe13b05ab, Thu, 23 Oct 2014 22:27:04 +0100)
OS: Unknown (Unix 3.16.0.29)
RUNTIME: 3.8.0 ((detached/45d0ba1) (64-bit)
GC: 2 GENERATIONS
LOGS: /var/log/eventstore
HELP: False (<DEFAULT>)
VERSION: False (<DEFAULT>)
LOG: /var/log/eventstore (Config File)
CONFIG: /var/lib/eventstore/eventstore.config (Command Line)
DEFINES: <empty> (<DEFAULT>)
WHAT IF: False (<DEFAULT>)
INT IP: 10.75.176.46 (Config File)
EXT IP: 10.75.176.46 (Config File)
INT HTTP PORT: 2112 (<DEFAULT>)
EXT HTTP PORT: 2113 (<DEFAULT>)
INT TCP PORT: 1112 (<DEFAULT>)
INT SECURE TCP PORT: 0 (<DEFAULT>)
EXT TCP PORT: 1113 (<DEFAULT>)
EXT SECURE TCP PORT: 0 (<DEFAULT>)
INT TCP HEARTBEAT TIMEOUT: 700 (<DEFAULT>)
EXT TCP HEARTBEAT TIMEOUT: 1000 (<DEFAULT>)
INT TCP HEARTBEAT INTERVAL: 700 (<DEFAULT>)
EXT TCP HEARTBEAT INTERVAL: 2000 (<DEFAULT>)
FORCE: False (<DEFAULT>)
CLUSTER SIZE: 3 (Config File)
NODE PRIORITY: 0 (<DEFAULT>)
MIN FLUSH DELAY MS: 2 (<DEFAULT>)
COMMIT COUNT: -1 (<DEFAULT>)
PREPARE COUNT: -1 (<DEFAULT>)
ADMIN ON EXT: True (<DEFAULT>)
STATS ON EXT: True (<DEFAULT>)
GOSSIP ON EXT: True (<DEFAULT>)
DISABLE SCAVENGE MERGING: False (<DEFAULT>)
DISCOVER VIA DNS: true (Config File)
CLUSTER DNS: eventstore-ncus.eventday.com (Config File)
CLUSTER GOSSIP PORT: 2113 (Config File)
GOSSIP SEED: <empty> (<DEFAULT>)
STATS PERIOD SEC: 30 (<DEFAULT>)
CACHED CHUNKS: -1 (<DEFAULT>)
CHUNKS CACHE SIZE: 536871424 (<DEFAULT>)
MAX MEM TABLE SIZE: 1000000 (<DEFAULT>)
DB: /var/lib/eventstore/db (Config File)
MEM DB: False (<DEFAULT>)
SKIP DB VERIFY: False (<DEFAULT>)
RUN PROJECTIONS: All (Config File)
PROJECTION THREADS: 3 (<DEFAULT>)
WORKER THREADS: 5 (<DEFAULT>)
HTTP PREFIXES: [ http://*:2113/ ] (Config File)
ENABLE TRUSTED AUTH: False (<DEFAULT>)
CERTIFICATE STORE LOCATION: <empty> (<DEFAULT>)
CERTIFICATE STORE NAME: <empty> (<DEFAULT>)
CERTIFICATE SUBJECT NAME: <empty> (<DEFAULT>)
CERTIFICATE THUMBPRINT: <empty> (<DEFAULT>)
CERTIFICATE FILE: <empty> (<DEFAULT>)
CERTIFICATE PASSWORD: <empty> (<DEFAULT>)
USE INTERNAL SSL: False (<DEFAULT>)
SSL TARGET HOST: n/a (<DEFAULT>)
SSL VALIDATE SERVER: True (<DEFAULT>)
AUTHENTICATION TYPE: internal (<DEFAULT>)
PREPARE TIMEOUT MS: 2000 (<DEFAULT>)
COMMIT TIMEOUT MS: 2000 (<DEFAULT>)
UNSAFE DISABLE FLUSH TO DISK: False (<DEFAULT>)
GOSSIP INTERVAL MS: 1000 (<DEFAULT>)
GOSSIP ALLOWED DIFFERENCE MS: 60000 (<DEFAULT>)
GOSSIP TIMEOUT MS: 500 (<DEFAULT>)
[PID:07955:001 2015.02.18 18:53:00.179 INFO ProgramBase`1 ] Quorum size set to 2
[PID:07955:001 2015.02.18 18:53:00.186 INFO ProgramBase`1 ] Can't find plugins path: plugins
[PID:07955:001 2015.02.18 18:53:00.219 INFO ProgramBase`1 ]
INSTANCE ID: cf1556d3-ebe2-49c4-8748-afd55ca853fd
DATABASE: /var/lib/eventstore/db
WRITER CHECKPOINT: 0 (0x0)
CHASER CHECKPOINT: 0 (0x0)
EPOCH CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
TRUNCATE CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
[PID:07955:001 2015.02.18 18:53:00.417 TRACE MessageHierarchy ] MessageHierarchy initialization took 00:00:00.1513913.
[PID:07955:001 2015.02.18 18:53:00.517 TRACE TFChunk ] CACHED TFChunk #0-0 (chunk-000000.000000) in 00:00:00.0024134.
[PID:07955:001 2015.02.18 18:53:00.673 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/projections
[PID:07955:001 2015.02.18 18:53:00.674 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/v8/Prelude ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Prelude
[PID:07955:001 2015.02.18 18:53:00.674 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/resources ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/web-resources/js
[PID:07955:001 2015.02.18 18:53:00.676 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.676 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.676 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.677 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.677 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.678 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.691 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07955:001 2015.02.18 18:53:00.691 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.692 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07955:001 2015.02.18 18:53:00.692 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.692 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07955:001 2015.02.18 18:53:00.692 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07955:001 2015.02.18 18:53:00.692 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07955:001 2015.02.18 18:53:00.693 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07955:010 2015.02.18 18:53:00.723 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] SYSTEM INIT...
[PID:07955:010 2015.02.18 18:53:00.756 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.176.46:1113.
[PID:07955:010 2015.02.18 18:53:00.760 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.176.46:1112.
[PID:07955:015 2015.02.18 18:53:00.778 INFO IndexCommitter ] TableIndex initialization...
[PID:07955:015 2015.02.18 18:53:00.789 INFO IndexCommitter ] ReadIndex building...
[PID:07955:015 2015.02.18 18:53:00.791 DEBUG IndexCommitter ] ReadIndex rebuilding done: total processed 0 records, time elapsed: 00:00:00.0013460.
[PID:07955:010 2015.02.18 18:53:00.810 INFO HttpAsyncServer ] Starting HTTP server on [http://*:2113/]...
[PID:07955:010 2015.02.18 18:53:00.814 INFO HttpAsyncServer ] HTTP server is up and listening on [http://*:2113/]
[PID:07955:010 2015.02.18 18:53:00.837 TRACE InMemoryBus ] SLOW BUS MSG [MainBus]: SystemInit - 53ms. Handler: HttpService.
[PID:07955:010 2015.02.18 18:53:00.837 INFO HttpAsyncServer ] Starting HTTP server on [http://10.75.176.46:2112/]...
[PID:07955:010 2015.02.18 18:53:00.838 INFO HttpAsyncServer ] HTTP server is up and listening on [http://10.75.176.46:2112/]
[PID:07955:010 2015.02.18 18:53:00.866 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: SystemInit - 147ms. Q: 0/7.
[PID:07955:010 2015.02.18 18:53:00.866 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] Service 'StorageWriter' initialized.
[PID:07955:010 2015.02.18 18:53:00.869 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] Service 'StorageReader' initialized.
[PID:07955:010 2015.02.18 18:53:00.870 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] Service 'StorageChaser' initialized.
[PID:07955:010 2015.02.18 18:53:00.904 TRACE GossipServiceBase ] CLUSTER HAS CHANGED
Old:
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:00.839
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:00.872
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:00.839
--------------------------------------------------------------------------------
[PID:07955:010 2015.02.18 18:53:00.907 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] SYSTEM START...
[PID:07955:010 2015.02.18 18:53:00.913 INFO ClusterVNodeControll] ========== [10.75.176.46:2112] IS UNKNOWN!!! WHOA!!!
[PID:07955:010 2015.02.18 18:53:00.962 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS.
[PID:07955:010 2015.02.18 18:53:00.963 DEBUG ElectionsService ] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:00.965 DEBUG ElectionsService ] ELECTIONS: (V=0) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:01.600 TRACE GossipServiceBase ] Looks like node [65.52.17.181:2113] is DEAD (Gossip send failed).
[PID:07955:010 2015.02.18 18:53:01.602 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.17.181:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:00.872
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:01.545
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:01.601
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:01.545
--------------------------------------------------------------------------------
[PID:07955:010 2015.02.18 18:53:01.968 DEBUG ElectionsService ] ELECTIONS: (V=0) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:01.968 DEBUG ElectionsService ] ELECTIONS: (V=1) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:01.968 DEBUG ElectionsService ] ELECTIONS: (V=1) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:02.187 TRACE GossipServiceBase ] Looks like node [65.52.18.0:2113] is DEAD (Gossip send failed).
[PID:07955:010 2015.02.18 18:53:02.187 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.0:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:01.601
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:02.167
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:02.187
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:01.601
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:02.167
--------------------------------------------------------------------------------
[PID:07955:010 2015.02.18 18:53:02.691 TRACE GossipServiceBase ] Looks like node [65.52.18.4:2113] is DEAD (Gossip send failed).
[PID:07955:010 2015.02.18 18:53:02.691 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.4:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:00.872
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:02.187
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:01.601
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:02.687
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:53:02.691
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:53:02.187
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:53:01.601
VND {cf1556d3-ebe2-49c4-8748-afd55ca853fd} <LIVE> [Unknown, 10.75.176.46:1112, n/a, 10.75.176.46:1113, n/a, 10.75.176.46:2112, 10.75.176.46:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:53:02.687
--------------------------------------------------------------------------------
[PID:07955:010 2015.02.18 18:53:02.975 DEBUG ElectionsService ] ELECTIONS: (V=1) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:02.975 DEBUG ElectionsService ] ELECTIONS: (V=2) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:02.975 DEBUG ElectionsService ] ELECTIONS: (V=2) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:03.983 DEBUG ElectionsService ] ELECTIONS: (V=2) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:03.983 DEBUG ElectionsService ] ELECTIONS: (V=3) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:03.983 DEBUG ElectionsService ] ELECTIONS: (V=3) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:04.986 DEBUG ElectionsService ] ELECTIONS: (V=3) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:04.986 DEBUG ElectionsService ] ELECTIONS: (V=4) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:04.986 DEBUG ElectionsService ] ELECTIONS: (V=4) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:05.993 DEBUG ElectionsService ] ELECTIONS: (V=4) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:05.993 DEBUG ElectionsService ] ELECTIONS: (V=5) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:05.993 DEBUG ElectionsService ] ELECTIONS: (V=5) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:07.002 DEBUG ElectionsService ] ELECTIONS: (V=5) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:07.002 DEBUG ElectionsService ] ELECTIONS: (V=6) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:07.002 DEBUG ElectionsService ] ELECTIONS: (V=6) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:08.007 DEBUG ElectionsService ] ELECTIONS: (V=6) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:08.007 DEBUG ElectionsService ] ELECTIONS: (V=7) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:08.007 DEBUG ElectionsService ] ELECTIONS: (V=7) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:09.015 DEBUG ElectionsService ] ELECTIONS: (V=7) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:09.015 DEBUG ElectionsService ] ELECTIONS: (V=8) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:09.015 DEBUG ElectionsService ] ELECTIONS: (V=8) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:10.023 DEBUG ElectionsService ] ELECTIONS: (V=8) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:10.023 DEBUG ElectionsService ] ELECTIONS: (V=9) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:10.023 DEBUG ElectionsService ] ELECTIONS: (V=9) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:11.027 DEBUG ElectionsService ] ELECTIONS: (V=9) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:11.027 DEBUG ElectionsService ] ELECTIONS: (V=10) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:11.027 DEBUG ElectionsService ] ELECTIONS: (V=10) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:006 2015.02.18 18:53:11.463 INFO TcpService ] External TCP connection accepted: [Normal, 10.75.176.200:59072, L10.75.176.46:1113, {564b54dd-437f-4115-9d92-1f7c947666fe}].
[PID:07955:018 2015.02.18 18:53:11.463 INFO TcpService ] Internal TCP connection accepted: [Normal, 10.75.176.200:59070, L10.75.176.46:1112, {92594d94-7943-4ab7-acc1-fa18e0680620}].
[PID:07955:010 2015.02.18 18:53:12.035 DEBUG ElectionsService ] ELECTIONS: (V=10) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:12.035 DEBUG ElectionsService ] ELECTIONS: (V=11) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:12.035 DEBUG ElectionsService ] ELECTIONS: (V=11) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:13.043 DEBUG ElectionsService ] ELECTIONS: (V=11) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:13.043 DEBUG ElectionsService ] ELECTIONS: (V=12) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:13.043 DEBUG ElectionsService ] ELECTIONS: (V=12) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:010 2015.02.18 18:53:14.047 DEBUG ElectionsService ] ELECTIONS: (V=12) TIMED OUT! (S=ElectingLeader, M=).
[PID:07955:010 2015.02.18 18:53:14.047 DEBUG ElectionsService ] ELECTIONS: (V=13) SHIFT TO LEADER ELECTION.
[PID:07955:010 2015.02.18 18:53:14.047 DEBUG ElectionsService ] ELECTIONS: (V=13) VIEWCHANGE FROM [10.75.176.46:2112, {cf1556d3-ebe2-49c4-8748-afd55ca853fd}].
[PID:07955:008 2015.02.18 18:53:14.540 TRACE TcpConnectionManager] Closing connection 'external-normal' [10.75.176.200:59072, L10.75.176.46:1113, {564b54dd-437f-4115-9d92-1f7c947666fe}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 0
[PID:07955:008 2015.02.18 18:53:14.608 INFO TcpConnection ] ES TcpConnection closed [18:53:14.545: N10.75.176.200:59072, L10.75.176.46:1113, {564b54dd-437f-4115-9d92-1f7c947666fe}]:
Received bytes: 0, Sent bytes: 22
Send calls: 1, callbacks: 1
Receive calls: 1, callbacks: 0
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 0
Raw
10.75.180.54-2113-cluster-node.log
[PID:07795:001 2015.02.18 18:55:03.434 INFO ProgramBase`1 ]
ES VERSION: 3.0.1.0 (release-oss-v3.0.1/7fa876c111888dd5980dbd86d126e6abe13b05ab, Thu, 23 Oct 2014 22:27:04 +0100)
OS: Unknown (Unix 3.16.0.29)
RUNTIME: 3.8.0 ((detached/45d0ba1) (64-bit)
GC: 2 GENERATIONS
LOGS: /var/log/eventstore
HELP: False (<DEFAULT>)
VERSION: False (<DEFAULT>)
LOG: /var/log/eventstore (Config File)
CONFIG: /var/lib/eventstore/eventstore.config (Command Line)
DEFINES: <empty> (<DEFAULT>)
WHAT IF: False (<DEFAULT>)
INT IP: 10.75.180.54 (Config File)
EXT IP: 10.75.180.54 (Config File)
INT HTTP PORT: 2112 (<DEFAULT>)
EXT HTTP PORT: 2113 (<DEFAULT>)
INT TCP PORT: 1112 (<DEFAULT>)
INT SECURE TCP PORT: 0 (<DEFAULT>)
EXT TCP PORT: 1113 (<DEFAULT>)
EXT SECURE TCP PORT: 0 (<DEFAULT>)
INT TCP HEARTBEAT TIMEOUT: 700 (<DEFAULT>)
EXT TCP HEARTBEAT TIMEOUT: 1000 (<DEFAULT>)
INT TCP HEARTBEAT INTERVAL: 700 (<DEFAULT>)
EXT TCP HEARTBEAT INTERVAL: 2000 (<DEFAULT>)
FORCE: False (<DEFAULT>)
CLUSTER SIZE: 3 (Config File)
NODE PRIORITY: 0 (<DEFAULT>)
MIN FLUSH DELAY MS: 2 (<DEFAULT>)
COMMIT COUNT: -1 (<DEFAULT>)
PREPARE COUNT: -1 (<DEFAULT>)
ADMIN ON EXT: True (<DEFAULT>)
STATS ON EXT: True (<DEFAULT>)
GOSSIP ON EXT: True (<DEFAULT>)
DISABLE SCAVENGE MERGING: False (<DEFAULT>)
DISCOVER VIA DNS: true (Config File)
CLUSTER DNS: eventstore-ncus.eventday.com (Config File)
CLUSTER GOSSIP PORT: 2113 (Config File)
GOSSIP SEED: <empty> (<DEFAULT>)
STATS PERIOD SEC: 30 (<DEFAULT>)
CACHED CHUNKS: -1 (<DEFAULT>)
CHUNKS CACHE SIZE: 536871424 (<DEFAULT>)
MAX MEM TABLE SIZE: 1000000 (<DEFAULT>)
DB: /var/lib/eventstore/db (Config File)
MEM DB: False (<DEFAULT>)
SKIP DB VERIFY: False (<DEFAULT>)
RUN PROJECTIONS: All (Config File)
PROJECTION THREADS: 3 (<DEFAULT>)
WORKER THREADS: 5 (<DEFAULT>)
HTTP PREFIXES: [ http://*:2113/ ] (Config File)
ENABLE TRUSTED AUTH: False (<DEFAULT>)
CERTIFICATE STORE LOCATION: <empty> (<DEFAULT>)
CERTIFICATE STORE NAME: <empty> (<DEFAULT>)
CERTIFICATE SUBJECT NAME: <empty> (<DEFAULT>)
CERTIFICATE THUMBPRINT: <empty> (<DEFAULT>)
CERTIFICATE FILE: <empty> (<DEFAULT>)
CERTIFICATE PASSWORD: <empty> (<DEFAULT>)
USE INTERNAL SSL: False (<DEFAULT>)
SSL TARGET HOST: n/a (<DEFAULT>)
SSL VALIDATE SERVER: True (<DEFAULT>)
AUTHENTICATION TYPE: internal (<DEFAULT>)
PREPARE TIMEOUT MS: 2000 (<DEFAULT>)
COMMIT TIMEOUT MS: 2000 (<DEFAULT>)
UNSAFE DISABLE FLUSH TO DISK: False (<DEFAULT>)
GOSSIP INTERVAL MS: 1000 (<DEFAULT>)
GOSSIP ALLOWED DIFFERENCE MS: 60000 (<DEFAULT>)
GOSSIP TIMEOUT MS: 500 (<DEFAULT>)
[PID:07795:001 2015.02.18 18:55:03.470 INFO ProgramBase`1 ] Quorum size set to 2
[PID:07795:001 2015.02.18 18:55:03.480 INFO ProgramBase`1 ] Can't find plugins path: plugins
[PID:07795:001 2015.02.18 18:55:03.514 INFO ProgramBase`1 ]
INSTANCE ID: d9b99bc8-9edd-4640-9f90-9f8dacb2406c
DATABASE: /var/lib/eventstore/db
WRITER CHECKPOINT: 0 (0x0)
CHASER CHECKPOINT: 0 (0x0)
EPOCH CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
TRUNCATE CHECKPOINT: -1 (0xFFFFFFFFFFFFFFFF)
[PID:07795:001 2015.02.18 18:55:03.711 TRACE MessageHierarchy ] MessageHierarchy initialization took 00:00:00.1510134.
[PID:07795:001 2015.02.18 18:55:03.810 TRACE TFChunk ] CACHED TFChunk #0-0 (chunk-000000.000000) in 00:00:00.0023256.
[PID:07795:001 2015.02.18 18:55:03.968 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/projections
[PID:07795:001 2015.02.18 18:55:03.969 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/v8/Prelude ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Prelude
[PID:07795:001 2015.02.18 18:55:03.969 INFO MiniWeb ] Starting MiniWeb for /web/es/js/projections/resources ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/web-resources/js
[PID:07795:001 2015.02.18 18:55:03.971 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.971 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.971 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.973 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.973 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/v8/Prelude/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.973 TRACE MiniWeb ] Binding MiniWeb to /web/es/js/projections/resources/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.986 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07795:001 2015.02.18 18:55:03.986 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.986 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07795:001 2015.02.18 18:55:03.987 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.987 INFO MiniWeb ] Starting MiniWeb for /web ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/clusternode-web
[PID:07795:001 2015.02.18 18:55:03.987 TRACE MiniWeb ] Binding MiniWeb to /web/{*remaining_path}
[PID:07795:001 2015.02.18 18:55:03.987 INFO MiniWeb ] Starting MiniWeb for /web/users ==> /var/lib/eventstore/EventStore-OSS-Linux-v3.0.1/Users/web
[PID:07795:001 2015.02.18 18:55:03.987 TRACE MiniWeb ] Binding MiniWeb to /web/users/{*remaining_path}
[PID:07795:010 2015.02.18 18:55:04.017 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] SYSTEM INIT...
[PID:07795:010 2015.02.18 18:55:04.047 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.180.54:1113.
[PID:07795:010 2015.02.18 18:55:04.051 INFO TcpServerListener ] Starting Normal TCP listening on TCP endpoint: 10.75.180.54:1112.
[PID:07795:015 2015.02.18 18:55:04.069 INFO IndexCommitter ] TableIndex initialization...
[PID:07795:015 2015.02.18 18:55:04.077 INFO IndexCommitter ] ReadIndex building...
[PID:07795:015 2015.02.18 18:55:04.079 DEBUG IndexCommitter ] ReadIndex rebuilding done: total processed 0 records, time elapsed: 00:00:00.0009720.
[PID:07795:010 2015.02.18 18:55:04.097 INFO HttpAsyncServer ] Starting HTTP server on [http://*:2113/]...
[PID:07795:010 2015.02.18 18:55:04.102 INFO HttpAsyncServer ] HTTP server is up and listening on [http://*:2113/]
[PID:07795:010 2015.02.18 18:55:04.125 TRACE InMemoryBus ] SLOW BUS MSG [MainBus]: SystemInit - 50ms. Handler: HttpService.
[PID:07795:010 2015.02.18 18:55:04.125 INFO HttpAsyncServer ] Starting HTTP server on [http://10.75.180.54:2112/]...
[PID:07795:010 2015.02.18 18:55:04.125 INFO HttpAsyncServer ] HTTP server is up and listening on [http://10.75.180.54:2112/]
[PID:07795:010 2015.02.18 18:55:04.151 TRACE QueuedHandlerAutoRes] SLOW QUEUE MSG [MainQueue]: SystemInit - 139ms. Q: 0/7.
[PID:07795:010 2015.02.18 18:55:04.153 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] Service 'StorageWriter' initialized.
[PID:07795:010 2015.02.18 18:55:04.155 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] Service 'StorageReader' initialized.
[PID:07795:010 2015.02.18 18:55:04.156 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] Service 'StorageChaser' initialized.
[PID:07795:010 2015.02.18 18:55:04.188 TRACE GossipServiceBase ] CLUSTER HAS CHANGED
Old:
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:04.126
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.157
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:04.126
--------------------------------------------------------------------------------
[PID:07795:010 2015.02.18 18:55:04.190 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] SYSTEM START...
[PID:07795:010 2015.02.18 18:55:04.195 INFO ClusterVNodeControll] ========== [10.75.180.54:2112] IS UNKNOWN!!! WHOA!!!
[PID:07795:010 2015.02.18 18:55:04.242 DEBUG ElectionsService ] ELECTIONS: STARTING ELECTIONS.
[PID:07795:010 2015.02.18 18:55:04.242 DEBUG ElectionsService ] ELECTIONS: (V=0) SHIFT TO LEADER ELECTION.
[PID:07795:010 2015.02.18 18:55:04.245 DEBUG ElectionsService ] ELECTIONS: (V=0) VIEWCHANGE FROM [10.75.180.54:2112, {d9b99bc8-9edd-4640-9f90-9f8dacb2406c}].
[PID:07795:010 2015.02.18 18:55:04.881 TRACE GossipServiceBase ] Looks like node [65.52.17.181:2113] is DEAD (Gossip send failed).
[PID:07795:010 2015.02.18 18:55:04.882 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.17.181:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.157
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:04.827
New:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.881
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:04.827
--------------------------------------------------------------------------------
[PID:07795:006 2015.02.18 18:55:04.947 INFO TcpService ] External TCP connection accepted: [Normal, 10.75.180.180:60225, L10.75.180.54:1113, {2d674f83-abc4-45f1-bd56-5451a6d49003}].
[PID:07795:006 2015.02.18 18:55:04.951 INFO TcpService ] Internal TCP connection accepted: [Normal, 10.75.180.180:60227, L10.75.180.54:1112, {5ee2c9f0-2530-4ad4-b6e3-fbe5b21387f5}].
[PID:07795:010 2015.02.18 18:55:05.249 DEBUG ElectionsService ] ELECTIONS: (V=0) TIMED OUT! (S=ElectingLeader, M=).
[PID:07795:010 2015.02.18 18:55:05.249 DEBUG ElectionsService ] ELECTIONS: (V=1) SHIFT TO LEADER ELECTION.
[PID:07795:010 2015.02.18 18:55:05.249 DEBUG ElectionsService ] ELECTIONS: (V=1) VIEWCHANGE FROM [10.75.180.54:2112, {d9b99bc8-9edd-4640-9f90-9f8dacb2406c}].
[PID:07795:010 2015.02.18 18:55:05.475 TRACE GossipServiceBase ] Looks like node [65.52.18.4:2113] is DEAD (Gossip send failed).
[PID:07795:010 2015.02.18 18:55:05.480 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.4:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.881
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:05.455
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:05.476
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.881
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:05.455
--------------------------------------------------------------------------------
[PID:07795:010 2015.02.18 18:55:05.983 TRACE GossipServiceBase ] Looks like node [65.52.18.0:2113] is DEAD (Gossip send failed).
[PID:07795:010 2015.02.18 18:55:05.983 TRACE GossipServiceBase ] CLUSTER HAS CHANGED (gossip send failed to [65.52.18.0:2113])
Old:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:05.476
MAN {00000000-0000-0000-0000-000000000000} <LIVE> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:04.157
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.881
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:05.964
New:
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.4:2113, 65.52.18.4:2113] | 2015-02-18 18:55:05.476
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.18.0:2113, 65.52.18.0:2113] | 2015-02-18 18:55:05.983
MAN {00000000-0000-0000-0000-000000000000} <DEAD> [Manager, 65.52.17.181:2113, 65.52.17.181:2113] | 2015-02-18 18:55:04.881
VND {d9b99bc8-9edd-4640-9f90-9f8dacb2406c} <LIVE> [Unknown, 10.75.180.54:1112, n/a, 10.75.180.54:1113, n/a, 10.75.180.54:2112, 10.75.180.54:2113] -1/0/0/E-1@-1:{00000000-0000-0000-0000-000000000000} | 2015-02-18 18:55:05.964
--------------------------------------------------------------------------------
[PID:07795:010 2015.02.18 18:55:06.255 DEBUG ElectionsService ] ELECTIONS: (V=1) TIMED OUT! (S=ElectingLeader, M=).
[PID:07795:010 2015.02.18 18:55:06.255 DEBUG ElectionsService ] ELECTIONS: (V=2) SHIFT TO LEADER ELECTION.
[PID:07795:010 2015.02.18 18:55:06.255 DEBUG ElectionsService ] ELECTIONS: (V=2) VIEWCHANGE FROM [10.75.180.54:2112, {d9b99bc8-9edd-4640-9f90-9f8dacb2406c}].
[PID:07795:010 2015.02.18 18:55:07.259 DEBUG ElectionsService ] ELECTIONS: (V=2) TIMED OUT! (S=ElectingLeader, M=).
[PID:07795:010 2015.02.18 18:55:07.259 DEBUG ElectionsService ] ELECTIONS: (V=3) SHIFT TO LEADER ELECTION.
[PID:07795:010 2015.02.18 18:55:07.259 DEBUG ElectionsService ] ELECTIONS: (V=3) VIEWCHANGE FROM [10.75.180.54:2112, {d9b99bc8-9edd-4640-9f90-9f8dacb2406c}].
[PID:07795:008 2015.02.18 18:55:07.992 TRACE TcpConnectionManager] Closing connection 'external-normal' [10.75.180.180:60225, L10.75.180.54:1113, {2d674f83-abc4-45f1-bd56-5451a6d49003}] cleanly. Reason: HEARTBEAT TIMEOUT at msgNum 0
[PID:07795:008 2015.02.18 18:55:08.027 INFO TcpConnection ] ES TcpConnection closed [18:55:07.995: N10.75.180.180:60225, L10.75.180.54:1113, {2d674f83-abc4-45f1-bd56-5451a6d49003}]:
Received bytes: 0, Sent bytes: 22
Send calls: 1, callbacks: 1
Receive calls: 1, callbacks: 0
Close reason: [Success] HEARTBEAT TIMEOUT at msgNum 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment