Skip to content

Instantly share code, notes, and snippets.

@boekabart
Created May 12, 2016 11:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save boekabart/de2d1bf1b866e9ac18618dabac4f2c42 to your computer and use it in GitHub Desktop.
Save boekabart/de2d1bf1b866e9ac18618dabac4f2c42 to your computer and use it in GitHub Desktop.
Akka.Net logging (combined from 2 log files) that shows that ClusterSingleton gets confused about who's oldest (A is oldest, but once B joins, A thinks B is oldest, and B thinks it's youngest).
A: ********** CimPocAiO logging started **********
A: 2016-05-10 21:25:19,810 INFO [6 ] DummyClassForStringSources Starting remoting
A: 2016-05-10 21:25:19,910 INFO [4 ] DummyClassForStringSources Remoting started; listening on addresses : [akka.tcp://CimPoc@127.0.0.1:9091]
A: 2016-05-10 21:25:19,910 INFO [5 ] DummyClassForStringSources Remoting now listens on addresses: [akka.tcp://CimPoc@127.0.0.1:9091]
A: 2016-05-10 21:25:19,946 INFO [7 ] DummyClassForStringSources Cluster Node [akka.tcp://CimPoc@127.0.0.1:9091] - Starting up...
A: 2016-05-10 21:25:19,964 WARN [7 ] ActorSystemImpl NewtonSoftJsonSerializer has been detected as a default serializer. It will be obsoleted in Akka.NET starting from version 1.5 in the favor of Wire (for more info visit: http://getakka.net/docs/Serialization#how-to-setup-wire-as-default-serializer ). If you want to suppress this message set HOCON `akka.suppress-json-serializer-warning` config flag to on.
A: 2016-05-10 21:25:19,964 WARN [4 ] ActorSystemImpl {
A: akka : {
A: scheduler : {
A: implementation : "PocAiO.FakeableNowScheduler, PocAiO"
A: }
A: log-config-on-start : on
A: log-dead-letters : on
A: stdout-loglevel : WARNING
A: loglevel : INFO
A: loggers : ["Akka.Logger.log4net.Log4NetLogger, Akka.Logger.log4net"]
A: akka : {
A: suppress-json-serializer-warnings : on
A: }
A: actor : {
A: provider : "Akka.Cluster.ClusterActorRefProvider, Akka.Cluster"
A: }
A: remote : {
A: helios : {
A: tcp : {
A: port : 9091
A: public-hostname : 127.0.0.1
A: hostname : 0.0.0.0
A: }
A: }
A: }
A: cluster : {
A: seed-nodes : [akka.tcp://CimPoc@127.0.0.1:4053]
A: roles : [ingest,server,sipadan,eos]
A: auto-down-unreachable-after : 10s
A: singleton : {
A: min-number-of-hand-over-retries : 10
A: }
A: }
A: persistence : {
A: journal : {
A: plugin : akka.persistence.journal.sqlite
A: sqlite : {
A: class : "Akka.Persistence.Sqlite.Journal.SqliteJournal, Akka.Persistence.Sqlite"
A: plugin-dispatcher : akka.actor.default-dispatcher
A: table-name : EventJournal
A: schema-name : dbo
A: auto-initialize : on
A: connection-string : FullUri=file:../data/CimPocJournal.db
A: }
A: }
A: snapshot-store : {
A: plugin : akka.persistence.no-snapshot-store
A: }
A: }
A: }
A: }
A: 2016-05-10 21:25:21,459 INFO [5 ] ClusterCoreDaemon Welcome from [akka.tcp://CimPoc@127.0.0.1:4053]
A: 2016-05-10 21:25:22,091 INFO [19 ] ClusterSingletonManager Singleton manager [akka.tcp://CimPoc@127.0.0.1:9091] starting singleton actor
A: 2016-05-10 21:25:22,091 INFO [19 ] ClusterSingletonManager ClusterSingletonManager state change [Start -> Oldest] Akka.Cluster.Tools.Singleton.Uninitialized
A: 2016-05-10 21:25:27,049 INFO [19 ] ClusterSingletonProxy Singleton identified at [akka://CimPoc/user/JobIdPublisherSingletonManager/JobIdPublisher]
B: ********** CimPocAiO logging started **********
B: 2016-05-10 21:25:39,161 INFO [5 ] DummyClassForStringSources Starting remoting
B: 2016-05-10 21:25:39,262 INFO [4 ] DummyClassForStringSources Remoting started; listening on addresses : [akka.tcp://CimPoc@127.0.0.1:9092]
B: 2016-05-10 21:25:39,262 INFO [6 ] DummyClassForStringSources Remoting now listens on addresses: [akka.tcp://CimPoc@127.0.0.1:9092]
B: 2016-05-10 21:25:39,293 INFO [7 ] DummyClassForStringSources Cluster Node [akka.tcp://CimPoc@127.0.0.1:9092] - Starting up...
B: 2016-05-10 21:25:39,330 WARN [4 ] ActorSystemImpl NewtonSoftJsonSerializer has been detected as a default serializer. It will be obsoleted in Akka.NET starting from version 1.5 in the favor of Wire (for more info visit: http://getakka.net/docs/Serialization#how-to-setup-wire-as-default-serializer ). If you want to suppress this message set HOCON `akka.suppress-json-serializer-warning` config flag to on.
B: 2016-05-10 21:25:39,330 WARN [5 ] ActorSystemImpl {
B: akka : {
B: scheduler : {
B: implementation : "PocAiO.FakeableNowScheduler, PocAiO"
B: }
B: log-config-on-start : on
B: log-dead-letters : on
B: stdout-loglevel : WARNING
B: loglevel : INFO
B: loggers : ["Akka.Logger.log4net.Log4NetLogger, Akka.Logger.log4net"]
B: akka : {
B: suppress-json-serializer-warnings : on
B: }
B: actor : {
B: provider : "Akka.Cluster.ClusterActorRefProvider, Akka.Cluster"
B: }
B: remote : {
B: helios : {
B: tcp : {
B: port : 9092
B: public-hostname : 127.0.0.1
B: hostname : 0.0.0.0
B: }
B: }
B: }
B: cluster : {
B: seed-nodes : [akka.tcp://CimPoc@127.0.0.1:4053]
B: roles : [ingest,server,sipadan,eos]
B: auto-down-unreachable-after : 10s
B: singleton : {
B: min-number-of-hand-over-retries : 10
B: }
B: }
B: persistence : {
B: journal : {
B: plugin : akka.persistence.journal.sqlite
B: sqlite : {
B: class : "Akka.Persistence.Sqlite.Journal.SqliteJournal, Akka.Persistence.Sqlite"
B: plugin-dispatcher : akka.actor.default-dispatcher
B: table-name : EventJournal
B: schema-name : dbo
B: auto-initialize : on
B: connection-string : FullUri=file:../data/CimPocJournal.db
B: }
B: }
B: snapshot-store : {
B: plugin : akka.persistence.no-snapshot-store
B: }
B: }
B: }
B: }
B: 2016-05-10 21:25:40,369 INFO [5 ] ClusterCoreDaemon Welcome from [akka.tcp://CimPoc@127.0.0.1:4053]
B: 2016-05-10 21:25:40,807 INFO [4 ] ClusterSingletonProxy Singleton identified at [akka.tcp://CimPoc@127.0.0.1:9091/user/JobIdPublisherSingletonManager/JobIdPublisher]
B: 2016-05-10 21:25:42,409 INFO [5 ] ClusterSingletonManager ClusterSingletonManager state change [Start -> Younger] Akka.Cluster.Tools.Singleton.Uninitialized
A: 2016-05-10 21:25:42,710 INFO [19 ] ClusterSingletonManager Oldest observed OldestChanged: [akka.tcp://CimPoc@127.0.0.1:9091 -> akka.tcp://CimPoc@127.0.0.1:9092]
A: 2016-05-10 21:25:42,710 INFO [19 ] ClusterSingletonManager ClusterSingletonManager state change [Oldest -> WasOldest] Akka.Cluster.Tools.Singleton.OldestData
B: 2016-05-10 21:25:42,725 WARN [5 ] ClusterSingletonManager unhandled event 3 in state Younger
A: 2016-05-10 21:25:47,730 INFO [25 ] ClusterSingletonManager Retry [1], sending TakeOverFromMe to [akka.tcp://CimPoc@127.0.0.1:9092]
B: 2016-05-10 21:25:47,730 WARN [19 ] ClusterSingletonManager unhandled event 3 in state Younger
A: 2016-05-10 21:25:52,752 ERROR [30 ] OneForOneStrategy Expected hand-over to [akka.tcp://CimPoc@127.0.0.1:9092] never occured
A: Akka.Cluster.Tools.Singleton.ClusterSingletonManagerIsStuck: Expected hand-over to [akka.tcp://CimPoc@127.0.0.1:9092] never occured
A: at Akka.Cluster.Tools.Singleton.ClusterSingletonManager.<InitializeFSM>b__30_4(Event`1 e)
A: at Akka.Actor.FSM`2.ProcessEvent(Event`1 fsmEvent, Object source)
A: at Akka.Actor.FSM`2.<Receive>b__53_1(Timer t)
A: at Akka.Case.With[TMessage](Action`1 action)
A: at Akka.Actor.FSM`2.Receive(Object message)
A: at Akka.Actor.ActorBase.AroundReceive(Receive receive, Object message)
A: at Akka.Actor.ActorCell.ReceiveMessage(Object message)
A: at Akka.Actor.ActorCell.Invoke(Envelope envelope)
A: 2016-05-10 21:25:52,782 INFO [30 ] ClusterSingletonManager Singleton manager [akka.tcp://CimPoc@127.0.0.1:9091] starting singleton actor
A: 2016-05-10 21:25:52,782 INFO [30 ] ClusterSingletonManager ClusterSingletonManager state change [Start -> Oldest] Akka.Cluster.Tools.Singleton.Uninitialized
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment