Skip to content

Instantly share code, notes, and snippets.

@nemosupremo
Created October 9, 2015 19:12
Show Gist options
  • Save nemosupremo/61ba7c994cc5a3d284bf to your computer and use it in GitHub Desktop.
Save nemosupremo/61ba7c994cc5a3d284bf to your computer and use it in GitHub Desktop.
Oct 9 16:06:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:42.312] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Me] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:06:42.312Z)]
Oct 9 16:06:51 master-01 mesos-master[11603]: 2015-10-09 16:06:51,508:11603(0x7f520d069700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.11:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.11:2181 timed out (exceeded timeout by 3ms)
Oct 9 16:06:51 master-01 mesos-master[11603]: 2015-10-09 16:06:51,508:11603(0x7f520d069700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:06:51 master-01 mesos-master[11603]: 2015-10-09 16:06:51,508:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.11:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.11:2181 timed out (exceeded timeout by 4ms)
Oct 9 16:06:51 master-01 mesos-master[11603]: 2015-10-09 16:06:51,508:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:06:51 master-01 mesos-master[11603]: I1009 16:06:51.509228 11619 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:51 master-01 mesos-master[11603]: I1009 16:06:51.510809 11623 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:51 master-01 mesos-master[11603]: 2015-10-09 16:06:51,853:11603(0x7f51ef7fe700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.11:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.11:2181 timed out (exceeded timeout by 3ms)
Oct 9 16:06:51 master-01 mesos-master[11603]: I1009 16:06:51.853920 11625 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:51 master-01 marathon[20175]: 2015-10-09 16:06:51,854:20175(0x7fe33d708700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.11:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.11:2181 timed out (exceeded timeout by 4ms)
Oct 9 16:06:51 master-01 marathon[20175]: I1009 16:06:51.855607 20235 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:51 master-01 marathon[20175]: 2015-10-09 16:06:51,856:20175(0x7fe33d708700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:06:51 master-01 marathon[20175]: [2015-10-09 16:06:51,942] INFO Client session timed out, have not heard from server in 6670ms for sessionid 0x2504d38107b0017, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1096)
Oct 9 16:06:55 master-01 mesos-master[11603]: 2015-10-09 16:06:55,560:11603(0x7f51effff700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:55 master-01 mesos-master[11603]: I1009 16:06:55.561415 11621 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:55 master-01 mesos-master[11603]: 2015-10-09 16:06:55,563:11603(0x7f520d069700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:55 master-01 marathon[20175]: 2015-10-09 16:06:55,564:20175(0x7fe342e45700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:55 master-01 marathon[20175]: 2015-10-09 16:06:55,564:20175(0x7fe33d708700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:55 master-01 marathon[20175]: I1009 16:06:55.564796 20236 group.cpp:418] Lost connection to ZooKeeper, attempting to reconnect ...
Oct 9 16:06:55 master-01 mesos-master[11603]: 2015-10-09 16:06:55,565:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:58 master-01 mesos-master[11603]: 2015-10-09 16:06:58,518:11603(0x7f51ef7fe700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.55:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.55:2181 timed out (exceeded timeout by 0ms)
Oct 9 16:06:58 master-01 mesos-master[11603]: 2015-10-09 16:06:58,519:11603(0x7f51ef7fe700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:06:58 master-01 mesos-master[11603]: 2015-10-09 16:06:58,519:11603(0x7f51ef7fe700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.676] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$xe] Received health result: [Unhealthy(web-prod.bcfd3dcb-6e9a-11e5-bd7a-00163e105035,2015-10-08T20:40:08.189Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.676Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.677] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$xe] Received health result: [Unhealthy(web-prod.058fe160-6e81-11e5-bd7a-00163e105035,2015-10-08T20:40:08.189Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.677Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.770] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$ze] Received health result: [Unhealthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.770Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.771] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$ze] Received health result: [Unhealthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.771Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.772] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ae] Received health result: [Unhealthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.772Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.776] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Be] Received health result: [Unhealthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.776Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.777] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ce] Received health result: [Unhealthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.777Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.782] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.06301907-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.782Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.783] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.062dcf15-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.783Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.783] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.059dc413-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.783Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.784] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.bcf43d1a-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.784Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.785] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.75e244d8-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.785Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.785] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.c1b6a72c-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.785Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.785] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.7bdb8139-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.785Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.786] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.062ee086-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.786Z)]
Oct 9 16:06:59 master-01 marathon[20175]: [INFO] [10/09/2015 16:06:59.989] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$ye] Received health result: [Unhealthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:06:59.989Z)]
Oct 9 16:07:01 master-01 mesos-master[11603]: W1009 16:07:01.511768 11622 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=2504d38107b0010) expiration
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.512701 11622 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.513115 11618 network.hpp:424] ZooKeeper group memberships changed
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.513219 11618 network.hpp:466] ZooKeeper group PIDs: { }
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x2504d38107b0010
Oct 9 16:07:01 master-01 mesos-master[11603]:
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,513:11603(0x7f5211cce700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7f5216f30a60 sessionId=0 sessionPasswd=<null> context=0x7f51f0004ed0 flags=0
Oct 9 16:07:01 master-01 mesos-master[11603]: W1009 16:07:01.514709 11623 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=2504d38107b000e) expiration
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.514859 11623 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.515022 11625 log.cpp:381] Renewing replica group membership
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x2504d38107b000e
Oct 9 16:07:01 master-01 mesos-master[11603]:
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,515:11603(0x7f52114cd700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7f5216f30a60 sessionId=0 sessionPasswd=<null> context=0x7f51e8006340 flags=0
Oct 9 16:07:01 master-01 mesos-master[11603]: W1009 16:07:01.855284 11624 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=2504d38107b000f) expiration
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,855:11603(0x7f51ef7fe700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.856062 11624 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.856165 11620 detector.cpp:138] Detected a new leader: None
Oct 9 16:07:01 master-01 mesos-master[11603]: I1009 16:07:01.856256 11620 master.cpp:1356] The newly elected leader is None
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,856:11603(0x7f51ef7fe700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x2504d38107b000f
Oct 9 16:07:01 master-01 mesos-master[11603]:
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,857:11603(0x7f5210ccc700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7f5216f30a60 sessionId=0 sessionPasswd=<null> context=0x7f52000058b0 flags=0
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,862:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:01 master-01 marathon[20175]: W1009 16:07:01.863263 20239 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=2504d38107b0002) expiration
Oct 9 16:07:01 master-01 marathon[20175]: I1009 16:07:01.863523 20239 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:01 master-01 marathon[20175]: I1009 16:07:01.863724 20234 detector.cpp:138] Detected a new leader: None
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x2504d38107b0002
Oct 9 16:07:01 master-01 marathon[20175]:
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,864:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,864:20175(0x7fe346750700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7fe34b2a8a60 sessionId=0 sessionPasswd=<null> context=0x7fe37c9606a0 flags=0
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,865:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,866:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,866:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:01 master-01 mesos-master[11603]: 2015-10-09 16:07:01,866:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,869:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,869:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,870:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,870:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,871:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:01 master-01 marathon[20175]: 2015-10-09 16:07:01,871:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:01 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:01.994] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/IO-HTTP/host-connector-41/0] Premature connection close (the server doesn't appear to support request pipelining) in response to GET request to /status/ with 5 retries left, retrying...
Oct 9 16:07:01 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:01.998] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 4 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:01.999] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/IO-HTTP/host-connector-41/2] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 3 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.000] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 2 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.059] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/IO-HTTP/host-connector-33/0] Premature connection close (the server doesn't appear to support request pipelining) in response to GET request to /status/ with 5 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.063] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 4 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.064] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/IO-HTTP/host-connector-33/2] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 3 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.065] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 2 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,108] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:02 master-01 mesos-master[11603]: 2015-10-09 16:07:02,230:11603(0x7f51effff700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.55:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.55:2181 timed out (exceeded timeout by 4ms)
Oct 9 16:07:02 master-01 mesos-master[11603]: 2015-10-09 16:07:02,231:11603(0x7f51effff700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:02 master-01 marathon[20175]: 2015-10-09 16:07:02,231:20175(0x7fe342e45700):ZOO_ERROR@handle_socket_error_msg@1643: Socket [10.129.196.11:2181] zk retcode=-7, errno=110(Connection timed out): connection to 10.129.196.11:2181 timed out (exceeded timeout by 1ms)
Oct 9 16:07:02 master-01 marathon[20175]: 2015-10-09 16:07:02,231:20175(0x7fe342e45700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:02 master-01 marathon[20175]: 2015-10-09 16:07:02,231:20175(0x7fe342e45700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:02 master-01 mesos-master[11603]: 2015-10-09 16:07:02,232:11603(0x7f51effff700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.328] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Me] Received health result: [Unhealthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,AskTimeoutException: Ask timed out on [Actor[akka://marathon/user/IO-HTTP#743208934]] after [10000 ms],2015-10-09T16:07:02.328Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.332] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Me] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:07:02.332Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,598] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,598] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,599] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.684] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$xe] Received health result: [Healthy(web-prod.058fe160-6e81-11e5-bd7a-00163e105035,2015-10-08T20:40:08.189Z,2015-10-09T16:07:02.684Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.685] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$xe] Received health result: [Healthy(web-prod.bcfd3dcb-6e9a-11e5-bd7a-00163e105035,2015-10-08T20:40:08.189Z,2015-10-09T16:07:02.685Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.775] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$ze] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:07:02.775Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.775] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$ze] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:07:02.775Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.782] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ce] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:07:02.782Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.784] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/IO-HTTP/host-connector-41/1] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 5 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.785] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/IO-HTTP/host-connector-33/1] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 5 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.786] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Be] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:07:02.786Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.787] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 4 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.788] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 4 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.790] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$De] Received health result: [Healthy(geard.062ee086-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.790Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.790] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$De] Received health result: [Healthy(geard.c1b6a72c-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.790Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.791] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$De] Received health result: [Healthy(geard.062dcf15-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.791Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.792] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/IO-HTTP/host-connector-33/1] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 3 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.792] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/IO-HTTP/host-connector-41/1] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 3 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.794] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 2 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.794] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 2 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.795] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$De] Received health result: [Healthy(geard.7bdb8139-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.795Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.795] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$De] Received health result: [Healthy(geard.06301907-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.795Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.796] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/IO-HTTP/host-connector-41/1] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 1 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.797] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/IO-HTTP/host-connector-33/1] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 1 retries left, retrying...
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.799] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with no retries left, dispatching error...
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.799] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.bcf43d1a-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,ConnectionAttemptFailedException: Connection attempt to 10.129.196.34:3333 failed,2015-10-09T16:07:02.799Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:02.800] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with no retries left, dispatching error...
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.800] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$De] Received health result: [Unhealthy(geard.75e244d8-6e9a-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,ConnectionAttemptFailedException: Connection attempt to 10.129.196.35:3333 failed,2015-10-09T16:07:02.800Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.800] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$De] Received health result: [Healthy(geard.059dc413-6e81-11e5-bd7a-00163e105035,2015-10-08T19:54:01.809Z,2015-10-09T16:07:02.800Z)]
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,862] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,863] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:02 master-01 marathon[20175]: [2015-10-09 16:07:02,863] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:02.994] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$ye] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:07:02.993Z)]
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,588] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,589] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,589] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,727] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,728] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:03 master-01 marathon[20175]: [2015-10-09 16:07:03,730] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:04 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:04.782] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/IO-HTTP/group-0/249] Illegal response header: Illegal 'Access-Control-Allow-Origin' header: Unexpected end of input, expected $timesAccess$minusControl$minusAllow$minusOrigin (line 1, pos 1):
Oct 9 16:07:04 master-01 marathon[20175]:
Oct 9 16:07:04 master-01 marathon[20175]: ^
Oct 9 16:07:04 master-01 marathon[20175]:
Oct 9 16:07:04 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:04.783] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ae] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:07:04.783Z)]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,203:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,203:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,204:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,205:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,205:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,205:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,207:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,207:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,207:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,208:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,208:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,209:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 mesos-master[11603]: W1009 16:07:05.562645 11620 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=1504d38107c0013) expiration
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.562978 11620 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.563698 11618 contender.cpp:196] Membership cancelled: 912
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.563753 11618 master.cpp:1338] Lost candidacy as a follower... Contend again
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.563791 11618 contender.cpp:233] Withdrawing the previous membership before recontending
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.563822 11618 contender.cpp:186] Now cancelling the membership: 912
Oct 9 16:07:05 master-01 mesos-master[11603]: I1009 16:07:05.563930 11618 contender.cpp:131] Joining the ZK group
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x1504d38107c0013
Oct 9 16:07:05 master-01 mesos-master[11603]:
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,564:11603(0x7f5212cd0700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7f5216f30a60 sessionId=0 sessionPasswd=<null> context=0x7f51e8008d20 flags=0
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,567:20175(0x7fe342e45700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:05 master-01 marathon[20175]: W1009 16:07:05.567360 20234 group.cpp:456] Timed out waiting to reconnect to ZooKeeper. Forcing ZooKeeper session (sessionId=1504d38107c001c) expiration
Oct 9 16:07:05 master-01 marathon[20175]: I1009 16:07:05.567525 20234 group.cpp:472] ZooKeeper session expired
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,568] WARN Disconnected (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:91)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,568] INFO Abdicating (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:308)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,568] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:07:05 master-01 marathon[20175]: I1009 16:07:05.567647 20240 detector.cpp:138] Detected a new leader: None
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@zookeeper_close@2522: Freeing zookeeper resources for sessionId=0x1504d38107c001c
Oct 9 16:07:05 master-01 marathon[20175]:
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,569:20175(0x7fe348f55700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7fe34b2a8a60 sessionId=0 sessionPasswd=<null> context=0x7fe35d1dc840 flags=0
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.571] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/leaderShipCoordinator] All actors suspended:
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/rateLimiter#-736850290]
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/offerMatcherLaunchTokens#550536420]
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/launchQueue#-1740320890]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,573:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,574:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/killOverdueStagedTasks#1084734318]
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/offerMatcherManager#2022947207]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,574:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,574:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,575:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:05 master-01 mesos-master[11603]: 2015-10-09 16:07:05,576:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: * Actor[akka://marathon/user/taskStatusUpdate#1214885755]
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.572] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/MarathonScheduler/$a] Suspending scheduler actor
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.576] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/taskStatusUpdate/6] Stopped class mesosphere.marathon.core.task.tracker.impl.TaskStatusUpdateActor
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.578] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/launchQueue/6/0-geard] Stopped appTaskLaunchActor for /geard version 2015-10-08T19:54:01.809Z
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.579] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/launchQueue/6/1-web-prod] Stopped appTaskLaunchActor for /web-prod version 2015-10-08T20:40:08.189Z
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,572] INFO Removing health check for app [/web-staging] and version [2015-10-08T20:36:18.604Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,581] INFO Removing health check for app [/chatd] and version [2015-10-03T05:04:52.603Z]: [HealthCheck(Some(/v1/self),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,581] INFO Removing health check for app [/phantom] and version [2015-06-13T01:24:28.535Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,582] INFO Removing health check for app [/geard] and version [2015-10-08T19:54:01.809Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,572] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.582] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Be] Stopped health check actor for app [/web-staging] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: I1009 16:07:05.583678 20240 sched.cpp:1589] Asked to stop the driver
Oct 9 16:07:05 master-01 marathon[20175]: I1009 16:07:05.584007 20240 sched.cpp:276] No master detected
Oct 9 16:07:05 master-01 marathon[20175]: I1009 16:07:05.584051 20240 sched.cpp:831] Stopping framework '20151002-220555-935624970-5050-17468-0000'
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.582] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Ae] Stopped health check actor for app [/chatd] and healthCheck [HealthCheck(Some(/v1/self),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.582] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$ye] Stopped health check actor for app [/phantom] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,579] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.584] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$De] Stopped health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,584] INFO Removing health check for app [/geard] and version [2015-10-08T19:21:00.379Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.585] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Me] Stopped health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,585] INFO Removing health check for app [/api] and version [2015-10-07T22:18:43.603Z]: [HealthCheck(Some(/REVISION),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.586] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$ze] Stopped health check actor for app [/api] and healthCheck [HealthCheck(Some(/REVISION),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,586] INFO Removing health check for app [/web-prod] and version [2015-10-08T20:40:08.189Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.586] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$xe] Stopped health check actor for app [/web-prod] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,587] INFO Removing health check for app [/rank] and version [2015-09-05T00:45:16.537Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:07:05 master-01 marathon[20175]: [INFO] [10/09/2015 16:07:05.587] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ce] Stopped health check actor for app [/rank] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,588] INFO Driver future completed. Executing optional abdication command. (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:195)
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,588:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,589:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,590:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,590:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,590:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:05 master-01 marathon[20175]: 2015-10-09 16:07:05,591:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,607] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,607] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,609] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,762] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,763] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,764] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,865] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:05 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:05 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:05 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:05 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:127)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:05 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:05 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:05 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:05 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:05 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:05 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:05 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,909] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,910] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:05 master-01 marathon[20175]: [2015-10-09 16:07:05,910] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,505] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,505] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,506] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,523:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,523:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,524:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,524:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,524:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,525:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,525:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,525:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,526:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,526:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,526:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 mesos-master[11603]: 2015-10-09 16:07:06,527:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,659] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,660] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,660] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,890] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,891] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,892] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:06 master-01 mesos-master[11603]: I1009 16:07:06.918812 11618 http.cpp:516] HTTP request for '/master/state.json'
Oct 9 16:07:06 master-01 marathon[20175]: [2015-10-09 16:07:06,992] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:06 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:06 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:06 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:06 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.retryWork(BackoffHelper.java:139)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:128)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:06 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:06 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:06 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:06 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:06 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:06 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:06 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:07 master-01 marathon[20175]: [2015-10-09 16:07:07,916] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:07 master-01 marathon[20175]: [2015-10-09 16:07:07,917] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:07 master-01 marathon[20175]: [2015-10-09 16:07:07,918] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,436] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,437] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,438] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,542:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,543:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,543:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,544:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,544:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,545:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,545:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,546:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,546:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,547:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,547:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,547:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,654] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,655] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:08 master-01 marathon[20175]: [2015-10-09 16:07:08,656] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,913:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,914:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,914:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,915:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,915:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:08 master-01 mesos-master[11603]: 2015-10-09 16:07:08,917:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,928:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,928:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,928:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,929:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,929:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:08 master-01 marathon[20175]: 2015-10-09 16:07:08,930:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,254] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,254] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,256] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,356] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:09 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:09 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:09 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:09 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.retryWork(BackoffHelper.java:139)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:128)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:09 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:09 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:09 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:09 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:09 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:09 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:09 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,474] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,475] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:09 master-01 marathon[20175]: [2015-10-09 16:07:09,476] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,863:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,864:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,864:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,864:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,865:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,865:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,865:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,865:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,866:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,866:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,867:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:09 master-01 mesos-master[11603]: 2015-10-09 16:07:09,867:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:10 master-01 marathon[20175]: [2015-10-09 16:07:10,268] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:10 master-01 marathon[20175]: [2015-10-09 16:07:10,274] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:10 master-01 marathon[20175]: [2015-10-09 16:07:10,275] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,294] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,295] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,296] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:11 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:11.651] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/IO-HTTP/host-connector-33/2] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with 1 retries left, retrying...
Oct 9 16:07:11 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:11.654] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/IO-HTTP/host-connector-33/0] Connection attempt to 10.129.196.35:3333 failed in response to GET request to /status/ with no retries left, dispatching error...
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,718] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,719] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,720] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,878:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,879:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,879:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,880:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,880:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:11 master-01 mesos-master[11603]: 2015-10-09 16:07:11,881:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,883:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,883:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,883:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,884:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,885:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:11 master-01 marathon[20175]: 2015-10-09 16:07:11,885:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,975] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,975] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:11 master-01 marathon[20175]: [2015-10-09 16:07:11,976] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:12 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:12.018] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/IO-HTTP/group-0/233] Configured connecting timeout of 10 seconds expired, stopping
Oct 9 16:07:12 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:12.018] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/IO-HTTP/host-connector-41/2] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with 1 retries left, retrying...
Oct 9 16:07:12 master-01 marathon[20175]: [WARN] [10/09/2015 16:07:12.024] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/IO-HTTP/host-connector-41/0] Connection attempt to 10.129.196.34:3333 failed in response to GET request to /status/ with no retries left, dispatching error...
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,254:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,255:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,255:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,256:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,256:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:12 master-01 mesos-master[11603]: 2015-10-09 16:07:12,259:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,267:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,267:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,268:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,268:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,269:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:12 master-01 marathon[20175]: 2015-10-09 16:07:12,269:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,564] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,565] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,565] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,736] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,737] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:12 master-01 marathon[20175]: [2015-10-09 16:07:12,738] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,203:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,204:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,204:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,205:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,205:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,205:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,206:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,206:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,206:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,206:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,207:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 mesos-master[11603]: 2015-10-09 16:07:13,207:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:13 master-01 marathon[20175]: [2015-10-09 16:07:13,456] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:13 master-01 marathon[20175]: [2015-10-09 16:07:13,456] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:13 master-01 marathon[20175]: [2015-10-09 16:07:13,457] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:13 master-01 marathon[20175]: [2015-10-09 16:07:13,557] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:13 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:13 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:13 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:13 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.retryWork(BackoffHelper.java:139)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:128)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:13 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:13 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:13 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:13 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:13 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:13 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:13 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,652] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,653] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,655] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,823] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,824] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,825] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,918] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,919] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:14 master-01 marathon[20175]: [2015-10-09 16:07:14,920] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,109] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,111] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,111] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,217:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,218:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,218:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,219:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,219:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,219:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,220:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,220:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,220:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,220:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,221:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,221:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,595:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,597:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,597:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,597] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,598] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,598:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,598:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:15 master-01 marathon[20175]: [2015-10-09 16:07:15,599] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:15 master-01 mesos-master[11603]: 2015-10-09 16:07:15,600:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,603:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,603:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,603:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,604:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,604:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:15 master-01 marathon[20175]: 2015-10-09 16:07:15,605:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,158] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,159] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,159] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,543:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,544:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,544:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,545:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,545:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,545:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,545:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,546:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,546:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,547:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,547:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 mesos-master[11603]: 2015-10-09 16:07:16,547:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,729] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,730] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:16 master-01 marathon[20175]: [2015-10-09 16:07:16,731] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:17 master-01 marathon[20175]: [2015-10-09 16:07:17,204] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:17 master-01 marathon[20175]: [2015-10-09 16:07:17,206] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:17 master-01 marathon[20175]: [2015-10-09 16:07:17,207] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,259] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,260] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,261] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,292] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,294] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,295] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,554:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,555:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,555:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,555:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,556:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,556:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,557:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,557:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,557:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,558:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,558:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,558:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,914] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,915] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:18 master-01 marathon[20175]: [2015-10-09 16:07:18,916] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,936:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,937:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,938:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,939:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,939:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,939:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,939:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,939:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,940:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,940:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:18 master-01 mesos-master[11603]: 2015-10-09 16:07:18,941:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:18 master-01 marathon[20175]: 2015-10-09 16:07:18,942:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 marathon[20175]: [2015-10-09 16:07:19,147] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:19 master-01 marathon[20175]: [2015-10-09 16:07:19,148] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:19 master-01 marathon[20175]: [2015-10-09 16:07:19,149] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,883:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,883:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,883:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,884:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,884:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,884:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,884:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,885:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,885:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,885:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,886:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:19 master-01 mesos-master[11603]: 2015-10-09 16:07:19,886:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,036] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,037] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,038] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,953] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,953] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:20 master-01 marathon[20175]: [2015-10-09 16:07:20,954] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,118] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,119] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,121] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,225] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,226] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,226] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,402] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,403] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,403] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,894:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,894:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,894:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,895:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,895:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,896:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,896:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,896:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:21 master-01 mesos-master[11603]: 2015-10-09 16:07:21,896:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,897:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,897:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:21 master-01 marathon[20175]: 2015-10-09 16:07:21,897:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,966] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,966] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:21 master-01 marathon[20175]: [2015-10-09 16:07:21,967] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,277:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,278:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,279:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,279:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,279:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,280:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,280:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,280:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,281:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,281:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:22 master-01 mesos-master[11603]: 2015-10-09 16:07:22,283:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:22 master-01 marathon[20175]: 2015-10-09 16:07:22,285:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,068] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,069] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,070] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,170] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:23 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:23 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:23 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:23 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.retryWork(BackoffHelper.java:139)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:128)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:23 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:23 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:23 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:23 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:23 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:23 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:23 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,222:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,223:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,224:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,224:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,225:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,225:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,225:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,225:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,225:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,226:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,226:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 mesos-master[11603]: 2015-10-09 16:07:23,227:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,490] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,491] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,492] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,524] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,525] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,525] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,816] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,817] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:23 master-01 marathon[20175]: [2015-10-09 16:07:23,818] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:24 master-01 marathon[20175]: [2015-10-09 16:07:24,582] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:24 master-01 marathon[20175]: [2015-10-09 16:07:24,583] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:24 master-01 marathon[20175]: [2015-10-09 16:07:24,584] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,199] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,200] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,201] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,231:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,231:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,231:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,232:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,232:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,232:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,233:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,233:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,233:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,233:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,234:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,234:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,618:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,619:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,619:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,619:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,619:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,620:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,620:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,620:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,621:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,621:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:25 master-01 mesos-master[11603]: 2015-10-09 16:07:25,624:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: 2015-10-09 16:07:25,625:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,729] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,730] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:25 master-01 marathon[20175]: [2015-10-09 16:07:25,731] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:26 master-01 marathon[20175]: [2015-10-09 16:07:26,214] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:26 master-01 marathon[20175]: [2015-10-09 16:07:26,215] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:26 master-01 marathon[20175]: [2015-10-09 16:07:26,216] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,560:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,561:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,561:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,562:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,562:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,563:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,563:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,563:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,564:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,564:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,565:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:26 master-01 mesos-master[11603]: 2015-10-09 16:07:26,565:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,026] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,027] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,028] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,275] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,276] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,277] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,581] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,582] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:27 master-01 marathon[20175]: [2015-10-09 16:07:27,582] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:28 master-01 marathon[20175]: [2015-10-09 16:07:28,117] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:28 master-01 marathon[20175]: [2015-10-09 16:07:28,118] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:28 master-01 marathon[20175]: [2015-10-09 16:07:28,118] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,568:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,569:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,569:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,570:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,570:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,570:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,570:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,571:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,571:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,572:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,572:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,573:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,959:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,959:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,960:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,960:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,960:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,960:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,961:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,961:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,961:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,961:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:28 master-01 mesos-master[11603]: 2015-10-09 16:07:28,962:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:28 master-01 marathon[20175]: 2015-10-09 16:07:28,962:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,293] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,294] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,294] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,899:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,899:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,900:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,900:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,901:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,901:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,901:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,901:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,902:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,902:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,902:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:29 master-01 mesos-master[11603]: 2015-10-09 16:07:29,903:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,923] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,924] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:29 master-01 marathon[20175]: [2015-10-09 16:07:29,925] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,046] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,047] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,048] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,276] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,276] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,277] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,568] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,569] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,570] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,694] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,695] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:30 master-01 marathon[20175]: [2015-10-09 16:07:30,696] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,907:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,907:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,908:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,908:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,908:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,909:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,910:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,910:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:31 master-01 mesos-master[11603]: 2015-10-09 16:07:31,910:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,911:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,911:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:31 master-01 marathon[20175]: 2015-10-09 16:07:31,911:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,115] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,116] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,117] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,298:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,298:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,299:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,299:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,299:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,299:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,300:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,300:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,300:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,300:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:32 master-01 mesos-master[11603]: 2015-10-09 16:07:32,301:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 marathon[20175]: 2015-10-09 16:07:32,301:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,535] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,536] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,536] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,950] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,951] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,952] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:32 master-01 marathon[20175]: [2015-10-09 16:07:32,999] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:32,999] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,001] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,238:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,238:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,238:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,239:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,239:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,240:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,240:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,240:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,240:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,240:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,241:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 mesos-master[11603]: 2015-10-09 16:07:33,241:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,381] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,382] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,382] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,751] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,752] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:33 master-01 marathon[20175]: [2015-10-09 16:07:33,752] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:34 master-01 marathon[20175]: [2015-10-09 16:07:34,659] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:34 master-01 marathon[20175]: [2015-10-09 16:07:34,660] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:34 master-01 marathon[20175]: [2015-10-09 16:07:34,660] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,247:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,248:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,248:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,249:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,250:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,250:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,250:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,250:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,251:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,251:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,251:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,252:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,488] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,488] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,490] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,638:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,639:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,639:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,639:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,641:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,641:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,641:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,642:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,643:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 mesos-master[11603]: 2015-10-09 16:07:35,643:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,644:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:35 master-01 marathon[20175]: 2015-10-09 16:07:35,644:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,800] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,801] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:35 master-01 marathon[20175]: [2015-10-09 16:07:35,801] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,261] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,262] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,262] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,577:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,577:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,578:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,579:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,581:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,581:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,582:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,582:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,582:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,583:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,583:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:36 master-01 mesos-master[11603]: 2015-10-09 16:07:36,583:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,716] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,716] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:36 master-01 marathon[20175]: [2015-10-09 16:07:36,718] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,316] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,317] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,318] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,398] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,399] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:37 master-01 marathon[20175]: [2015-10-09 16:07:37,400] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,085] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,086] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,088] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,460] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,461] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,462] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,588:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,588:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,589:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,589:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,590:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,590:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,590:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,591:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,591:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,591:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,592:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,592:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,706] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,707] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:38 master-01 marathon[20175]: [2015-10-09 16:07:38,709] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,978:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,979:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,979:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,979:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,980:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,980:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,980:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,980:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,981:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,981:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:38 master-01 mesos-master[11603]: 2015-10-09 16:07:38,981:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:38 master-01 marathon[20175]: 2015-10-09 16:07:38,982:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,222] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,223] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,224] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,325] WARN Temporary error cancelling membership: /marathon/leader/member_0000000809 (com.twitter.common.zookeeper.Group:384)
Oct 9 16:07:39 master-01 marathon[20175]: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /marathon/leader/member_0000000809
Oct 9 16:07:39 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
Oct 9 16:07:39 master-01 marathon[20175]: #011at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
Oct 9 16:07:39 master-01 marathon[20175]: #011at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:370)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership$1.get(Group.java:367)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:109)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper$1.get(BackoffHelper.java:107)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.retryWork(BackoffHelper.java:139)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilResult(BackoffHelper.java:128)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.util.BackoffHelper.doUntilSuccess(BackoffHelper.java:107)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.Group$ActiveMembership.cancel(Group.java:367)
Oct 9 16:07:39 master-01 marathon[20175]: #011at com.twitter.common.zookeeper.CandidateImpl$4$1.execute(CandidateImpl.java:157)
Oct 9 16:07:39 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:207)
Oct 9 16:07:39 master-01 marathon[20175]: #011at mesosphere.marathon.MarathonSchedulerService$$anonfun$runDriver$2.apply(MarathonSchedulerService.scala:193)
Oct 9 16:07:39 master-01 marathon[20175]: #011at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
Oct 9 16:07:39 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
Oct 9 16:07:39 master-01 marathon[20175]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
Oct 9 16:07:39 master-01 marathon[20175]: #011at java.lang.Thread.run(Thread.java:745)
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,918:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,918:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,919:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,919:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,920:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,920:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,921:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,921:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,921:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,921:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,922:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 mesos-master[11603]: 2015-10-09 16:07:39,922:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,983] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,984] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:39 master-01 marathon[20175]: [2015-10-09 16:07:39,984] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,248] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,249] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,250] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,542] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,543] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:40 master-01 marathon[20175]: [2015-10-09 16:07:40,544] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,279] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,281] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,281] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,384] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,385] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,386] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,599] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,601] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:41 master-01 marathon[20175]: [2015-10-09 16:07:41,602] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,928:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,928:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,929:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,929:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,930:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,930:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,930:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,931:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,931:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:41 master-01 mesos-master[11603]: 2015-10-09 16:07:41,931:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,932:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:41 master-01 marathon[20175]: 2015-10-09 16:07:41,932:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,253] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,254] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,257] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,318:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,319:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,319:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,320:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,320:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,321:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,320:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,321:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,322:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,322:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:42 master-01 mesos-master[11603]: 2015-10-09 16:07:42,325:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 marathon[20175]: 2015-10-09 16:07:42,325:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,944] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,945] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:42 master-01 marathon[20175]: [2015-10-09 16:07:42,946] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,258:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,258:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,259:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,259:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,260:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,260:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,260:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,261:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,261:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,261:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,261:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 mesos-master[11603]: 2015-10-09 16:07:43,262:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:43 master-01 marathon[20175]: [2015-10-09 16:07:43,708] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:43 master-01 marathon[20175]: [2015-10-09 16:07:43,708] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:43 master-01 marathon[20175]: [2015-10-09 16:07:43,709] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:43 master-01 mesos-master[11603]: I1009 16:07:43.831172 11618 http.cpp:516] HTTP request for '/master/state.json'
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,204] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,205] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,206] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,469] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,470] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,470] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,960] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,962] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:44 master-01 marathon[20175]: [2015-10-09 16:07:44,962] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,268:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,268:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,268:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,269:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,269:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,270:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,270:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,270:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,270:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,271:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,271:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,271:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,658:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,659:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,659:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,659:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,660:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,660:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,660:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,660:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,660:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,661:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:45 master-01 mesos-master[11603]: 2015-10-09 16:07:45,661:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: 2015-10-09 16:07:45,662:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:45 master-01 marathon[20175]: [2015-10-09 16:07:45,837] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:45 master-01 marathon[20175]: [2015-10-09 16:07:45,837] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:45 master-01 marathon[20175]: [2015-10-09 16:07:45,838] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:46 master-01 marathon[20175]: [2015-10-09 16:07:46,363] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:46 master-01 marathon[20175]: [2015-10-09 16:07:46,364] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:46 master-01 marathon[20175]: [2015-10-09 16:07:46,364] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,598:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,599:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,599:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,600:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,600:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,600:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,600:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,601:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,601:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,602:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,602:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:46 master-01 mesos-master[11603]: 2015-10-09 16:07:46,602:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,070] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,070] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,071] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,740] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,741] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,742] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,768] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,769] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:47 master-01 marathon[20175]: [2015-10-09 16:07:47,769] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,158] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,160] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,160] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,510] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,511] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:48 master-01 marathon[20175]: [2015-10-09 16:07:48,511] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,608:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,609:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,609:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,609:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,610:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,611:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,611:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,612:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,612:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,613:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,613:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,613:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 mesos-master[11603]: 2015-10-09 16:07:48,998:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,998:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,999:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:48 master-01 marathon[20175]: 2015-10-09 16:07:48,999:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:48,999:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,000:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:49 master-01 marathon[20175]: 2015-10-09 16:07:49,000:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,000:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,001:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:49 master-01 marathon[20175]: 2015-10-09 16:07:49,001:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:49 master-01 marathon[20175]: 2015-10-09 16:07:49,002:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,005:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 marathon[20175]: [2015-10-09 16:07:49,336] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:49 master-01 marathon[20175]: [2015-10-09 16:07:49,337] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:49 master-01 marathon[20175]: [2015-10-09 16:07:49,338] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,939:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,939:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,940:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,940:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,940:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,941:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,941:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,941:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,942:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,942:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,942:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:49 master-01 mesos-master[11603]: 2015-10-09 16:07:49,942:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,234] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,235] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,236] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,535] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,536] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,537] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,748] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,749] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,750] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,752] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,752] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:50 master-01 marathon[20175]: [2015-10-09 16:07:50,753] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:51 master-01 marathon[20175]: [2015-10-09 16:07:51,674] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:51 master-01 marathon[20175]: [2015-10-09 16:07:51,676] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:51 master-01 marathon[20175]: [2015-10-09 16:07:51,676] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,948:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,948:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,949:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,950:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,950:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,951:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,951:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,951:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,952:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,952:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:51 master-01 marathon[20175]: 2015-10-09 16:07:51,952:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:51 master-01 mesos-master[11603]: 2015-10-09 16:07:51,953:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,011] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,012] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,013] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,338:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,339:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,339:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,339:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,340:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,341:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,341:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,342:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,341:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,342:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:52 master-01 mesos-master[11603]: 2015-10-09 16:07:52,343:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 marathon[20175]: 2015-10-09 16:07:52,345:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,376] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,377] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,378] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,637] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,638] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:52 master-01 marathon[20175]: [2015-10-09 16:07:52,639] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,278:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,278:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,279:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,280:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,280:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,280:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,281:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,281:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,281:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,281:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,282:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 mesos-master[11603]: 2015-10-09 16:07:53,282:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:53 master-01 marathon[20175]: [2015-10-09 16:07:53,366] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:53 master-01 marathon[20175]: [2015-10-09 16:07:53,367] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:53 master-01 marathon[20175]: [2015-10-09 16:07:53,369] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,255] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,256] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,257] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,596] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,598] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,599] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,709] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,709] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:54 master-01 marathon[20175]: [2015-10-09 16:07:54,710] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,288:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,289:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,289:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,290:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,290:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,290:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,291:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,291:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,292:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,292:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,292:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,293:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,463] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,464] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,465] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,678:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,680:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,680:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,680:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,681:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,681:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,681:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,681:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,682:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 mesos-master[11603]: 2015-10-09 16:07:55,682:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,683:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:55 master-01 marathon[20175]: 2015-10-09 16:07:55,684:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,840] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,841] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:55 master-01 marathon[20175]: [2015-10-09 16:07:55,841] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,618:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,619:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,620:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,620:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,621:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,621:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,621:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,621:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,622:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,622:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,623:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 mesos-master[11603]: 2015-10-09 16:07:56,623:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:56 master-01 marathon[20175]: [2015-10-09 16:07:56,810] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:56 master-01 marathon[20175]: [2015-10-09 16:07:56,812] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:56 master-01 marathon[20175]: [2015-10-09 16:07:56,813] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,094] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,095] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,096] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,100] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,101] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,102] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,912] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,913] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:57 master-01 marathon[20175]: [2015-10-09 16:07:57,914] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,137] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,139] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,140] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,629:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,629:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,629:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,630:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,631:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,631:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,631:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,632:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,633:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,633:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:58 master-01 marathon[20175]: 2015-10-09 16:07:58,633:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 mesos-master[11603]: 2015-10-09 16:07:58,634:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,759] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,760] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:58 master-01 marathon[20175]: [2015-10-09 16:07:58,761] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,019:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,020:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,020:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,020:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,021:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,021:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,021:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,021:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,022:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,022:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,023:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:59 master-01 marathon[20175]: 2015-10-09 16:07:59,024:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 marathon[20175]: [2015-10-09 16:07:59,801] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:07:59 master-01 marathon[20175]: [2015-10-09 16:07:59,807] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:07:59 master-01 marathon[20175]: [2015-10-09 16:07:59,807] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,958:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,958:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,960:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,960:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,960:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,960:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,960:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,961:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,961:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,961:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,962:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:07:59 master-01 mesos-master[11603]: 2015-10-09 16:07:59,962:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,611] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,613] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,613] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,842] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,843] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,844] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,866] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,867] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:00 master-01 marathon[20175]: [2015-10-09 16:08:00,867] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:01 master-01 marathon[20175]: [2015-10-09 16:08:01,602] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:01 master-01 marathon[20175]: [2015-10-09 16:08:01,603] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:01 master-01 marathon[20175]: [2015-10-09 16:08:01,604] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,969:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,968:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,969:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,970:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,970:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,970:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,971:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,971:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,971:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,972:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:01 master-01 mesos-master[11603]: 2015-10-09 16:08:01,972:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:01 master-01 marathon[20175]: 2015-10-09 16:08:01,972:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,125] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,126] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,128] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,358:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,359:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,360:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,360:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,360:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,360:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,361:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,361:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,361:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,361:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:02 master-01 mesos-master[11603]: 2015-10-09 16:08:02,362:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: 2015-10-09 16:08:02,362:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,577] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,578] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,579] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,858] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,859] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:02 master-01 marathon[20175]: [2015-10-09 16:08:02,862] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,298:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,298:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,299:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,299:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,299:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,300:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,300:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,300:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,300:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,300:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,301:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 mesos-master[11603]: 2015-10-09 16:08:03,301:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,598] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,599] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,600] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,719] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,720] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:03 master-01 marathon[20175]: [2015-10-09 16:08:03,721] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,647] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,648] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,649] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,823] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,824] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:04 master-01 marathon[20175]: [2015-10-09 16:08:04,825] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,309:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,309:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,309:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,310:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,310:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,310:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,310:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,311:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,311:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,311:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,311:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,312:20175(0x7fe33ee11700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,410] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,410] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,411] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,698:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,699:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,699:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,699:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,700:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,700:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,700:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,701:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,701:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,701:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:05 master-01 mesos-master[11603]: 2015-10-09 16:08:05,702:11603(0x7f51ee7fc700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: 2015-10-09 16:08:05,702:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,744] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,744] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:05 master-01 marathon[20175]: [2015-10-09 16:08:05,745] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,638:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,638:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,639:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,639:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,639:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,639:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,640:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,640:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,640:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,640:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,641:11603(0x7f520e06b700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.49:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 mesos-master[11603]: 2015-10-09 16:08:06,641:11603(0x7f520c868700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.11:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,739] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,740] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,740] INFO Unable to read additional data from server sessionid 0x2504d38107b0017, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,752] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,753] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:06 master-01 marathon[20175]: [2015-10-09 16:08:06,754] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,051] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,052] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,053] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,670] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,671] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:07 master-01 marathon[20175]: [2015-10-09 16:08:07,671] INFO Unable to read additional data from server sessionid 0x15048f7d9560225, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,455] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,456] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,457] INFO Unable to reconnect to ZooKeeper service, session 0x2504d38107b0017 has expired, closing socket connection (org.apache.zookeeper.ClientCnxn:1094)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,458] INFO Zookeeper session expired. Event: WatchedEvent state:Expired type:None path:null (com.twitter.common.zookeeper.ZooKeeperClient:369)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,458] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn:512)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,458] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,458] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,458] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,459] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,459] INFO Initiating client connection, connectString=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=com.twitter.common.zookeeper.ZooKeeperClient$3@5faaed7 (org.apache.zookeeper.ZooKeeper:438)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,471] INFO Opening socket connection to server master-03.channelmeter.com/10.129.196.55:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,471] INFO Socket connection established to master-03.channelmeter.com/10.129.196.55:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:08 master-01 marathon[20175]: [2015-10-09 16:08:08,472] INFO Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:1098)
Oct 9 16:08:08 master-01 marathon[20175]: 2015-10-09 16:08:08,648:20175(0x7fe33ee11700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:08 master-01 mesos-master[11603]: 2015-10-09 16:08:08,648:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:08 master-01 mesos-master[11603]: 2015-10-09 16:08:08,649:11603(0x7f51eeffd700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:08 master-01 mesos-master[11603]: 2015-10-09 16:08:08,649:11603(0x7f51eeffd700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:08 master-01 marathon[20175]: 2015-10-09 16:08:08,654:20175(0x7fe33ee11700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.49:2181], sessionId=0x1504d5c03a10008, negotiated timeout=10000
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.655212 20240 group.cpp:313] Group process (group(8)@10.129.196.49:44385) connected to ZooKeeper
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.655242 20240 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.655252 20240 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
Oct 9 16:08:08 master-01 mesos-master[11603]: 2015-10-09 16:08:08,658:11603(0x7f51eeffd700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.11:2181], sessionId=0x2504d5c02dd0009, negotiated timeout=10000
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.658854 11625 group.cpp:313] Group process (group(4)@10.129.196.49:5050) connected to ZooKeeper
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.658936 11625 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.658956 11625 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.660370 11625 detector.cpp:138] Detected a new leader: (id='911')
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.660475 11625 group.cpp:659] Trying to get '/mesos/info_0000000911' in ZooKeeper
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.661088 20240 detector.cpp:138] Detected a new leader: (id='911')
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.661162 20240 group.cpp:659] Trying to get '/mesos/info_0000000911' in ZooKeeper
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.661547 11625 detector.cpp:452] A new leading master (UPID=master@10.129.196.55:5050) is detected
Oct 9 16:08:08 master-01 mesos-master[11603]: I1009 16:08:08.661612 11625 master.cpp:1356] The newly elected leader is master@10.129.196.55:5050 with id 20151009-073103-935624970-5050-18156
Oct 9 16:08:08 master-01 marathon[20175]: I1009 16:08:08.662240 20240 detector.cpp:452] A new leading master (UPID=master@10.129.196.55:5050) is detected
Oct 9 16:08:09 master-01 mesos-master[11603]: 2015-10-09 16:08:09,038:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:09 master-01 marathon[20175]: 2015-10-09 16:08:09,039:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:09 master-01 marathon[20175]: 2015-10-09 16:08:09,039:20175(0x7fe33e40e700):ZOO_ERROR@handle_socket_error_msg@1721: Socket [10.129.196.55:2181] zk retcode=-4, errno=112(Host is down): failed while receiving a server response
Oct 9 16:08:09 master-01 marathon[20175]: 2015-10-09 16:08:09,040:20175(0x7fe33e40e700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:09 master-01 mesos-master[11603]: 2015-10-09 16:08:09,047:11603(0x7f51ee7fc700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.49:2181], sessionId=0x1504d5c03a1000b, negotiated timeout=10000
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.048370 11625 group.cpp:313] Group process (group(3)@10.129.196.49:5050) connected to ZooKeeper
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.048506 11625 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (1, 0, 0)
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.048550 11625 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
Oct 9 16:08:09 master-01 marathon[20175]: 2015-10-09 16:08:09,049:20175(0x7fe33e40e700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.49:2181], sessionId=0x1504d5c03a1000c, negotiated timeout=10000
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.049994 20240 group.cpp:313] Group process (group(9)@10.129.196.49:44385) connected to ZooKeeper
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.050031 20240 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.050050 20240 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.058517 20240 detector.cpp:138] Detected a new leader: (id='911')
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.058708 20240 group.cpp:659] Trying to get '/mesos/info_0000000911' in ZooKeeper
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.063848 11619 contender.cpp:247] New candidate (id='915') has entered the contest for leadership
Oct 9 16:08:09 master-01 marathon[20175]: I1009 16:08:09.064824 20237 detector.cpp:452] A new leading master (UPID=master@10.129.196.55:5050) is detected
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,454] INFO Opening socket connection to server master-01.channelmeter.com/10.129.196.49:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,455] INFO Socket connection established to master-01.channelmeter.com/10.129.196.49:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,507] INFO Session establishment complete on server master-01.channelmeter.com/10.129.196.49:2181, sessionid = 0x1504d5c03a10015, negotiated timeout = 10000 (org.apache.zookeeper.ClientCnxn:1235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,544] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,544] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,544] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,545] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,549] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,549] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,549] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,550] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,551] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,551] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,552] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,552] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,552] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,553] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,553] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,553] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,554] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,554] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,554] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,557] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,557] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,557] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,557] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,563] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,563] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,563] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,563] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,564] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,564] WARN All candidates have temporarily left the group: Group /marathon/leader (com.twitter.common.zookeeper.CandidateImpl:142)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,601] INFO Opening socket connection to server master-02.channelmeter.com/10.129.196.11:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:975)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,602] INFO Socket connection established to master-02.channelmeter.com/10.129.196.11:2181, initiating session (org.apache.zookeeper.ClientCnxn:852)
Oct 9 16:08:09 master-01 marathon[20175]: [2015-10-09 16:08:09,604] INFO Session establishment complete on server master-02.channelmeter.com/10.129.196.11:2181, sessionid = 0x15048f7d9560225, negotiated timeout = 40000 (org.apache.zookeeper.ClientCnxn:1235)
Oct 9 16:08:09 master-01 mesos-master[11603]: 2015-10-09 16:08:09,978:11603(0x7f520c868700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.49:2181]
Oct 9 16:08:09 master-01 mesos-master[11603]: 2015-10-09 16:08:09,978:11603(0x7f520e06b700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.55:2181]
Oct 9 16:08:09 master-01 mesos-master[11603]: 2015-10-09 16:08:09,990:11603(0x7f520e06b700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.55:2181], sessionId=0x3504d5c02eb0002, negotiated timeout=10000
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.990717 11619 group.cpp:313] Group process (group(2)@10.129.196.49:5050) connected to ZooKeeper
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.990795 11619 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (1, 0, 0)
Oct 9 16:08:09 master-01 mesos-master[11603]: I1009 16:08:09.990816 11619 group.cpp:385] Trying to create path '/mesos/log_replicas' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: 2015-10-09 16:08:10,005:11603(0x7f520c868700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.49:2181], sessionId=0x1504d5c03a10019, negotiated timeout=10000
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.005854 11624 group.cpp:313] Group process (group(1)@10.129.196.49:5050) connected to ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.005934 11624 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.005954 11624 group.cpp:385] Trying to create path '/mesos/log_replicas' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.007297 11624 network.hpp:424] ZooKeeper group memberships changed
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.007393 11624 group.cpp:659] Trying to get '/mesos/log_replicas/0000000870' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.008004 11624 network.hpp:466] ZooKeeper group PIDs: { log-replica(1)@10.129.196.55:5050 }
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.020472 11620 network.hpp:424] ZooKeeper group memberships changed
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.020630 11620 group.cpp:659] Trying to get '/mesos/log_replicas/0000000870' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.021280 11620 group.cpp:659] Trying to get '/mesos/log_replicas/0000000871' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.022091 11620 network.hpp:466] ZooKeeper group PIDs: { log-replica(1)@10.129.196.49:5050, log-replica(1)@10.129.196.55:5050 }
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.040686 11621 network.hpp:424] ZooKeeper group memberships changed
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.040863 11621 group.cpp:659] Trying to get '/mesos/log_replicas/0000000870' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.041621 11621 group.cpp:659] Trying to get '/mesos/log_replicas/0000000871' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.042067 11621 group.cpp:659] Trying to get '/mesos/log_replicas/0000000872' in ZooKeeper
Oct 9 16:08:10 master-01 mesos-master[11603]: I1009 16:08:10.042521 11621 network.hpp:466] ZooKeeper group PIDs: { log-replica(1)@10.129.196.11:5050, log-replica(1)@10.129.196.49:5050, log-replica(1)@10.129.196.55:5050 }
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,331] INFO Membership already cancelled, node at path: /marathon/leader/member_0000000809 has been deleted (com.twitter.common.zookeeper.Group:379)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,331] INFO Will offer leadership after 500 milliseconds backoff (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:332)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,332] INFO Defeated (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:235)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,332] INFO Defeat leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:280)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,332] INFO Now standing by. Closing existing handles and rejecting new. (mesosphere.marathon.event.http.HttpEventStreamActor:96)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,333] INFO Stopping driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:224)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,336] WARN All candidates have temporarily left the group: Group /marathon/leader (com.twitter.common.zookeeper.CandidateImpl:142)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,849] INFO Using HA and therefore offering leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:339)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,853] ERROR Current member ID member_0000000804 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,857] ERROR Current member ID member_0000000805 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,857] ERROR Current member ID member_0000000802 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,858] ERROR Current member ID member_0000000801 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,858] ERROR Current member ID member_0000000808 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,859] ERROR Current member ID member_0000000809 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,859] ERROR Current member ID member_0000000803 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,860] ERROR Current member ID member_0000000806 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,860] ERROR Current member ID member_0000000807 is not a candidate for leader, current voting: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:144)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,864] INFO Set group member ID to member_0000000810 (com.twitter.common.zookeeper.Group:426)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,867] INFO Candidate /marathon/leader/member_0000000810 is now leader of group: [member_0000000810] (com.twitter.common.zookeeper.CandidateImpl:152)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,868] INFO Elected (Leader Interface) (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:244)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,884] INFO Migration successfully applied for version Version(0, 11, 0) (mesosphere.marathon.state.Migration:85)
Oct 9 16:08:11 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:11.884] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/taskStatusUpdate/7] Starting class mesosphere.marathon.core.task.tracker.impl.TaskStatusUpdateActor
Oct 9 16:08:11 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:11.885] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/rateLimiter/7] started RateLimiterActor
Oct 9 16:08:11 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:11.885] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/leaderShipCoordinator] All actors active:
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/rateLimiter#-736850290]
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/offerMatcherLaunchTokens#550536420]
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/launchQueue#-1740320890]
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/killOverdueStagedTasks#1084734318]
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/offerMatcherManager#2022947207]
Oct 9 16:08:11 master-01 marathon[20175]: * Actor[akka://marathon/user/taskStatusUpdate#1214885755]
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,886] INFO Elect leadership (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:295)
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,887] INFO Running driver (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:187)
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.887794 12447 sched.cpp:157] Version: 0.22.1
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@716: Client environment:host.name=master-01
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-45-generic
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@725: Client environment:os.version=#74-Ubuntu SMP Tue Jan 13 19:36:28 UTC 2015
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@733: Client environment:user.name=(null)
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@741: Client environment:user.home=/root
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@log_env@753: Client environment:user.dir=/
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,888:20175(0x7fe34574e700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=zoo1:2181,zoo2:2181,zoo3:2181 sessionTimeout=10000 watcher=0x7fe34b2a8a60 sessionId=0 sessionPasswd=<null> context=0x114e430 flags=0
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,889] INFO Became active. Accepting event streaming requests. (mesosphere.marathon.event.http.HttpEventStreamActor:101)
Oct 9 16:08:11 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:11.889] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/MarathonScheduler/$a] Starting scheduler actor
Oct 9 16:08:11 master-01 marathon[20175]: [2015-10-09 16:08:11,890] INFO Reset offerLeadership backoff (mesosphere.marathon.MarathonSchedulerService$$EnhancerByGuice$$42b13787:327)
Oct 9 16:08:11 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:11.892] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/MarathonScheduler/$a] Scheduler actor ready
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,899:20175(0x7fe342039700):ZOO_INFO@check_events@1703: initiated connection to server [10.129.196.11:2181]
Oct 9 16:08:11 master-01 marathon[20175]: 2015-10-09 16:08:11,903:20175(0x7fe342039700):ZOO_INFO@check_events@1750: session establishment complete on server [10.129.196.11:2181], sessionId=0x2504d5c02dd0014, negotiated timeout=10000
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.904172 20238 group.cpp:313] Group process (group(10)@10.129.196.49:44385) connected to ZooKeeper
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.904204 20238 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0)
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.904214 20238 group.cpp:385] Trying to create path '/mesos' in ZooKeeper
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.905916 20238 detector.cpp:138] Detected a new leader: (id='911')
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.906002 20238 group.cpp:659] Trying to get '/mesos/info_0000000911' in ZooKeeper
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.906702 20238 detector.cpp:452] A new leading master (UPID=master@10.129.196.55:5050) is detected
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.906752 20238 sched.cpp:254] New master detected at master@10.129.196.55:5050
Oct 9 16:08:11 master-01 marathon[20175]: I1009 16:08:11.906913 20238 sched.cpp:264] No credentials provided. Attempting to register without authentication
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,190] INFO Adding health check for app [/phantom] and version [2015-06-13T01:24:28.535Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.191] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ne] Starting health check actor for app [/phantom] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,191] INFO Adding health check for app [/web-staging] and version [2015-10-08T20:36:18.604Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,192] INFO Adding health check for app [/chatd] and version [2015-10-03T05:04:52.603Z]: [HealthCheck(Some(/v1/self),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,192] INFO Adding health check for app [/geard] and version [2015-10-08T19:54:01.809Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,192] INFO Adding health check for app [/geard] and version [2015-10-08T19:21:00.379Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,193] INFO Adding health check for app [/rank] and version [2015-09-05T00:45:16.537Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,193] INFO Adding health check for app [/api] and version [2015-10-07T22:18:43.603Z]: [HealthCheck(Some(/REVISION),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [2015-10-09 16:08:12,193] INFO Adding health check for app [/web-prod] and version [2015-10-08T20:40:08.189Z]: [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Oe] Starting health check actor for app [/web-staging] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Pe] Starting health check actor for app [/chatd] and healthCheck [HealthCheck(Some(/v1/self),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Qe] Starting health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Re] Starting health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Se] Starting health check actor for app [/rank] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Te] Starting health check actor for app [/api] and healthCheck [HealthCheck(Some(/REVISION),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:12.194] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Ue] Starting health check actor for app [/web-prod] and healthCheck [HealthCheck(Some(/health-check),HTTP,0,None,5 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.011065 11624 detector.cpp:138] Detected a new leader: (id='914')
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.011246 11624 group.cpp:659] Trying to get '/mesos/info_0000000914' in ZooKeeper
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.013267 11624 detector.cpp:452] A new leading master (UPID=master@10.129.196.11:5050) is detected
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.013355 11624 master.cpp:1356] The newly elected leader is master@10.129.196.11:5050 with id 20151008-190321-197427466-5050-2990
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.014940 20238 detector.cpp:138] Detected a new leader: (id='914')
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.015045 20238 group.cpp:659] Trying to get '/mesos/info_0000000914' in ZooKeeper
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.015416 20240 detector.cpp:138] Detected a new leader: (id='914')
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.015475 20240 group.cpp:659] Trying to get '/mesos/info_0000000914' in ZooKeeper
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.016182 20240 detector.cpp:452] A new leading master (UPID=master@10.129.196.11:5050) is detected
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.016420 20234 detector.cpp:138] Detected a new leader: (id='914')
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.016477 20234 group.cpp:659] Trying to get '/mesos/info_0000000914' in ZooKeeper
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.016767 20238 detector.cpp:452] A new leading master (UPID=master@10.129.196.11:5050) is detected
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.017504 11624 replica.cpp:477] Replica received implicit promise request with proposal 6586
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.017565 11624 replica.cpp:482] Replica denying promise request with proposal 6586
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.018122 20234 detector.cpp:452] A new leading master (UPID=master@10.129.196.11:5050) is detected
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.018180 20234 sched.cpp:254] New master detected at master@10.129.196.11:5050
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.018342 20234 sched.cpp:264] No credentials provided. Attempting to register without authentication
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.026958 11624 replica.cpp:477] Replica received implicit promise request with proposal 6587
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.553725 11624 leveldb.cpp:306] Persisting metadata (9 bytes) to leveldb took 526.645996ms
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.553865 11624 replica.cpp:345] Persisted promised to 6587
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.553989 11624 replica.cpp:511] Replica received write request for position 13169
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.577824 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 23.777252ms
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.577941 11624 replica.cpp:679] Persisted action at 13169
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.578045 11624 replica.cpp:658] Replica received learned notice for position 13169
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.614732 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 36.615278ms
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.614856 11624 replica.cpp:679] Persisted action at 13169
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.614907 11624 replica.cpp:664] Replica learned APPEND action at position 13169
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.614948 11624 replica.cpp:511] Replica received write request for position 13170
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.771478 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 156.48637ms
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.771611 11624 replica.cpp:679] Persisted action at 13170
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.771751 11624 replica.cpp:658] Replica received learned notice for position 13170
Oct 9 16:08:18 master-01 marathon[20175]: I1009 16:08:18.893251 20234 sched.cpp:448] Framework registered with 20151002-220555-935624970-5050-17468-0000
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,893] INFO Registered as 20151002-220555-935624970-5050-17468-0000 to master '20151008-190321-197427466-5050-2990' (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:47)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,909] INFO Received status update for task geard.06301907-6e81-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,913] INFO Increasing delay. Task launch delay for [/geard] changed from [0 milliseconds] to [1 seconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,914] INFO Received status update for task geard.7bdb8139-6e9a-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,915] INFO Received status update for task web-prod.bcfd3dcb-6e9a-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 8) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,915] INFO Received status update for task geard.bcf43d1a-6e9a-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,916] INFO Received status update for task geard.062dcf15-6e81-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,916] INFO Received status update for task geard.75e244d8-6e9a-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,917] INFO Received status update for task web-prod.058fe160-6e81-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 8) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,917] INFO Received status update for task geard.059dc413-6e81-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,917] INFO Received status update for task geard.c1b6a72c-6e9a-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,918] INFO Task geard.06301907-6e81-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.919] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,922] INFO Need to scale /geard from 8 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,923] INFO Queueing 1 new tasks for /geard (8 queued or running) (mesosphere.marathon.SchedulerActions:520)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.924] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/launchQueue/7/0-geard] Started appTaskLaunchActor for /geard version 2015-10-08T19:54:01.809Z with initial count 1
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,934] INFO Task geard.7bdb8139-6e9a-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.935] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,938] INFO Received status update for task geard.062ee086-6e81-11e5-bd7a-00163e105035: TASK_FAILED (Command exited with status 1) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,949] INFO Task web-prod.bcfd3dcb-6e9a-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.950] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,951] INFO Increasing delay. Task launch delay for [/geard] changed from [962 milliseconds] to [1 seconds 150 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,952] INFO Increasing delay. Task launch delay for [/web-prod] changed from [0 milliseconds] to [1 seconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,952] INFO Increasing delay. Task launch delay for [/geard] changed from [1 seconds 149 milliseconds] to [1 seconds 322 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,952] INFO Increasing delay. Task launch delay for [/geard] changed from [1 seconds 322 milliseconds] to [1 seconds 520 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,952] INFO Increasing delay. Task launch delay for [/geard] changed from [1 seconds 520 milliseconds] to [1 seconds 749 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,954] INFO Need to scale /web-prod from 1 up to 2 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,956] INFO Queueing 1 new tasks for /web-prod (1 queued or running) (mesosphere.marathon.SchedulerActions:520)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.957] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/launchQueue/7/1-web-prod] Started appTaskLaunchActor for /web-prod version 2015-10-08T20:40:08.189Z with initial count 1
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,958] INFO Increasing delay. Task launch delay for [/web-prod] changed from [994 milliseconds] to [1 seconds 150 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,958] INFO Increasing delay. Task launch delay for [/geard] changed from [1 seconds 743 milliseconds] to [2 seconds 11 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,958] INFO Increasing delay. Task launch delay for [/geard] changed from [2 seconds 11 milliseconds] to [2 seconds 313 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,962] INFO Increasing delay. Task launch delay for [/geard] changed from [2 seconds 309 milliseconds] to [2 seconds 660 milliseconds]. (mesosphere.marathon.core.launchqueue.impl.RateLimiter$:52)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,967] INFO Task geard.bcf43d1a-6e9a-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.968] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,971] INFO Need to scale /geard from 6 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,971] INFO Queueing 2 new tasks for /geard (7 queued or running) (mesosphere.marathon.SchedulerActions:520)
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.973357 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 201.542616ms
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.973557 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 66559ns
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.973613 11624 replica.cpp:679] Persisted action at 13170
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.973655 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13170
Oct 9 16:08:18 master-01 mesos-master[11603]: I1009 16:08:18.973731 11624 replica.cpp:511] Replica received write request for position 13171
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,980] INFO Task geard.062dcf15-6e81-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:18 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:18.981] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,987] INFO Need to scale /geard from 5 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:18 master-01 marathon[20175]: [2015-10-09 16:08:18,988] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:18,999] INFO Task geard.75e244d8-6e9a-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:19.000] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,002] INFO Need to scale /geard from 4 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,003] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,014] INFO Task web-prod.058fe160-6e81-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:19.015] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,016] INFO Need to scale /web-prod from 0 up to 2 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,017] INFO Already queued or started 2 tasks for /web-prod. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,031] INFO Task geard.059dc413-6e81-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:19.032] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,034] INFO Need to scale /geard from 3 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,035] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,045] INFO Task geard.c1b6a72c-6e9a-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:19.046] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,047] INFO Need to scale /geard from 2 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,048] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,061] INFO Task geard.062ee086-6e81-11e5-bd7a-00163e105035 expunged and removed from TaskTracker (mesosphere.marathon.tasks.TaskTracker$$EnhancerByGuice$$abd67fd2:111)
Oct 9 16:08:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:19.061] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/taskStatusUpdate/7] Sending event notification.
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,063] INFO Need to scale /geard from 1 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:19 master-01 marathon[20175]: [2015-10-09 16:08:19,064] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.345389 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 371.590576ms
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.345517 11624 replica.cpp:679] Persisted action at 13171
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.345648 11624 replica.cpp:658] Replica received learned notice for position 13171
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.956719 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 610.99643ms
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.956910 11624 replica.cpp:679] Persisted action at 13171
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.956949 11624 replica.cpp:664] Replica learned APPEND action at position 13171
Oct 9 16:08:19 master-01 mesos-master[11603]: I1009 16:08:19.956993 11624 replica.cpp:511] Replica received write request for position 13172
Oct 9 16:08:20 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:20.128] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/offerMatcherManager/7] activating matcher ActorOfferMatcher(Actor[akka://marathon/user/launchQueue/7/1-web-prod#424130966]).
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.283267 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 326.224302ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.283439 11624 replica.cpp:679] Persisted action at 13172
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.283596 11624 replica.cpp:658] Replica received learned notice for position 13172
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.362648 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 78.994248ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.362967 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 56926ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.363178 11624 replica.cpp:679] Persisted action at 13172
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.363428 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13172
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.363519 11624 replica.cpp:511] Replica received write request for position 13173
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.401511 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 37.875017ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.401916 11624 replica.cpp:679] Persisted action at 13173
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.402165 11624 replica.cpp:658] Replica received learned notice for position 13173
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.438016 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 35.722628ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.438478 11624 replica.cpp:679] Persisted action at 13173
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.438623 11624 replica.cpp:664] Replica learned APPEND action at position 13173
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.438815 11624 replica.cpp:511] Replica received write request for position 13174
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.474990 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 35.9345ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.475412 11624 replica.cpp:679] Persisted action at 13174
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.475666 11624 replica.cpp:658] Replica received learned notice for position 13174
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.496424 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 20.466523ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.496891 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 56927ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.497099 11624 replica.cpp:679] Persisted action at 13174
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.497231 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13174
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.497364 11624 replica.cpp:511] Replica received write request for position 13175
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.525754 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 28.209562ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.526139 11624 replica.cpp:679] Persisted action at 13175
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.526487 11624 replica.cpp:658] Replica received learned notice for position 13175
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.563261 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 36.568708ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.563659 11624 replica.cpp:679] Persisted action at 13175
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.563776 11624 replica.cpp:664] Replica learned APPEND action at position 13175
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.563917 11624 replica.cpp:511] Replica received write request for position 13176
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.598254 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 34.171233ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.598644 11624 replica.cpp:679] Persisted action at 13176
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.599004 11624 replica.cpp:658] Replica received learned notice for position 13176
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.618736 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 19.601563ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.619187 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 54080ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.619321 11624 replica.cpp:679] Persisted action at 13176
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.619437 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13176
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.619583 11624 replica.cpp:511] Replica received write request for position 13177
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.641145 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 21.368782ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.641517 11624 replica.cpp:679] Persisted action at 13177
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.641865 11624 replica.cpp:658] Replica received learned notice for position 13177
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.664654 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 22.646861ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.665040 11624 replica.cpp:679] Persisted action at 13177
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.665143 11624 replica.cpp:664] Replica learned APPEND action at position 13177
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.665285 11624 replica.cpp:511] Replica received write request for position 13178
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.682044 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 16.632321ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.682425 11624 replica.cpp:679] Persisted action at 13178
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.682770 11624 replica.cpp:658] Replica received learned notice for position 13178
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.696224 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 13.293404ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.696620 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 54701ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.696898 11624 replica.cpp:679] Persisted action at 13178
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.697013 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13178
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.697142 11624 replica.cpp:511] Replica received write request for position 13179
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.709219 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 11.95125ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.709429 11624 replica.cpp:679] Persisted action at 13179
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.709771 11624 replica.cpp:658] Replica received learned notice for position 13179
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.732377 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 22.425274ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.732785 11624 replica.cpp:679] Persisted action at 13179
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.732906 11624 replica.cpp:664] Replica learned APPEND action at position 13179
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.733044 11624 replica.cpp:511] Replica received write request for position 13180
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.792088 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 58.913049ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.792528 11624 replica.cpp:679] Persisted action at 13180
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.792923 11624 replica.cpp:658] Replica received learned notice for position 13180
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.806665 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 13.593699ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.807065 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 49097ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.807219 11624 replica.cpp:679] Persisted action at 13180
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.807332 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13180
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.807471 11624 replica.cpp:511] Replica received write request for position 13181
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.825093 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 17.477431ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.825460 11624 replica.cpp:679] Persisted action at 13181
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.825839 11624 replica.cpp:658] Replica received learned notice for position 13181
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.828728 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 2.777693ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.828863 11624 replica.cpp:679] Persisted action at 13181
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.828963 11624 replica.cpp:664] Replica learned APPEND action at position 13181
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.829072 11624 replica.cpp:511] Replica received write request for position 13182
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.834098 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.920868ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.834259 11624 replica.cpp:679] Persisted action at 13182
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.834488 11624 replica.cpp:658] Replica received learned notice for position 13182
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.841946 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 7.331981ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.842229 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 38902ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.842377 11624 replica.cpp:679] Persisted action at 13182
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.842483 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13182
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.842607 11624 replica.cpp:511] Replica received write request for position 13183
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.851187 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 8.40134ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.851435 11624 replica.cpp:679] Persisted action at 13183
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.851776 11624 replica.cpp:658] Replica received learned notice for position 13183
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.856998 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 5.067444ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.857250 11624 replica.cpp:679] Persisted action at 13183
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.857421 11624 replica.cpp:664] Replica learned APPEND action at position 13183
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.857620 11624 replica.cpp:511] Replica received write request for position 13184
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.865437 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 7.641733ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.865785 11624 replica.cpp:679] Persisted action at 13184
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.866246 11624 replica.cpp:658] Replica received learned notice for position 13184
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.874622 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 8.183565ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.874903 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 60699ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.875017 11624 replica.cpp:679] Persisted action at 13184
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.875224 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13184
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.875361 11624 replica.cpp:511] Replica received write request for position 13185
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.881834 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 6.348551ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.882005 11624 replica.cpp:679] Persisted action at 13185
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.882323 11624 replica.cpp:658] Replica received learned notice for position 13185
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.889421 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 6.956582ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.889593 11624 replica.cpp:679] Persisted action at 13185
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.889698 11624 replica.cpp:664] Replica learned APPEND action at position 13185
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.889833 11624 replica.cpp:511] Replica received write request for position 13186
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.896863 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 6.5183ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.897078 11624 replica.cpp:679] Persisted action at 13186
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.897452 11624 replica.cpp:658] Replica received learned notice for position 13186
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.903167 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.578841ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.903419 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 30894ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.903529 11624 replica.cpp:679] Persisted action at 13186
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.903642 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13186
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.903759 11624 replica.cpp:511] Replica received write request for position 13187
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.912272 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 8.372129ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.912472 11624 replica.cpp:679] Persisted action at 13187
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.912798 11624 replica.cpp:658] Replica received learned notice for position 13187
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.917474 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.538332ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.917629 11624 replica.cpp:679] Persisted action at 13187
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.917729 11624 replica.cpp:664] Replica learned APPEND action at position 13187
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.917840 11624 replica.cpp:511] Replica received write request for position 13188
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.923651 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 5.709281ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.923861 11624 replica.cpp:679] Persisted action at 13188
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.924185 11624 replica.cpp:658] Replica received learned notice for position 13188
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.929849 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.540186ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.930104 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 40893ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.930228 11624 replica.cpp:679] Persisted action at 13188
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.930331 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13188
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.930477 11624 replica.cpp:511] Replica received write request for position 13189
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.936184 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 5.533396ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.936372 11624 replica.cpp:679] Persisted action at 13189
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.936705 11624 replica.cpp:658] Replica received learned notice for position 13189
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.941375 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.549658ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.941524 11624 replica.cpp:679] Persisted action at 13189
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.941642 11624 replica.cpp:664] Replica learned APPEND action at position 13189
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.941759 11624 replica.cpp:511] Replica received write request for position 13190
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.947289 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 5.414952ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.947438 11624 replica.cpp:679] Persisted action at 13190
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.947731 11624 replica.cpp:658] Replica received learned notice for position 13190
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.953398 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.549921ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.953745 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 49695ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.953896 11624 replica.cpp:679] Persisted action at 13190
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.954260 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13190
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.954418 11624 replica.cpp:511] Replica received write request for position 13191
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.960453 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 5.883436ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.960631 11624 replica.cpp:679] Persisted action at 13191
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.960927 11624 replica.cpp:658] Replica received learned notice for position 13191
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.969019 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 7.96114ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.969255 11624 replica.cpp:679] Persisted action at 13191
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.969362 11624 replica.cpp:664] Replica learned APPEND action at position 13191
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.969482 11624 replica.cpp:511] Replica received write request for position 13192
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.974063 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.464448ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.974236 11624 replica.cpp:679] Persisted action at 13192
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.974555 11624 replica.cpp:658] Replica received learned notice for position 13192
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.980135 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.452613ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.980315 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 29507ns
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.980429 11624 replica.cpp:679] Persisted action at 13192
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.980527 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13192
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.980659 11624 replica.cpp:511] Replica received write request for position 13193
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.985474 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 4.696951ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.985719 11624 replica.cpp:679] Persisted action at 13193
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.986138 11624 replica.cpp:658] Replica received learned notice for position 13193
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.991147 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.821255ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.991487 11624 replica.cpp:679] Persisted action at 13193
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.991652 11624 replica.cpp:664] Replica learned APPEND action at position 13193
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.991832 11624 replica.cpp:511] Replica received write request for position 13194
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.996640 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.621669ms
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.996848 11624 replica.cpp:679] Persisted action at 13194
Oct 9 16:08:20 master-01 mesos-master[11603]: I1009 16:08:20.997272 11624 replica.cpp:658] Replica received learned notice for position 13194
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.002048 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 4.607521ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.002382 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 43186ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.002558 11624 replica.cpp:679] Persisted action at 13194
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.002722 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13194
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.002938 11624 replica.cpp:511] Replica received write request for position 13195
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.009044 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 5.891661ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.009306 11624 replica.cpp:679] Persisted action at 13195
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.009692 11624 replica.cpp:658] Replica received learned notice for position 13195
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.014459 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.591504ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.014706 11624 replica.cpp:679] Persisted action at 13195
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.014895 11624 replica.cpp:664] Replica learned APPEND action at position 13195
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.015066 11624 replica.cpp:511] Replica received write request for position 13196
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.020759 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 5.537799ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.021051 11624 replica.cpp:679] Persisted action at 13196
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.021479 11624 replica.cpp:658] Replica received learned notice for position 13196
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.026741 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.093554ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.027138 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 54428ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.027295 11624 replica.cpp:679] Persisted action at 13196
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.027447 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13196
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.027771 11624 replica.cpp:511] Replica received write request for position 13197
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.032778 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 4.782547ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.033010 11624 replica.cpp:679] Persisted action at 13197
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.033421 11624 replica.cpp:658] Replica received learned notice for position 13197
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.038487 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.881828ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.038697 11624 replica.cpp:679] Persisted action at 13197
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.038849 11624 replica.cpp:664] Replica learned APPEND action at position 13197
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.039047 11624 replica.cpp:511] Replica received write request for position 13198
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.044114 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.907123ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.044381 11624 replica.cpp:679] Persisted action at 13198
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.044787 11624 replica.cpp:658] Replica received learned notice for position 13198
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.050369 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.423407ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.050776 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 53147ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.051038 11624 replica.cpp:679] Persisted action at 13198
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.051201 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13198
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.051380 11624 replica.cpp:511] Replica received write request for position 13199
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.057459 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 5.878964ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.057701 11624 replica.cpp:679] Persisted action at 13199
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.058145 11624 replica.cpp:658] Replica received learned notice for position 13199
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.063412 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 5.0519ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.063673 11624 replica.cpp:679] Persisted action at 13199
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.063823 11624 replica.cpp:664] Replica learned APPEND action at position 13199
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.064007 11624 replica.cpp:511] Replica received write request for position 13200
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.068831 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.670255ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.069067 11624 replica.cpp:679] Persisted action at 13200
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.069492 11624 replica.cpp:658] Replica received learned notice for position 13200
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.074278 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 4.603446ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.074453 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 30849ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.074561 11624 replica.cpp:679] Persisted action at 13200
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.074671 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13200
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.074810 11624 replica.cpp:511] Replica received write request for position 13201
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.083124 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 8.154965ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.083360 11624 replica.cpp:679] Persisted action at 13201
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.083744 11624 replica.cpp:658] Replica received learned notice for position 13201
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.088752 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.825071ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.088942 11624 replica.cpp:679] Persisted action at 13201
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.089082 11624 replica.cpp:664] Replica learned APPEND action at position 13201
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.089237 11624 replica.cpp:511] Replica received write request for position 13202
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.093961 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.571868ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.094209 11624 replica.cpp:679] Persisted action at 13202
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.094516 11624 replica.cpp:658] Replica received learned notice for position 13202
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.100162 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 5.498071ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.100404 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 29385ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.100538 11624 replica.cpp:679] Persisted action at 13202
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.100646 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13202
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.100862 11624 replica.cpp:511] Replica received write request for position 13203
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.105825 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 4.791709ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.105996 11624 replica.cpp:679] Persisted action at 13203
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.106305 11624 replica.cpp:658] Replica received learned notice for position 13203
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.111145 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.671526ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.111313 11624 replica.cpp:679] Persisted action at 13203
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.111461 11624 replica.cpp:664] Replica learned APPEND action at position 13203
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.111604 11624 replica.cpp:511] Replica received write request for position 13204
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.116298 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.539753ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.116451 11624 replica.cpp:679] Persisted action at 13204
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.116678 11624 replica.cpp:658] Replica received learned notice for position 13204
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.121155 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 4.324143ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.121335 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 29158ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.121443 11624 replica.cpp:679] Persisted action at 13204
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.121541 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13204
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.121649 11624 replica.cpp:511] Replica received write request for position 13205
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.126178 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 4.392316ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.126310 11624 replica.cpp:679] Persisted action at 13205
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.126524 11624 replica.cpp:658] Replica received learned notice for position 13205
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.131242 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.585353ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.131377 11624 replica.cpp:679] Persisted action at 13205
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.131486 11624 replica.cpp:664] Replica learned APPEND action at position 13205
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.131605 11624 replica.cpp:511] Replica received write request for position 13206
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.136050 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.338535ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.136174 11624 replica.cpp:679] Persisted action at 13206
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.136366 11624 replica.cpp:658] Replica received learned notice for position 13206
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.140874 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 4.402741ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.141080 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 28166ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.141199 11624 replica.cpp:679] Persisted action at 13206
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.141299 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13206
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.141408 11624 replica.cpp:511] Replica received write request for position 13207
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.146219 11624 leveldb.cpp:343] Persisting action (4789 bytes) to leveldb took 4.684269ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.146502 11624 replica.cpp:679] Persisted action at 13207
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.146837 11624 replica.cpp:658] Replica received learned notice for position 13207
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.151649 11624 leveldb.cpp:343] Persisting action (4791 bytes) to leveldb took 4.635948ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.151834 11624 replica.cpp:679] Persisted action at 13207
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.151985 11624 replica.cpp:664] Replica learned APPEND action at position 13207
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.152139 11624 replica.cpp:511] Replica received write request for position 13208
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.156862 11624 leveldb.cpp:343] Persisting action (20 bytes) to leveldb took 4.600453ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.157021 11624 replica.cpp:679] Persisted action at 13208
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.157321 11624 replica.cpp:658] Replica received learned notice for position 13208
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.162060 11624 leveldb.cpp:343] Persisting action (22 bytes) to leveldb took 4.606733ms
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.162236 11624 leveldb.cpp:401] Deleting ~2 keys from leveldb took 29916ns
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.162341 11624 replica.cpp:679] Persisted action at 13208
Oct 9 16:08:21 master-01 mesos-master[11603]: I1009 16:08:21.162436 11624 replica.cpp:664] Replica learned TRUNCATE action at position 13208
Oct 9 16:08:21 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:21.638] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/offerMatcherManager/7] activating matcher ActorOfferMatcher(Actor[akka://marathon/user/launchQueue/7/0-geard#-2083958485]).
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.210] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:08:22.210Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.211] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:08:22.211Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.212] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Re] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:08:22.212Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.212] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:08:22.212Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.216] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:22.216Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.216] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:08:22.216Z)]
Oct 9 16:08:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:22.217] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:22.216Z)]
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,898] INFO Syncing tasks for all apps (mesosphere.marathon.SchedulerActions:442)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,900] INFO Requesting task reconciliation with the Mesos master (mesosphere.marathon.SchedulerActions:464)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,902] INFO Already running 1 instances of /web-staging. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,902] INFO Already running 1 instances of /rank. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,902] INFO Need to scale /geard from 1 up to 9 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,903] INFO Already queued or started 9 tasks for /geard. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,904] INFO Already running 1 instances of /cassandra-reaper. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,904] INFO Already running 0 instances of /redis. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,904] INFO Already running 0 instances of /feed-backup. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,904] INFO Already running 1 instances of /chronos. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,905] INFO Already running 2 instances of /kafka. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,905] INFO Already running 2 instances of /api. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,905] INFO Already running 1 instances of /mesos-dns. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,905] INFO Already running 0 instances of /atlas. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,906] INFO Already running 1 instances of /docker. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,906] INFO Already running 0 instances of /nginx-ops. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,906] INFO Already running 1 instances of /phantom. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,906] INFO Already running 1 instances of /caddy-ops. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Already running 0 instances of /nginx. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Already running 1 instances of /graphite. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Already running 1 instances of /mongo-mms-backup. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Need to scale /web-prod from 0 up to 2 instances (mesosphere.marathon.SchedulerActions:514)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Already running 1 instances of /jenkins. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,908] INFO Already running 1 instances of /redis-monitor-graphite. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,909] INFO Already queued or started 2 tasks for /web-prod. Not scaling. (mesosphere.marathon.SchedulerActions:524)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,909] INFO Already running 1 instances of /statsd. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 1 instances of /chatd. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 1 instances of /presto. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 1 instances of /adm1. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 0 instances of /docker-ui. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 1 instances of /caddy. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,911] INFO Already running 1 instances of /mongo-mms-agent. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,912] INFO Already running 1 instances of /pritunl. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,912] INFO Already running 1 instances of /elasticsearch. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,912] INFO Already running 1 instances of /opscenter. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,913] INFO Already running 1 instances of /metrics. Not scaling. (mesosphere.marathon.SchedulerActions:538)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,924] INFO Received status update for task phantom.e03fdbb9-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,925] INFO Received status update for task cassandra-reaper.de4594dd-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,925] INFO Received status update for task statsd.de30863b-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,926] INFO Received status update for task mesos-dns.e75e0d03-6987-11e5-9d7a-00163e105043: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,926] INFO Received status update for task elasticsearch.e6ec628c-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,929] INFO Received status update for task metrics.db03140a-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,931] INFO Received status update for task jenkins.a9c4006f-6bb7-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,933] INFO Removing health check for app [/geard] and version [2015-10-08T19:21:00.379Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:85)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,933] INFO Received status update for task caddy-ops.4144e505-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:26.934] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Re] Stopped health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,935] INFO Received status update for task web-staging.672656c6-6dfc-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,937] INFO Received status update for task docker.da4566d4-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,938] INFO Received status update for task geard.b5b916ae-6df1-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,940] INFO Received status update for task adm1.d80a91fd-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,942] INFO Received status update for task kafka.592fca1f-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,944] INFO Received status update for task pritunl.ed2da0a2-6c97-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,945] INFO Received status update for task caddy.d013d583-6cb1-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,946] INFO Received status update for task mongo-mms-agent.de36529c-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,948] INFO Received status update for task redis-monitor-graphite.de4d35fe-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,949] INFO Adding health check for app [/geard] and version [2015-10-08T19:21:00.379Z]: [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)] (mesosphere.marathon.health.MarathonHealthCheckManager$$EnhancerByGuice$$951a17e5:61)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,949] INFO Received status update for task api.02bfc725-6d42-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:26.950] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Ve] Starting health check actor for app [/geard] and healthCheck [HealthCheck(Some(/status/),HTTP,0,None,10 seconds,10 seconds,10 seconds,3,false)]
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,950] INFO Received status update for task kafka.59303f50-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,975] INFO Received status update for task api.d2d11e0c-6d41-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,976] INFO Received status update for task chatd.740f8449-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,976] INFO Received status update for task mongo-mms-backup.da4fa006-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,976] INFO Received status update for task opscenter.da4c92c5-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,977] INFO Received status update for task rank.e03f6688-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,977] INFO Received status update for task chronos.a193dbf6-6ddd-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,977] INFO Received status update for task graphite.de5ced70-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,977] INFO Received status update for task presto.afe7b8ff-6de7-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,977] INFO Received status update for task chronos.a193dbf6-6ddd-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,981] INFO Received status update for task docker.da4566d4-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,988] INFO Received status update for task opscenter.da4c92c5-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,994] INFO Received status update for task api.d2d11e0c-6d41-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:26 master-01 marathon[20175]: [2015-10-09 16:08:26,998] INFO Received status update for task rank.e03f6688-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:26,999] INFO Received status update for task caddy.d013d583-6cb1-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,002] INFO Received status update for task chatd.740f8449-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,004] INFO Received status update for task statsd.de30863b-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,007] INFO Received status update for task mongo-mms-agent.de36529c-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,011] INFO Received status update for task pritunl.ed2da0a2-6c97-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,014] INFO Received status update for task caddy-ops.4144e505-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,016] INFO Received status update for task phantom.e03fdbb9-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,018] INFO Received status update for task metrics.db03140a-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,019] INFO Received status update for task adm1.d80a91fd-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,021] INFO Received status update for task kafka.59303f50-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,022] INFO Received status update for task presto.afe7b8ff-6de7-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,024] INFO Received status update for task kafka.592fca1f-698c-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,026] INFO Received status update for task jenkins.a9c4006f-6bb7-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,027] INFO Received status update for task cassandra-reaper.de4594dd-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,029] INFO Received status update for task redis-monitor-graphite.de4d35fe-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,031] INFO Received status update for task api.02bfc725-6d42-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,032] INFO Received status update for task web-staging.672656c6-6dfc-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,034] INFO Received status update for task geard.b5b916ae-6df1-11e5-8632-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,036] INFO Received status update for task elasticsearch.e6ec628c-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,038] INFO Received status update for task graphite.de5ced70-698f-11e5-ac2e-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,039] INFO Received status update for task mongo-mms-backup.da4fa006-698b-11e5-8997-00163e105035: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:27 master-01 marathon[20175]: [2015-10-09 16:08:27,041] INFO Received status update for task mesos-dns.e75e0d03-6987-11e5-9d7a-00163e105043: TASK_RUNNING (Reconciliation: Latest task state) (mesosphere.marathon.MarathonScheduler$$EnhancerByGuice$$81466d20:75)
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.220] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:08:32.220Z)]
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.221] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:08:32.221Z)]
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.222] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:08:32.222Z)]
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.223] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:08:32.223Z)]
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.223] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:32.223Z)]
Oct 9 16:08:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:32.225] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:32.225Z)]
Oct 9 16:08:33 master-01 mesos-master[11603]: I1009 16:08:33.831194 11620 http.cpp:516] HTTP request for '/master/state.json'
Oct 9 16:08:36 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:36.971] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:08:36.970Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.230] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:08:42.230Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.231] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:08:42.231Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.232] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:08:42.232Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.233] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:42.233Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.236] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:08:42.236Z)]
Oct 9 16:08:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:42.237] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:42.237Z)]
Oct 9 16:08:46 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:46.981] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:08:46.981Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.240] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:08:52.240Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.241] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:08:52.241Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.243] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:08:52.243Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.244] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:52.244Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.244] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:08:52.244Z)]
Oct 9 16:08:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:52.245] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:08:52.245Z)]
Oct 9 16:08:56 master-01 marathon[20175]: [INFO] [10/09/2015 16:08:56.990] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:08:56.990Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.250] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:02.250Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.250] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:02.250Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.252] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:02.252Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.253] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:02.253Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.256] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:02.256Z)]
Oct 9 16:09:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:02.256] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:02.256Z)]
Oct 9 16:09:07 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:07.001] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:07.000Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.260] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:12.260Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.261] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:12.261Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.262] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:12.262Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.263] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:12.263Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.264] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:12.264Z)]
Oct 9 16:09:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:12.265] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:12.265Z)]
Oct 9 16:09:17 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:17.011] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:17.011Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.270] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:22.270Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.271] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:22.271Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.273] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:22.273Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.273] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:22.273Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.274] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:22.274Z)]
Oct 9 16:09:22 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:22.275] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:22.275Z)]
Oct 9 16:09:23 master-01 mesos-master[11603]: I1009 16:09:23.831347 11622 http.cpp:516] HTTP request for '/master/state.json'
Oct 9 16:09:27 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:27.021] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:27.021Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.280] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:32.279Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.280] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:32.280Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.283] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:32.283Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.284] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:32.284Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.285] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:32.285Z)]
Oct 9 16:09:32 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:32.286] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:32.286Z)]
Oct 9 16:09:37 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:37.031] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:37.031Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.289] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:42.289Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.290] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:42.290Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.290] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:42.290Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.292] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:42.292Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.294] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:42.294Z)]
Oct 9 16:09:42 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:42.295] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:42.295Z)]
Oct 9 16:09:47 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:47.042] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:47.042Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.300] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:09:52.300Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.301] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:09:52.301Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.302] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:09:52.302Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.303] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:52.303Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.305] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:09:52.305Z)]
Oct 9 16:09:52 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:52.306] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:09:52.306Z)]
Oct 9 16:09:57 master-01 marathon[20175]: [INFO] [10/09/2015 16:09:57.051] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:09:57.051Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.310] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:10:02.310Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.311] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:10:02.311Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.313] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:10:02.313Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.313] [marathon-akka.actor.default-dispatcher-5] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:10:02.313Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.315] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:10:02.315Z)]
Oct 9 16:10:02 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:02.316] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:10:02.316Z)]
Oct 9 16:10:07 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:07.060] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:10:07.060Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.319] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Pe] Received health result: [Healthy(chatd.740f8449-698c-11e5-8997-00163e105035,2015-10-03T05:04:52.603Z,2015-10-09T16:10:12.319Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.320] [marathon-akka.actor.default-dispatcher-8] [akka://marathon/user/$Ne] Received health result: [Healthy(phantom.e03fdbb9-698b-11e5-8997-00163e105035,2015-06-13T01:24:28.535Z,2015-10-09T16:10:12.320Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.322] [marathon-akka.actor.default-dispatcher-10] [akka://marathon/user/$Se] Received health result: [Healthy(rank.e03f6688-698b-11e5-8997-00163e105035,2015-09-05T00:45:16.537Z,2015-10-09T16:10:12.322Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.323] [marathon-akka.actor.default-dispatcher-7] [akka://marathon/user/$Te] Received health result: [Healthy(api.02bfc725-6d42-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:10:12.323Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.323] [marathon-akka.actor.default-dispatcher-6] [akka://marathon/user/$Oe] Received health result: [Healthy(web-staging.672656c6-6dfc-11e5-8632-00163e105035,2015-10-08T20:36:18.604Z,2015-10-09T16:10:12.323Z)]
Oct 9 16:10:12 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:12.324] [marathon-akka.actor.default-dispatcher-9] [akka://marathon/user/$Te] Received health result: [Healthy(api.d2d11e0c-6d41-11e5-8632-00163e105035,2015-10-07T22:18:43.603Z,2015-10-09T16:10:12.324Z)]
Oct 9 16:10:13 master-01 mesos-master[11603]: I1009 16:10:13.831073 11625 http.cpp:516] HTTP request for '/master/state.json'
Oct 9 16:10:17 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:17.071] [marathon-akka.actor.default-dispatcher-2] [akka://marathon/user/$Ve] Received health result: [Healthy(geard.b5b916ae-6df1-11e5-8632-00163e105035,2015-10-08T19:21:00.379Z,2015-10-09T16:10:17.071Z)]
Oct 9 16:10:19 master-01 marathon[20175]: [2015-10-09 16:10:19,679] WARN Offer [20151008-190321-197427466-5050-2990-O627]. Constraints for app [/geard] not satisfied.
Oct 9 16:10:19 master-01 marathon[20175]: The conflicting constraints are: [field: "hostname"
Oct 9 16:10:19 master-01 marathon[20175]: operator: UNIQUE
Oct 9 16:10:19 master-01 marathon[20175]: ] (mesosphere.mesos.ResourceMatcher$:86)
Oct 9 16:10:19 master-01 marathon[20175]: [2015-10-09 16:10:19,680] INFO Offer [20151008-190321-197427466-5050-2990-O627]. Insufficient resources for [/geard] (need cpus=0.5, mem=128.0, disk=0.0, ports=([3333, 7946] required), available in offer:
Oct 9 16:10:19 master-01 marathon[20175]: id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151008-190321-197427466-5050-2990-O627"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: framework_id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151002-220555-935624970-5050-17468-0000"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: slave_id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151003-015036-935624970-5050-22288-S17"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: hostname: "10.129.196.34"
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "ports"
Oct 9 16:10:19 master-01 marathon[20175]: type: RANGES
Oct 9 16:10:19 master-01 marathon[20175]: ranges {
Oct 9 16:10:19 master-01 marathon[20175]: range {
Oct 9 16:10:19 master-01 marathon[20175]: begin: 1
Oct 9 16:10:19 master-01 marathon[20175]: end: 65535
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "cpus"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 1.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "mem"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 245.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "disk"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 17699.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: attributes {
Oct 9 16:10:19 master-01 marathon[20175]: name: "group"
Oct 9 16:10:19 master-01 marathon[20175]: type: TEXT
Oct 9 16:10:19 master-01 marathon[20175]: text {
Oct 9 16:10:19 master-01 marathon[20175]: value: "worker"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: (mesosphere.mesos.TaskBuilder:69)
Oct 9 16:10:19 master-01 marathon[20175]: [2015-10-09 16:10:19,683] WARN Offer [20151008-190321-197427466-5050-2990-O628]. Constraints for app [/web-prod] not satisfied.
Oct 9 16:10:19 master-01 marathon[20175]: The conflicting constraints are: [field: "group"
Oct 9 16:10:19 master-01 marathon[20175]: operator: CLUSTER
Oct 9 16:10:19 master-01 marathon[20175]: value: "web"
Oct 9 16:10:19 master-01 marathon[20175]: ] (mesosphere.mesos.ResourceMatcher$:86)
Oct 9 16:10:19 master-01 marathon[20175]: [2015-10-09 16:10:19,683] INFO Offer [20151008-190321-197427466-5050-2990-O628]. Insufficient resources for [/web-prod] (need cpus=0.25, mem=128.0, disk=0.0, ports=([3000] required), available in offer:
Oct 9 16:10:19 master-01 marathon[20175]: id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151008-190321-197427466-5050-2990-O628"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: framework_id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151002-220555-935624970-5050-17468-0000"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: slave_id {
Oct 9 16:10:19 master-01 marathon[20175]: value: "20151003-015036-935624970-5050-22288-S20"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: hostname: "10.129.196.51"
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "ports"
Oct 9 16:10:19 master-01 marathon[20175]: type: RANGES
Oct 9 16:10:19 master-01 marathon[20175]: ranges {
Oct 9 16:10:19 master-01 marathon[20175]: range {
Oct 9 16:10:19 master-01 marathon[20175]: begin: 1
Oct 9 16:10:19 master-01 marathon[20175]: end: 65535
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "cpus"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 1.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "mem"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 245.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: resources {
Oct 9 16:10:19 master-01 marathon[20175]: name: "disk"
Oct 9 16:10:19 master-01 marathon[20175]: type: SCALAR
Oct 9 16:10:19 master-01 marathon[20175]: scalar {
Oct 9 16:10:19 master-01 marathon[20175]: value: 17699.0
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: role: "*"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: attributes {
Oct 9 16:10:19 master-01 marathon[20175]: name: "group"
Oct 9 16:10:19 master-01 marathon[20175]: type: TEXT
Oct 9 16:10:19 master-01 marathon[20175]: text {
Oct 9 16:10:19 master-01 marathon[20175]: value: "worker"
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: }
Oct 9 16:10:19 master-01 marathon[20175]: (mesosphere.mesos.TaskBuilder:69)
Oct 9 16:10:19 master-01 marathon[20175]: [INFO] [10/09/2015 16:10:19.691] [marathon-akka.actor.default-dispatcher-11] [akka://marathon/user/launchQueue/7/0-geard] Request to launch task with id 'geard.3cb3b12d-6ea0-11e5-bd7a-00163e105035', version '2015-10-08T19:54:01.809Z'. 2 tasksToLaunch, 1 in flight. not backing off
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment