dcos-navstar.log

a1.log

Apr 18 01:38:22 a1.dcos systemd[1]: Started Navstar: A distributed systems & network overlay orchestration engine.
Apr 18 01:38:22 a1.dcos navstar-env[6270]: Exec: /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar/erts-8.2.2/bin/erlexec -noshell -noinput +Bd -boot /opt/mesosphere/packa
Apr 18 01:38:22 a1.dcos navstar-env[6270]: Root: /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar
Apr 18 01:38:22 a1.dcos navstar-env[6270]: /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar
Apr 18 01:38:22 a1.dcos navstar-env[6270]: Setup running ...
Apr 18 01:38:22 a1.dcos navstar-env[6270]: Directories verified. Res = {[ok],[]}
Apr 18 01:38:22 a1.dcos navstar-env[6270]: Setup finished processing hooks ...
Apr 18 01:38:28 a1.dcos navstar-env[6270]: [warning] <0.780.0> lager_error_logger_h dropped 99 messages in the last second that exceeded the limit of 50 messages/sec
Apr 18 01:38:31 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:34 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:forward_forward_join:618 Forwarding join original node 'navstar@192.168.65.60' dropped
Apr 18 01:38:36 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:44 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:49 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:54 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:54 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 01:38:56 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:38:57 a1.dcos navstar-env[6270]: [warning] <0.1165.0>@minuteman_mesos_poller:poll:211 Unable to poll agent: {failed_connect,[{to_address,{"192.168.65.111",5051}},{inet,[inet],econnrefused}]}
Apr 18 01:38:59 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:39:01 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 01:39:04 a1.dcos navstar-env[6270]: [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty

agent1.log

Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Checking whether time is synchronized using the kernel adjtimex API.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Time can be synchronized via most popular mechanisms (ntpd, chrony, systemd-timesyncd, etc.)
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Time is in sync!
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  64 bytes from localhost (127.0.0.1): icmp_seq=1 ttl=64 time=0.015 ms
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  --- ready.spartan ping statistics ---
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  1 packets transmitted, 1 received, 0% packet loss, time 0ms
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  rtt min/avg/max/mdev = 0.015/0.015/0.015/0.000 ms
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  PING ready.spartan (127.0.0.1) 56(84) bytes of data.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + iptables --wait -D FORWARD -p tcp -m set --match-set minuteman dst,dst -m tcp --tcp-flags FIN,SYN,RST,ACK SYN -j REJECT --reject-with icmp-port-unreachable
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Try `iptables -h' or 'iptables --help' for more information.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + true
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Try `iptables -h' or 'iptables --help' for more information.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  iptables v1.4.21: Set minuteman doesn't exist.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + iptables --wait -D OUTPUT -p tcp -m set --match-set minuteman dst,dst -m tcp --tcp-flags FIN,SYN,RST,ACK SYN -j REJECT --reject-with icmp-port-unreachable
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  iptables v1.4.21: Set minuteman doesn't exist.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + true
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Try `iptables -h' or 'iptables --help' for more information.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + iptables --wait -t raw -D PREROUTING -p tcp -m set --match-set minuteman dst,dst -m tcp --tcp-flags FIN,SYN,RST,ACK SYN -j NFQUEUE --queue-balance 50:58
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  iptables v1.4.21: Set minuteman doesn't exist.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + true
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + iptables --wait -t raw -D OUTPUT -p tcp -m set --match-set minuteman dst,dst -m tcp --tcp-flags FIN,SYN,RST,ACK SYN -j NFQUEUE --queue-balance 50:58
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  iptables v1.4.21: Set minuteman doesn't exist.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + RULE='POSTROUTING -m ipvs --ipvs --vdir ORIGINAL --vmethod MASQ -m comment --comment Minuteman-IPVS-IPTables-masquerade-rule -j MASQUERADE'
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + true
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Try `iptables -h' or 'iptables --help' for more information.
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + iptables --wait -t nat -C POSTROUTING -m ipvs --ipvs --vdir ORIGINAL --vmethod MASQ -m comment --comment Minuteman-IPVS-IPTables-masquerade-rule -j MASQUERADE
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  + echo 'Minuteman IPTables rule found'
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  Minuteman IPTables rule found
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Clearing proxy environment variables
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Connecting to zk-1.zk:2181
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Zookeeper connection established, state: CONNECTED
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [DEBUG] bootstrapping dcos-navstar
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Clearing proxy environment variables
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Connecting to zk-2.zk:2181
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [INFO] Zookeeper connection established, state: CONNECTED
Apr 18 08:46:44 public1.dcos.ajway.kr dcos-navstar.service:  [DEBUG] bootstrapping dcos-minuteman
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  RTNETLINK answers: File exists
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  Root: /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  Exec: /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar/erts-8.2.2/bin/erlexec -noshell -noinput +Bd -boot /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar/releases/0.1.0/navstar -mode embedded -boot_var ERTS_LIB_DIR /opt/mesosphere/packages/navstar--1128db0234105a64fb4be52f4453cd6aa895ff30/navstar/lib -config /tmp/sys.navstar@192.10.250.228.config -args_file /tmp/vm.navstar@192.10.250.228.args -pa -- foreground
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  Setup running ...
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  Setup finished processing hooks ...
Apr 18 08:46:45 public1.dcos.ajway.kr dcos-navstar.service:  Directories verified. Res = {[ok],[]}
Apr 18 08:46:50 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.780.0> lager_error_logger_h dropped 98 messages in the last second that exceeded the limit of 50 messages/sec
Apr 18 08:46:51 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 08:46:56 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 08:46:57 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:forward_forward_join:618 Forwarding join original node 'navstar@192.10.250.231' dropped
Apr 18 08:47:01 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:forward_forward_join:618 Forwarding join original node 'navstar@192.10.250.230' dropped
Apr 18 08:47:03 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:forward_forward_join:618 Forwarding join original node 'navstar@192.10.250.229' dropped
Apr 18 08:47:11 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 08:47:16 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 08:47:17 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:handle_shuffle:887 Handling shuffle early, because no nodes to send it to
Apr 18 08:47:27 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:47:47 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:48:07 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:48:27 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:48:37 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:48:47 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty
Apr 18 08:49:07 public1.dcos.ajway.kr dcos-navstar.service:  [warning] <0.931.0>@lashup_hyparview_membership:maybe_neighbor:691 Trying to connect to connect to node from passive view, but passive view empty