Created
July 31, 2022 15:01
-
-
Save radeksimko/f17444857718e6b847192d8c0bdfa464 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Jul 31 15:39:57 ubuntu systemd[1]: Stopping Nomad... | |
Jul 31 15:39:57 ubuntu nomad[3159]: ==> Caught signal: interrupt | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.846+0100 [INFO] agent: requesting shutdown | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.846+0100 [INFO] client: shutting down | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.846+0100 [INFO] client.plugin: shutting down plugin manager: plugin-type=device | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.846+0100 [INFO] client.plugin: plugin manager finished: plugin-type=device | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.846+0100 [INFO] client.plugin: shutting down plugin manager: plugin-type=driver | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [INFO] client.plugin: plugin manager finished: plugin-type=driver | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [INFO] client.plugin: shutting down plugin manager: plugin-type=csi | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [INFO] client.plugin: plugin manager finished: plugin-type=csi | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [INFO] nomad: shutting down server | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [WARN] nomad: serf: Shutdown without a Leave | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.855+0100 [INFO] nomad: cluster leadership lost | |
Jul 31 15:39:57 ubuntu nomad[3159]: 2022-07-31T15:39:57.856+0100 [INFO] agent: shutdown complete | |
Jul 31 15:39:57 ubuntu systemd[1]: nomad.service: Main process exited, code=exited, status=1/FAILURE | |
Jul 31 15:39:57 ubuntu systemd[1]: nomad.service: Failed with result 'exit-code'. | |
Jul 31 15:39:57 ubuntu systemd[1]: Stopped Nomad. | |
Jul 31 15:39:57 ubuntu systemd[1]: Started Nomad. | |
Jul 31 15:39:57 ubuntu nomad[6267]: ==> WARNING: Bootstrap mode enabled! Potentially unsafe operation. | |
Jul 31 15:39:57 ubuntu nomad[6267]: ==> Loaded configuration from /etc/nomad.d/nomad.hcl | |
Jul 31 15:39:57 ubuntu nomad[6267]: ==> Starting Nomad agent... | |
Jul 31 15:40:07 ubuntu nomad[6267]: ==> Nomad agent configuration: | |
Jul 31 15:40:07 ubuntu nomad[6267]: Advertise Addrs: HTTP: 10.20.1.117:4646; RPC: 10.20.1.117:4647; Serf: 10.20.1.117:4648 | |
Jul 31 15:40:07 ubuntu nomad[6267]: Bind Addrs: HTTP: [10.20.1.117:4646]; RPC: 10.20.1.117:4647; Serf: 10.20.1.117:4648 | |
Jul 31 15:40:07 ubuntu nomad[6267]: Client: true | |
Jul 31 15:40:07 ubuntu nomad[6267]: Log Level: INFO | |
Jul 31 15:40:07 ubuntu nomad[6267]: Region: global (DC: dc1) | |
Jul 31 15:40:07 ubuntu nomad[6267]: Server: true | |
Jul 31 15:40:07 ubuntu nomad[6267]: Version: 1.3.2 | |
Jul 31 15:40:07 ubuntu nomad[6267]: ==> Nomad agent started! Log data will stream in below: | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [WARN] agent.plugin_loader: skipping external plugins since plugin_dir doesn't exist: plugin_dir=/opt/nomad/data/plugins | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [INFO] agent: detected plugin: name=qemu type=driver plugin_version=0.1.0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [INFO] agent: detected plugin: name=java type=driver plugin_version=0.1.0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [INFO] agent: detected plugin: name=docker type=driver plugin_version=0.1.0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [INFO] agent: detected plugin: name=raw_exec type=driver plugin_version=0.1.0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.905+0100 [INFO] agent: detected plugin: name=exec type=driver plugin_version=0.1.0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.907+0100 [INFO] nomad: setting up raft bolt store: no_freelist_sync=false | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.907+0100 [INFO] nomad.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:68f3e132-263c-a7ea-c6e8-54858f65bac9 Address:10.20.1.116:4647}]" | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.907+0100 [INFO] nomad.raft: entering follower state: follower="Node at 10.20.1.117:4647 [Follower]" leader= | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] nomad: serf: EventMemberJoin: ubuntu.global 10.20.1.117 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] nomad: starting scheduling worker(s): num_workers=2 schedulers=["system", "sysbatch", "service", "batch", "_core"] | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] nomad: started scheduling worker(s): num_workers=2 schedulers=["system", "sysbatch", "service", "batch", "_core"] | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] client: using state directory: state_dir=/opt/nomad/data/client | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] client: using alloc directory: alloc_dir=/opt/nomad/data/alloc | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.908+0100 [INFO] client: using dynamic ports: min=20000 max=32000 reserved="" | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.909+0100 [WARN] nomad: serf: Failed to re-join any previously known node | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.909+0100 [INFO] nomad: adding server: server="ubuntu.global (Addr: 10.20.1.117:4647) (DC: dc1)" | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.924+0100 [INFO] client.cpuset.v1: initialized cpuset cgroup manager: parent=/nomad cpuset=0-1 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.925+0100 [INFO] client.fingerprint_mgr.cgroup: cgroups are available | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.925+0100 [INFO] client.fingerprint_mgr.cpu: fallback to default cpu total compute, set client config option cpu_total_compute to override | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.926+0100 [WARN] client.fingerprint_mgr.network: unable to parse speed: path=/usr/sbin/ethtool device=enp0s5 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.927+0100 [WARN] client.fingerprint_mgr.network: unable to parse speed: path=/usr/sbin/ethtool device=lo | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.928+0100 [WARN] client.fingerprint_mgr.network: unable to parse speed: path=/usr/sbin/ethtool device=enp0s5 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:57.929+0100 [WARN] client.fingerprint_mgr.network: unable to parse speed: path=/usr/sbin/ethtool device=docker0 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.549+0100 [WARN] nomad.raft: heartbeat timeout reached, starting election: last-leader= | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.549+0100 [INFO] nomad.raft: entering candidate state: node="Node at 10.20.1.117:4647 [Candidate]" term=3 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.552+0100 [INFO] nomad.raft: election won: tally=1 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.552+0100 [INFO] nomad.raft: entering leader state: leader="Node at 10.20.1.117:4647 [Leader]" | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.552+0100 [INFO] nomad: cluster leadership acquired | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.556+0100 [INFO] nomad: eval broker status modified: paused=false | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.556+0100 [INFO] nomad: blocked evals status modified: paused=false | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.557+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:39:59.557+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:40:07.936+0100 [INFO] client.plugin: starting plugin manager: plugin-type=csi | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:40:07.936+0100 [INFO] client.plugin: starting plugin manager: plugin-type=driver | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:40:07.936+0100 [INFO] client.plugin: starting plugin manager: plugin-type=device | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:40:07.973+0100 [INFO] client: started client: node_id=d2ec00b4-0fa7-3e67-4a5b-68bdd7e13eb8 | |
Jul 31 15:40:07 ubuntu nomad[6267]: 2022-07-31T15:40:07.978+0100 [INFO] client: node registration complete | |
Jul 31 15:40:16 ubuntu nomad[6267]: 2022-07-31T15:40:16.329+0100 [INFO] client: node registration complete | |
Jul 31 15:40:59 ubuntu nomad[6267]: 2022-07-31T15:40:59.566+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:40:59 ubuntu nomad[6267]: 2022-07-31T15:40:59.566+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:41:59 ubuntu nomad[6267]: 2022-07-31T15:41:59.557+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:41:59 ubuntu nomad[6267]: 2022-07-31T15:41:59.557+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:42:59 ubuntu nomad[6267]: 2022-07-31T15:42:59.560+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:42:59 ubuntu nomad[6267]: 2022-07-31T15:42:59.561+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:43:59 ubuntu nomad[6267]: 2022-07-31T15:43:59.557+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:43:59 ubuntu nomad[6267]: 2022-07-31T15:43:59.558+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:44:59 ubuntu nomad[6267]: 2022-07-31T15:44:59.560+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:44:59 ubuntu nomad[6267]: 2022-07-31T15:44:59.560+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:45:59 ubuntu nomad[6267]: 2022-07-31T15:45:59.560+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:45:59 ubuntu nomad[6267]: 2022-07-31T15:45:59.560+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:46:59 ubuntu nomad[6267]: 2022-07-31T15:46:59.561+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:46:59 ubuntu nomad[6267]: 2022-07-31T15:46:59.562+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" | |
Jul 31 15:47:59 ubuntu nomad[6267]: 2022-07-31T15:47:59.562+0100 [ERROR] nomad: failed to reconcile member: member="{ubuntu.global 10.20.1.117 4648 map[bootstrap:1 build:1.3.2 dc:dc1 expect:1 id:68f3e132-263c-a7ea-c6e8-54858f65bac9 port:4647 raft_vsn:> | |
Jul 31 15:47:59 ubuntu nomad[6267]: 2022-07-31T15:47:59.562+0100 [ERROR] nomad: failed to reconcile: error="error removing server with duplicate ID \"68f3e132-263c-a7ea-c6e8-54858f65bac9\": need at least one voter in configuration: {[]}" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment