Skip to content

Instantly share code, notes, and snippets.

@matti

matti/minio-healing.log

Created September 12, 2017 07:21
Show Gist options
  • Save matti/39f06d2aecb53a8d3912135115f3123c to your computer and use it in GitHub Desktop.
Save matti/39f06d2aecb53a8d3912135115f3123c to your computer and use it in GitHub Desktop.
Download ZIP
Raw
minio-healing.log
2017-09-12T07:16:52.000Z [2]: Initializing data volume.
2017-09-12T07:16:52.000Z [2]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:16:52.000Z [2]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:16:52.000Z [2]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:16:52.000Z [2]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:16:53.000Z [2]: Endpoint: http://10.81.128.100:9000 http://172.17.0.8:9000 http://127.0.0.1:9000
2017-09-12T07:16:53.000Z [2]: AccessKey: ACCESSKEY
2017-09-12T07:16:53.000Z [2]: SecretKey: SECRETKEY
2017-09-12T07:16:53.000Z [2]:
2017-09-12T07:16:53.000Z [2]: Browser Access:
2017-09-12T07:16:53.000Z [2]: http://10.81.128.100:9000 http://172.17.0.8:9000 http://127.0.0.1:9000
2017-09-12T07:16:53.000Z [2]:
2017-09-12T07:16:53.000Z [2]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]: $ mc config host add myminio http://10.81.128.100:9000 ACCESSKEY SECRETKEY
2017-09-12T07:16:53.000Z [2]:
2017-09-12T07:16:53.000Z [2]: Object API (Amazon S3 compatible):
2017-09-12T07:16:53.000Z [2]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:16:53.000Z [2]:
2017-09-12T07:16:53.000Z [2]: Drive Capacity: 20 GiB Free, 26 GiB Total
2017-09-12T07:16:53.000Z [2]: Status: 4 Online, 0 Offline. We can withstand [2] drive failure(s).
2017-09-12T07:17:05.000Z [3]: Waiting for all hosts to resolve....Failed to lookup web-1:9000
2017-09-12T07:17:06.000Z [3]: ...Failed to resolve hosts.. retrying after 1 second.
2017-09-12T07:17:06.000Z [4]: time="2017-09-12T07:17:06Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016e8f0)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:06.000Z [4]: time="2017-09-12T07:17:06Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016e9a0)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:06.000Z [4]: time="2017-09-12T07:17:06Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016ea50)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:07.000Z [3]: ....All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:17:09.000Z [1]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:17:10.000Z [4]: time="2017-09-12T07:17:10Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016e8f0)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:10.000Z [4]: time="2017-09-12T07:17:10Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016e9a0)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:10.000Z [4]: time="2017-09-12T07:17:10Z" level=error msg="Unable to fetch disk info for &cmd.networkStorage{rpcClient:(*cmd.AuthRPCClient)(0xc42016ea50)}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:28.000Z [3]: Initializing data volume. Waiting for minimum 3 servers to come online. (elapsed 20s)
2017-09-12T07:17:29.000Z [4]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:17:57.000Z [4]: time="2017-09-12T07:17:57Z" level=error msg="Unable to fetch disk info for &cmd.retryStorage{remoteStorage:(*cmd.networkStorage)(0xc4200224a8), maxRetryAttempts:4, retryUnit:1000000000, retryCap:30000000000}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:17:57.000Z [4]: Initializing data volume.
2017-09-12T07:17:57.000Z [4]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:17:57.000Z [4]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:17:57.000Z [4]: [03/04] http://web-3:9000/data/3 - 0 B offline
2017-09-12T07:17:57.000Z [4]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:17:57.000Z [4]: time="2017-09-12T07:17:57Z" level=fatal msg="Unable to initialize XL object layer." cause="Unable to recognize backend format, Read failed. Insufficient number of disks online" source="[xl-v1.go:74:newXLObjectLayer()]"
2017-09-12T07:18:10.000Z [4]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:18:12.000Z [2]: Waiting for all hosts to resolve.......Failed to lookup web-4:9000
2017-09-12T07:18:12.000Z [2]: Failed to resolve hosts.. retrying after 1 second.
2017-09-12T07:18:20.000Z [3]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:18:20.000Z [1]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:18:23.000Z [2]: .Failed to lookup web-1:9000
2017-09-12T07:18:33.000Z [2]: ..Failed to lookup web-3:9000
2017-09-12T07:18:34.000Z [4]: Initializing data volume. Waiting for minimum 3 servers to come online. (elapsed 22s)
2017-09-12T07:18:43.000Z [2]: .Failed to lookup web-4:9000
2017-09-12T07:18:43.000Z [2]: Failed to resolve hosts.. retrying after 1 second.
2017-09-12T07:18:49.000Z [3]: time="2017-09-12T07:18:49Z" level=error msg="Unable to fetch disk info for &cmd.retryStorage{remoteStorage:(*cmd.networkStorage)(0xc42027a298), maxRetryAttempts:4, retryUnit:1000000000, retryCap:30000000000}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:18:51.000Z [4]: Initializing data volume. Waiting for minimum 3 servers to come online. (elapsed 40s)
2017-09-12T07:18:54.000Z [2]: .Failed to lookup web-1:9000
2017-09-12T07:18:54.000Z [2]: ...Failed to resolve hosts.. retrying after 1 second.
2017-09-12T07:18:55.000Z [2]: ....All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:18:56.000Z [2]: Initializing data volume.
2017-09-12T07:18:56.000Z [2]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:18:56.000Z [2]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:18:56.000Z [2]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:18:56.000Z [2]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:18:56.000Z [4]: Initializing data volume.
2017-09-12T07:18:56.000Z [4]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:18:56.000Z [4]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:18:56.000Z [4]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:18:56.000Z [4]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:18:56.000Z [4]: Endpoint: http://10.81.128.106:9000 http://172.17.0.6:9000 http://127.0.0.1:9000
2017-09-12T07:18:56.000Z [4]: AccessKey: ACCESSKEY
2017-09-12T07:18:56.000Z [4]: SecretKey: SECRETKEY
2017-09-12T07:18:56.000Z [4]:
2017-09-12T07:18:56.000Z [4]: Browser Access:
2017-09-12T07:18:56.000Z [4]: http://10.81.128.106:9000 http://172.17.0.6:9000 http://127.0.0.1:9000
2017-09-12T07:18:56.000Z [4]:
2017-09-12T07:18:56.000Z [4]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]: $ mc config host add myminio http://10.81.128.106:9000 ACCESSKEY SECRETKEY
2017-09-12T07:18:56.000Z [4]:
2017-09-12T07:18:56.000Z [4]: Object API (Amazon S3 compatible):
2017-09-12T07:18:56.000Z [4]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:18:56.000Z [4]:
2017-09-12T07:18:56.000Z [4]: Drive Capacity: 20 GiB Free, 26 GiB Total
2017-09-12T07:18:56.000Z [4]: Status: 4 Online, 0 Offline. We can withstand [2] drive failure(s).
2017-09-12T07:19:02.000Z [1]: Initializing data volume.
2017-09-12T07:19:02.000Z [1]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:19:02.000Z [1]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:19:02.000Z [1]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:19:02.000Z [1]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:19:02.000Z [1]: Endpoint: http://10.81.128.159:9000 http://172.17.0.4:9000 http://127.0.0.1:9000
2017-09-12T07:19:02.000Z [1]: AccessKey: ACCESSKEY
2017-09-12T07:19:02.000Z [1]: SecretKey: SECRETKEY
2017-09-12T07:19:02.000Z [1]:
2017-09-12T07:19:02.000Z [1]: Browser Access:
2017-09-12T07:19:02.000Z [1]: http://10.81.128.159:9000 http://172.17.0.4:9000 http://127.0.0.1:9000
2017-09-12T07:19:02.000Z [1]:
2017-09-12T07:19:02.000Z [1]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]: $ mc config host add myminio http://10.81.128.159:9000 ACCESSKEY SECRETKEY
2017-09-12T07:19:02.000Z [1]:
2017-09-12T07:19:02.000Z [1]: Object API (Amazon S3 compatible):
2017-09-12T07:19:02.000Z [1]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:19:02.000Z [1]:
2017-09-12T07:19:02.000Z [1]: Drive Capacity: 20 GiB Free, 26 GiB Total
2017-09-12T07:19:02.000Z [1]: Status: 4 Online, 0 Offline. We can withstand [2] drive failure(s).
2017-09-12T07:19:08.000Z [3]: time="2017-09-12T07:19:08Z" level=error msg="Unable to fetch disk info for &cmd.retryStorage{remoteStorage:(*cmd.networkStorage)(0xc42027a2b0), maxRetryAttempts:4, retryUnit:1000000000, retryCap:30000000000}" cause="disk not found" source="[xl-v1.go:199:getDisksInfo()]"
2017-09-12T07:19:08.000Z [3]: Initializing data volume.
2017-09-12T07:19:08.000Z [3]: [01/04] http://web-1:9000/data/1 - 0 B offline
2017-09-12T07:19:08.000Z [3]: [02/04] http://web-2:9000/data/2 - 0 B offline
2017-09-12T07:19:08.000Z [3]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:19:08.000Z [3]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:19:09.000Z [3]: Endpoint: http://10.81.128.207:9000 http://172.17.0.6:9000 http://127.0.0.1:9000
2017-09-12T07:19:09.000Z [3]: AccessKey: ACCESSKEY
2017-09-12T07:19:09.000Z [3]: SecretKey: SECRETKEY
2017-09-12T07:19:09.000Z [3]:
2017-09-12T07:19:09.000Z [3]: Browser Access:
2017-09-12T07:19:09.000Z [3]: http://10.81.128.207:9000 http://172.17.0.6:9000 http://127.0.0.1:9000
2017-09-12T07:19:09.000Z [3]:
2017-09-12T07:19:09.000Z [3]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]: $ mc config host add myminio http://10.81.128.207:9000 ACCESSKEY SECRETKEY
2017-09-12T07:19:09.000Z [3]:
2017-09-12T07:19:09.000Z [3]: Object API (Amazon S3 compatible):
2017-09-12T07:19:09.000Z [3]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:19:09.000Z [3]:
2017-09-12T07:19:09.000Z [3]: Drive Capacity: 15 GiB Free, 20 GiB Total
2017-09-12T07:19:09.000Z [3]: Status: 3 Online, 1 Offline. We can withstand [1] drive failure(s).
2017-09-12T07:19:13.000Z [2]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:19:14.000Z [2]: Initializing data volume.
2017-09-12T07:19:14.000Z [2]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:19:14.000Z [2]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:19:14.000Z [2]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:19:14.000Z [2]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:19:14.000Z [2]: Endpoint: http://10.81.128.100:9000 http://172.17.0.8:9000 http://127.0.0.1:9000
2017-09-12T07:19:14.000Z [2]: AccessKey: ACCESSKEY
2017-09-12T07:19:14.000Z [2]: SecretKey: SECRETKEY
2017-09-12T07:19:14.000Z [2]:
2017-09-12T07:19:14.000Z [2]: Browser Access:
2017-09-12T07:19:14.000Z [2]: http://10.81.128.100:9000 http://172.17.0.8:9000 http://127.0.0.1:9000
2017-09-12T07:19:14.000Z [2]:
2017-09-12T07:19:14.000Z [2]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]: $ mc config host add myminio http://10.81.128.100:9000 ACCESSKEY SECRETKEY
2017-09-12T07:19:14.000Z [2]:
2017-09-12T07:19:14.000Z [2]: Object API (Amazon S3 compatible):
2017-09-12T07:19:14.000Z [2]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:19:14.000Z [2]:
2017-09-12T07:19:14.000Z [2]: Drive Capacity: 20 GiB Free, 26 GiB Total
2017-09-12T07:19:14.000Z [2]: Status: 4 Online, 0 Offline. We can withstand [2] drive failure(s).
2017-09-12T07:19:31.000Z [1]: Waiting for all hosts to resolve.......All hosts are resolving proceeding to initialize Minio.
2017-09-12T07:19:32.000Z [1]: Initializing data volume.
2017-09-12T07:19:32.000Z [1]: [01/04] http://web-1:9000/data/1 - 60 GiB online
2017-09-12T07:19:32.000Z [1]: [02/04] http://web-2:9000/data/2 - 60 GiB online
2017-09-12T07:19:32.000Z [1]: [03/04] http://web-3:9000/data/3 - 60 GiB online
2017-09-12T07:19:32.000Z [1]: [04/04] http://web-4:9000/data/4 - 13 GiB online
2017-09-12T07:19:32.000Z [1]: Endpoint: http://10.81.128.159:9000 http://172.17.0.4:9000 http://127.0.0.1:9000
2017-09-12T07:19:32.000Z [1]: AccessKey: ACCESSKEY
2017-09-12T07:19:32.000Z [1]: SecretKey: SECRETKEY
2017-09-12T07:19:32.000Z [1]:
2017-09-12T07:19:32.000Z [1]: Browser Access:
2017-09-12T07:19:32.000Z [1]: http://10.81.128.159:9000 http://172.17.0.4:9000 http://127.0.0.1:9000
2017-09-12T07:19:32.000Z [1]:
2017-09-12T07:19:32.000Z [1]: Command-line Access: https://docs.minio.io/docs/minio-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]: $ mc config host add myminio http://10.81.128.159:9000 ACCESSKEY SECRETKEY
2017-09-12T07:19:32.000Z [1]:
2017-09-12T07:19:32.000Z [1]: Object API (Amazon S3 compatible):
2017-09-12T07:19:32.000Z [1]: Go: https://docs.minio.io/docs/golang-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]: Java: https://docs.minio.io/docs/java-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]: Python: https://docs.minio.io/docs/python-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]: JavaScript: https://docs.minio.io/docs/javascript-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]: .NET: https://docs.minio.io/docs/dotnet-client-quickstart-guide
2017-09-12T07:19:32.000Z [1]:
2017-09-12T07:19:32.000Z [1]: Drive Capacity: 20 GiB Free, 26 GiB Total
2017-09-12T07:19:32.000Z [1]: Status: 4 Online, 0 Offline. We can withstand [2] drive failure(s).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment