Skip to content

Instantly share code, notes, and snippets.

@amirrustam
Created May 5, 2022 16:50
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save amirrustam/c39af57837a6333d44bb144c556f63cc to your computer and use it in GitHub Desktop.
Save amirrustam/c39af57837a6333d44bb144c556f63cc to your computer and use it in GitHub Desktop.
Debugging PR#91 kurtosis-tech/eth2-merge-kurtosis-module
# Source: https://app.circleci.com/pipelines/github/kurtosis-tech/eth2-merge-kurtosis-module/450/workflows/bf293a0e-83ee-47d1-96e5-ce40a4dc1b85/jobs/597
DEBU[2022-05-05T15:47:46Z] Received gRPC request to method '/module_api.ExecutableModuleService/IsAvailable' with args:
DEBU[2022-05-05T15:47:46Z] gRPC request to method '/module_api.ExecutableModuleService/IsAvailable' succeeded with response:
DEBU[2022-05-05T15:47:46Z] Received gRPC request to method '/module_api.ExecutableModuleService/Execute' with args:
params_json:"{}"
INFO[2022-05-05T15:47:46Z] Deserializing the following execute params:
{}
INFO[2022-05-05T15:47:46Z] Successfully deserialized execute params
INFO[2022-05-05T15:47:46Z] Adding 1 participants logging at level 'info'...
INFO[2022-05-05T15:47:46Z] Generating validator keys....
DEBU[2022-05-05T15:47:54Z] Removing service 'prelaunch-data-generator-1651765666'...
DEBU[2022-05-05T15:47:54Z] Successfully removed service ID prelaunch-data-generator-1651765666
INFO[2022-05-05T15:47:54Z] Successfully generated validator keys
INFO[2022-05-05T15:47:54Z] Generating EL client genesis data...
DEBU[2022-05-05T15:48:01Z] Removing service 'prelaunch-data-generator-1651765674'...
DEBU[2022-05-05T15:48:01Z] Successfully removed service ID prelaunch-data-generator-1651765674
INFO[2022-05-05T15:48:01Z] Successfully generated EL client genesis data
INFO[2022-05-05T15:48:01Z] Uploading Geth prefunded keys...
INFO[2022-05-05T15:48:01Z] Successfully uploaded Geth prefunded keys
INFO[2022-05-05T15:48:01Z] Adding 1 EL clients...
DEBU[2022-05-05T15:48:04Z] Getting the node info via RPC failed with error: An error occurred getting the node info
--- at /build/kurtosis-module/impl/participant_network/el/el_rest_client/el_client_rest_client.go:72 (ELClientRESTClient.GetNodeInfo) ---
Caused by: An error occurred making the request to URL 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"admin_nodeInfo","params":[],"id":0}'
--- at /build/kurtosis-module/impl/participant_network/el/el_rest_client/el_client_rest_client.go:97 (ELClientRESTClient.makeRequest) ---
Caused by: Post "http://99.45.160.4:8545": dial tcp 99.45.160.4:8545: connect: connection refused
DEBU[2022-05-05T15:48:05Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"admin_nodeInfo","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":{"id":"b890e96f3afa920478061ff4e6faf99eda262ad8547ba836e3ff55e89ff08021","name":"Geth/v1.10.18-unstable-0a9e384c-20220504/linux-amd64/go1.18.1","enode":"enode://b19dad8d968887ddb1078c195fa918f56b374fd633c24ecc89f59ef4ffce4595c6985a5d182a14585d29cee0dbb2e157a91f6c55c99837d50eb639a7b4f65a5d@99.45.160.4:30303","enr":"enr:-KO4QNEJbYwc_h2cqaN3P5Yjh_sChw9gn6O65ogYHBAiSikIVm5dCQcBz6OamFlOeSdaDpUTACwyigbxKtlDWkRtkFiGAYCU6Cmng2V0aMfGhNR76QoKgmlkgnY0gmlwhGMtoASJc2VjcDI1NmsxoQOxna2NloiH3bEHjBlfqRj1azdP1jPCTsyJ9Z70_85FlYRzbmFwwIN0Y3CCdl-DdWRwgnZf","ip":"99.45.160.4","ports":{"discovery":30303,"listener":30303},"listenAddr":"[::]:30303","protocols":{"eth":{"network":3151908,"difficulty":1,"genesis":"0xd234a575ad04d8f848ad14b222fcfcc8626209ea2a302ef2b8c7c0dbf407415b","config":{"chainId":3151908,"homesteadBlock":0,"eip150Block":0,"eip150Hash":"0x0000000000000000000000000000000000000000000000000000000000000000","eip155Block":0,"eip158Block":0,"byzantiumBlock":0,"constantinopleBlock":0,"petersburgBlock":0,"istanbulBlock":0,"berlinBlock":0,"londonBlock":0,"mergeForkBlock":10,"terminalTotalDifficulty":100000000},"head":"0xd234a575ad04d8f848ad14b222fcfcc8626209ea2a302ef2b8c7c0dbf407415b"},"snap":{}}}}
'
INFO[2022-05-05T15:48:05Z] Added EL client 0 of type 'geth'
INFO[2022-05-05T15:48:05Z] Successfully added 1 EL clients
INFO[2022-05-05T15:48:05Z] Waiting for all EL clients to start mining before adding CL clients... (this will take a few minutes, but is necessary to ensure that the Beacon nodes get slots from the EL clients; you can skip this wait by setting `"waitForMining": false` in the params object, but the Beacon nodes likely won't work properly)
DEBU[2022-05-05T15:48:05Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:10Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:15Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:20Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:25Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:30Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:35Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:40Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:45Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:50Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:48:55Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:49:00Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:49:05Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x0"}
'
DEBU[2022-05-05T15:49:10Z] Request to 'http://99.45.160.4:8545' with body '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":0}' returned result '{"jsonrpc":"2.0","id":0,"result":"0x1"}
'
INFO[2022-05-05T15:49:10Z] EL client 0 has begun mining
INFO[2022-05-05T15:49:10Z] All EL clients have started mining
INFO[2022-05-05T15:49:10Z] Generating CL client genesis data...
DEBU[2022-05-05T15:49:18Z] Removing service 'prelaunch-data-generator-1651765750'...
DEBU[2022-05-05T15:49:18Z] Successfully removed service ID prelaunch-data-generator-1651765750
INFO[2022-05-05T15:49:18Z] Successfully generated CL client genesis data
INFO[2022-05-05T15:49:18Z] Adding 1 CL clients...
DEBU[2022-05-05T15:49:27Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: connection refused
DEBU[2022-05-05T15:49:58Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: i/o timeout
DEBU[2022-05-05T15:50:17Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:21Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:24Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:27Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:30Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:33Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:36Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:39Z] CL client returned an error on GetHealth check; sleeping for 1s: An error occurred calling GET on node health endpoint 'http://99.45.160.5:4000/eth/v1/node/health'
--- at /build/kurtosis-module/impl/participant_network/cl/cl_client_rest_client/cl_client_rest_client.go:56 (CLClientRESTClient.GetHealth) ---
Caused by: Get "http://99.45.160.5:4000/eth/v1/node/health": dial tcp 99.45.160.5:4000: connect: no route to host
DEBU[2022-05-05T15:50:40Z] gRPC request to method '/module_api.ExecutableModuleService/Execute' failed with error:
An error occurred executing the module
--- at /go/pkg/mod/github.com/kurtosis-tech/kurtosis-module-api-lib/golang@v0.0.0-20220430214658-cd66dfe51abb/lib/execution/executable_module_service_impl.go:53 (executableModuleServiceImpl.Execute) ---
Caused by: An error occurred launching a participant network of '1' participants
--- at /build/kurtosis-module/impl/module.go:87 (Eth2KurtosisModule.Execute) ---
Caused by: An error occurred launching CL client for participant 0
--- at /build/kurtosis-module/impl/participant_network/participant_network.go:293 (LaunchParticipantNetwork) ---
Caused by: An error occurred waiting for the new Lighthouse Beacon node to become available
--- at /build/kurtosis-module/impl/participant_network/cl/lighthouse/lighthouse_launcher.go:123 (LighthouseCLClientLauncher.Launch) ---
Caused by: CL client didn't become available even after 10 retries with 1s between retries
--- at /build/kurtosis-module/impl/participant_network/cl/cl_availability_waiter.go:34 (WaitForBeaconClientAvailability) ---
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment