Skip to content

Instantly share code, notes, and snippets.

@thanethomson
Last active March 23, 2023 19:57
Show Gist options
  • Save thanethomson/7a3eeddff839adb33bf87af275b2c338 to your computer and use it in GitHub Desktop.
Save thanethomson/7a3eeddff839adb33bf87af275b2c338 to your computer and use it in GitHub Desktop.
CometBFT light client: empty RPC commit response triggers panic in E2E tests
light01 | I[2023-03-23|19:51:55.594] Downloading trusted light block using options module=main
light01 | I[2023-03-23|19:51:55.596] error comparing first header with witness. You may want to consider removing the witness module=main err="light block not found"
light01 | panic: runtime error: invalid memory address or nil pointer dereference
light01 | [signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0xbe7d14]
light01 |
light01 | goroutine 58 [running]:
light01 | github.com/tendermint/tendermint/light/provider/http.(*http).LightBlock(0xc000c44140, {0x13e9cf0, 0xc0001bb1c0}, 0x0)
light01 | /src/cometbft/light/provider/http/http.go:86 +0x134
light01 | github.com/tendermint/tendermint/light.(*Client).getTargetBlockOrLatest(0xc000c44140?, {0x13e9cf0, 0xc0001bb1c0}, 0x3e8, {0x13e6ef0, 0xc000c44140})
light01 | /src/cometbft/light/detector.go:384 +0x3c
light01 | github.com/tendermint/tendermint/light.(*Client).compareNewHeaderWithWitness(0xc00021c180, {0x13e9cf0, 0xc0001bb1c0}, 0xc0002c2f78?, 0xc00019c348, {0x13e6ef0, 0xc000c44140}, 0x0)
light01 | /src/cometbft/light/detector.go:138 +0x285
light01 | created by github.com/tendermint/tendermint/light.(*Client).compareFirstHeaderWithWitnesses
light01 | /src/cometbft/light/client.go:1144 +0x96b
validator02 | I[2023-03-23|19:51:35.385] service start msg="Starting SignerServer service" impl=SignerServer
validator02 | I[2023-03-23|19:51:35.385] start signer msg="Remote signer connecting to tcp://0.0.0.0:27559"
validator02 | D[2023-03-23|19:51:35.385] SignerDialer: Reconnection failed retries=1 max=100 err="dial tcp 0.0.0.0:27559: connect: connection refused"
validator02 | D[2023-03-23|19:51:36.385] SignerDialer: Reconnection failed retries=2 max=100 err="dial tcp 0.0.0.0:27559: connect: connection refused"
validator02 | I[2023-03-23|19:51:36.401] service start module=proxy msg="Starting multiAppConn service" impl=multiAppConn
validator02 | I[2023-03-23|19:51:36.401] service start module=abci-client connection=query msg="Starting localClient service" impl=localClient
validator02 | I[2023-03-23|19:51:36.401] service start module=abci-client connection=snapshot msg="Starting localClient service" impl=localClient
validator02 | I[2023-03-23|19:51:36.401] service start module=abci-client connection=mempool msg="Starting localClient service" impl=localClient
validator02 | I[2023-03-23|19:51:36.401] service start module=abci-client connection=consensus msg="Starting localClient service" impl=localClient
validator02 | I[2023-03-23|19:51:36.401] service start module=events msg="Starting EventBus service" impl=EventBus
validator02 | I[2023-03-23|19:51:36.401] service start module=pubsub msg="Starting PubSub service" impl=PubSub
validator02 | I[2023-03-23|19:51:36.408] service start module=txindex msg="Starting IndexerService service" impl=IndexerService
validator02 | I[2023-03-23|19:51:36.408] service start module=privval msg="Starting SignerListenerEndpoint service" impl=SignerListenerEndpoint
validator02 | I[2023-03-23|19:51:36.408] SignerListener: Listening for new connection module=privval
validator02 | I[2023-03-23|19:51:36.408] SignerListener: Blocking for connection module=privval
validator02 | D[2023-03-23|19:51:37.386] SignerDialer: Connection Ready
validator02 | I[2023-03-23|19:51:37.386] SignerListener: Connected module=privval
validator02 | I[2023-03-23|19:51:37.386] ABCI Handshake App Info module=consensus height=0 hash=E3B0C44298FC1C149AFBF4C8996FB92427AE41E4649B934CA495991B7852B855 software-version=0.17.0 protocol-version=1
validator02 | I[2023-03-23|19:51:37.386] ABCI Replay Blocks module=consensus appHeight=0 storeHeight=0 stateHeight=0
validator02 | I[2023-03-23|19:51:37.397] Completed ABCI Handshake - CometBFT and App are synced module=consensus appHeight=0 appHash=E3B0C44298FC1C149AFBF4C8996FB92427AE41E4649B934CA495991B7852B855
validator02 | I[2023-03-23|19:51:37.397] Version info module=main cmtbft_version=0.34.27 abci=0.17.0 block=11 p2p=8 commit_hash=
validator02 | I[2023-03-23|19:51:37.397] This node is a validator module=consensus addr=983D127556DCF9647DE215B021C4FA9854032954 pubKey=PubKeyEd25519{B191D3F739EC7332772E6B9875B1BF90C8B17064C2B48A915630E56390600E5B}
validator02 | I[2023-03-23|19:51:37.403] P2P Node ID module=p2p ID=63d9d8350f13171350e95bd0019df33c5f26bcb2 file=/cometbft/config/node_key.json
validator02 | I[2023-03-23|19:51:37.403] Adding persistent peers module=p2p addrs=[]
validator02 | I[2023-03-23|19:51:37.403] Adding unconditional peer ids module=p2p ids=[]
validator02 | I[2023-03-23|19:51:37.403] Add our address to book module=p2p book=/cometbft/config/addrbook.json addr=63d9d8350f13171350e95bd0019df33c5f26bcb2@[fd80:b10c::8]:26656
validator02 | I[2023-03-23|19:51:37.403] Add our address to book module=p2p book=/cometbft/config/addrbook.json addr=63d9d8350f13171350e95bd0019df33c5f26bcb2@0.0.0.0:26656
validator02 | I[2023-03-23|19:51:37.403] service start module=main msg="Starting Node service" impl=Node
validator02 | I[2023-03-23|19:51:37.403] Starting pprof server module=main laddr=:6060
validator02 | I[2023-03-23|19:51:37.403] service start module=p2p msg="Starting P2P Switch service" impl="P2P Switch"
validator02 | I[2023-03-23|19:51:37.403] service start module=evidence msg="Starting Evidence service" impl=Evidence
validator02 | I[2023-03-23|19:51:37.403] service start module=statesync msg="Starting StateSync service" impl=StateSync
validator02 | I[2023-03-23|19:51:37.403] service start module=pex msg="Starting PEX service" impl=PEX
validator02 | I[2023-03-23|19:51:37.403] service start module=p2p book=/cometbft/config/addrbook.json msg="Starting AddrBook service" impl=AddrBook
validator02 | I[2023-03-23|19:51:37.403] service start module=blockchain msg="Starting BlockchainReactor service" impl=BlockchainReactor
validator02 | I[2023-03-23|19:51:37.403] service start module=consensus msg="Starting Consensus service" impl=ConsensusReactor
validator02 | I[2023-03-23|19:51:37.403] serve module=rpc-server msg="Starting RPC HTTP server on [::]:26657"
validator02 | I[2023-03-23|19:51:37.403] Reactor module=consensus waitSync=false
validator02 | I[2023-03-23|19:51:37.403] service start module=consensus msg="Starting State service" impl=ConsensusState
validator02 | I[2023-03-23|19:51:37.403] Ensure peers module=pex numOutPeers=0 numInPeers=0 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:51:37.403] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:51:37.403] service start module=consensus wal=/cometbft/data/cs.wal/wal msg="Starting baseWAL service" impl=baseWAL
validator02 | I[2023-03-23|19:51:37.405] service start module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:26656 msg="Starting Peer service" impl="Peer{MConn{[fd80:b10c::7]:26656} 4b1068420ef739db63377250553562b9a978708a out}"
validator02 | I[2023-03-23|19:51:37.405] service start module=consensus wal=/cometbft/data/cs.wal/wal msg="Starting Group service" impl=Group
validator02 | I[2023-03-23|19:51:37.405] service start module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:26656 msg="Starting MConnection service" impl=MConn{[fd80:b10c::7]:26656}
validator02 | I[2023-03-23|19:51:37.405] service start module=consensus msg="Starting TimeoutTicker service" impl=TimeoutTicker
validator02 | I[2023-03-23|19:51:37.405] Searching for height module=consensus wal=/cometbft/data/cs.wal/wal height=1000 min=0 max=0
validator02 | I[2023-03-23|19:51:37.405] Searching for height module=consensus wal=/cometbft/data/cs.wal/wal height=0 min=0 max=0
validator02 | I[2023-03-23|19:51:37.405] Found module=consensus wal=/cometbft/data/cs.wal/wal height=0 index=0
validator02 | I[2023-03-23|19:51:37.405] Catchup by replaying consensus messages module=consensus height=1000
validator02 | I[2023-03-23|19:51:37.405] Replay: Done module=consensus
validator02 | I[2023-03-23|19:51:37.405] Saving AddrBook to file module=p2p book=/cometbft/config/addrbook.json size=0
validator02 | I[2023-03-23|19:51:37.506] Connection is closed @ recvRoutine (likely by the other side) module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:26656 conn=MConn{[fd80:b10c::7]:26656}
validator02 | I[2023-03-23|19:51:37.506] service stop module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:26656 msg="Stopping MConnection service" impl=MConn{[fd80:b10c::7]:26656}
validator02 | E[2023-03-23|19:51:37.506] Stopping peer for error module=p2p peer="Peer{MConn{[fd80:b10c::7]:26656} 4b1068420ef739db63377250553562b9a978708a out}" err=EOF
validator02 | I[2023-03-23|19:51:37.506] service stop module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:26656 msg="Stopping Peer service" impl="Peer{MConn{[fd80:b10c::7]:26656} 4b1068420ef739db63377250553562b9a978708a out}"
validator02 | I[2023-03-23|19:51:38.403] Timed out module=consensus dur=997.306092ms height=1000 round=0 step=RoundStepNewHeight
validator02 | I[2023-03-23|19:51:41.404] Timed out module=consensus dur=3s height=1000 round=0 step=RoundStepPropose
validator02 | I[2023-03-23|19:52:03.435] service start module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:47510 msg="Starting Peer service" impl="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:52:03.435] service start module=p2p peer=4b1068420ef739db63377250553562b9a978708a@[fd80:b10c::7]:47510 msg="Starting MConnection service" impl=MConn{[fd80:b10c::7]:47510}
validator02 | I[2023-03-23|19:52:07.405] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:52:07.405] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:52:07.405] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:52:37.406] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:52:37.406] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:52:37.406] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:53:07.406] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:53:07.406] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:53:07.406] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:53:37.403] Saving AddrBook to file module=p2p book=/cometbft/config/addrbook.json size=1
validator02 | I[2023-03-23|19:53:37.406] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:53:37.411] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:53:37.411] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:54:07.406] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:54:07.406] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:54:07.406] No addresses to dial. Falling back to seeds module=pex
validator02 | I[2023-03-23|19:54:37.406] Ensure peers module=pex numOutPeers=0 numInPeers=1 numDialing=0 numToDial=10
validator02 | I[2023-03-23|19:54:37.406] We need more addresses. Sending pexRequest to random peer module=pex peer="Peer{MConn{[fd80:b10c::7]:47510} 4b1068420ef739db63377250553562b9a978708a in}"
validator02 | I[2023-03-23|19:54:37.406] No addresses to dial. Falling back to seeds module=pex
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment