Hermes issue #1792

log.txt

...2022-01-19T12:15:56.086310Z ERROR ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: error processing pending events in destination chain: failed with underlying error: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:44.509426036 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123459"} }
2022-01-19T12:15:56.086817Z ERROR ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: [cosmoshub-4:transfer/channel-141 -> osmosis-1] timed out while confirming TxHashes: count=1; 22B9C8BBA689E35BA8C9514AD991F5820047468FF4A54602F482FBC14182B6D0
2022-01-19T12:15:56.089362Z  WARN ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: [osmosis-1 -> cosmoshub-4:07-tendermint-259] resolving trusted height from the full list of consensus state heights for target height 1-2860136; this may take a while
2022-01-19T12:16:01.946775Z  INFO ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: assembled batch of 2 message(s)
2022-01-19T12:16:01.949762Z ERROR ThreadId(80) send_tx{id=cosmoshub-4}:estimate_gas: failed to simulate tx. propagating error to caller: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:52.193694205 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123460"} }
2022-01-19T12:16:01.949834Z ERROR ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: error processing pending events in destination chain: failed with underlying error: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:52.193694205 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123460"} }
2022-01-19T12:16:01.950413Z ERROR ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: [cosmoshub-4:transfer/channel-141 -> osmosis-1] timed out while confirming TxHashes: count=1; 22B9C8BBA689E35BA8C9514AD991F5820047468FF4A54602F482FBC14182B6D0
2022-01-19T12:16:01.952897Z  WARN ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: [osmosis-1 -> cosmoshub-4:07-tendermint-259] resolving trusted height from the full list of consensus state heights for target height 1-2860136; this may take a while
2022-01-19T12:16:07.914635Z ERROR ThreadId(119) [cosmoshub-4] error during batch processing: supervisor was not able to connect to any chains: missing chain for id (juno-1) in configuration file
2022-01-19T12:16:07.959887Z  INFO ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: assembled batch of 2 message(s)
2022-01-19T12:16:07.964325Z ERROR ThreadId(80) send_tx{id=cosmoshub-4}:estimate_gas: failed to simulate tx. propagating error to caller: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 1

2:15:52.193694205 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123460"} }
2022-01-19T12:16:07.964387Z ERROR ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: error processing pending events in destination chain: failed with underlying error: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:52.193694205 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123460"} }
2022-01-19T12:16:07.964933Z ERROR ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: [cosmoshub-4:transfer/channel-141 -> osmosis-1] timed out while confirming TxHashes: count=1; 22B9C8BBA689E35BA8C9514AD991F5820047468FF4A54602F482FBC14182B6D0
2022-01-19T12:16:07.967472Z  WARN ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: [osmosis-1 -> cosmoshub-4:07-tendermint-259] resolving trusted height from the full list of consensus state heights for target height 1-2860136; this may take a while
2022-01-19T12:16:13.252574Z  INFO ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: assembled batch of 2 message(s)
2022-01-19T12:16:13.255616Z ERROR ThreadId(80) send_tx{id=cosmoshub-4}:estimate_gas: failed to simulate tx. propagating error to caller: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:59.033970382 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123461"} }
2022-01-19T12:16:13.255662Z ERROR ThreadId(82) packet{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: error processing pending events in destination chain: failed with underlying error: gRPC call failed with status: status: Unknown, message: "failed to execute message; message index: 1: receive packet verification failed: block timestamp >= packet timeout timestamp (2022-01-19 12:15:59.033970382 +0000 UTC >= 2022-01-19 18:31:23.475 +0700 +07): packet timeout", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "x-cosmos-block-height": "9123461"} }
2022-01-19T12:16:13.258055Z ERROR ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}: [cosmoshub-4:transfer/channel-141 -> osmosis-1] timed out while confirming TxHashes: count=1; 22B9C8BBA689E35BA8C9514AD991F5820047468FF4A54602F482FBC14182B6D0
2022-01-19T12:16:13.260456Z  WARN ThreadId(81) packet_cmd{src_chain=osmosis-1 src_port=transfer src_channel=channel-0 dst_chain=cosmoshub-4}:relay{odata=4hG-9d5Z37 ->Destination @1-2860135; len=1}: [osmosis-1 -> cosmoshub-4:07-tendermint-259] resolving trusted height from the full list of consensus state heights for target height 1-2860136; this may take a while
...