Skip to content

Instantly share code, notes, and snippets.

@brianlong

brianlong/Solana main net 66728408

Created February 25, 2021 04:24
Show Gist options
  • Save brianlong/344cb63213d82301681759b6c1468602 to your computer and use it in GitHub Desktop.
Save brianlong/344cb63213d82301681759b6c1468602 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
Solana main net 66728408
Looking at this sequence of slots, I am DDnA... and skipped 4 slots
--
66728400 Hqc2qT3vXvBSKozmz7Rd7gLF6jUJHuQEGBTnCHzEBnqk
66728401 Hqc2qT3vXvBSKozmz7Rd7gLF6jUJHuQEGBTnCHzEBnqk
66728402 Hqc2qT3vXvBSKozmz7Rd7gLF6jUJHuQEGBTnCHzEBnqk
66728403 Hqc2qT3vXvBSKozmz7Rd7gLF6jUJHuQEGBTnCHzEBnqk
66728404 XkCriyrNwS3G4rzAXtG5B1nnvb5Ka1JtCku93VqeKAr
66728405 XkCriyrNwS3G4rzAXtG5B1nnvb5Ka1JtCku93VqeKAr
66728406 XkCriyrNwS3G4rzAXtG5B1nnvb5Ka1JtCku93VqeKAr
66728407 XkCriyrNwS3G4rzAXtG5B1nnvb5Ka1JtCku93VqeKAr
66728408 DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp SKIPPED
66728409 DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp SKIPPED
66728410 DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp SKIPPED
66728411 DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp SKIPPED
66728412 J711fLahrgkEnPaCrbGUCpGemmeVg2LsaZhmC6HNPbXk SKIPPED
66728413 J711fLahrgkEnPaCrbGUCpGemmeVg2LsaZhmC6HNPbXk SKIPPED
66728414 J711fLahrgkEnPaCrbGUCpGemmeVg2LsaZhmC6HNPbXk SKIPPED
66728415 J711fLahrgkEnPaCrbGUCpGemmeVg2LsaZhmC6HNPbXk SKIPPED
66728416 ATwrKSHdF1JptZDFd2wUeU8reP6ftp9P695W9ipdB6TQ
66728417 ATwrKSHdF1JptZDFd2wUeU8reP6ftp9P695W9ipdB6TQ
66728418 ATwrKSHdF1JptZDFd2wUeU8reP6ftp9P695W9ipdB6TQ
66728419 ATwrKSHdF1JptZDFd2wUeU8reP6ftp9P695W9ipdB6TQ
--
In my logs, I see a new fork at 66728404 and then another new fork at 66728408. It looks like I never received the blocks for 66728405-66728407, so I created the new fork at 66728408. Later, I abandoned that fork for 66728405 which showed up late. Looking at the log segment below, does this seem correct? I never received the blocks, but the other nodes received and voted on them?
Here are the log entries showing the order & timing of the forks:
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.247946228Z INFO solana_core::replay_stage] new fork:66728400 parent:66728399 root:66728329
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643827745Z INFO solana_core::replay_stage] new fork:66728401 parent:66728400 root:66728330
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.051625961Z INFO solana_core::replay_stage] new fork:66728402 parent:66728401 root:66728331
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.533391174Z INFO solana_core::replay_stage] new fork:66728403 parent:66728402 root:66728332
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.966848622Z INFO solana_core::replay_stage] new fork:66728404 parent:66728403 root:66728333
** NOTE: SKIPS TO 66728408
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.452618785Z INFO solana_core::replay_stage] new fork:66728408 parent:66728403 (leader) root:66728333
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159201065Z INFO solana_core::replay_stage] new fork:66728409 parent:66728408 (leader) root:66728333
** NOTE: BACK TO 66728405
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.324154636Z INFO solana_core::replay_stage] new fork:66728405 parent:66728404 root:66728333
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.965482176Z INFO solana_core::replay_stage] new fork:66728406 parent:66728405 root:66728333
Feb 25 03:13:39 solana-production-lax chrt[15385]: [2021-02-25T03:13:39.354983532Z INFO solana_core::replay_stage] new fork:66728407 parent:66728406 root:66728333
ALL LOG ENTRIES BELOW:
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.247946228Z INFO solana_core::replay_stage] new fork:66728400 parent:66728399 root:66728329
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.248438754Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728400i block_height=61209987i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.249474413Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings hash_accounts=112408i store_accounts=65861i update_index=5148i handle_reclaims=0i append_accounts=0i find_storage=0i num_accounts=3280i total_data=617866108i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.249482773Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings2 recycle_store_count=0i current_recycle_store_count=1000i current_recycle_store_bytes=6383095808i create_store_count=0i store_get_slot_store=0i store_find_existing=0i dropped_stores=0i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.249789516Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=300i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.249802230Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728400i from_genesis=1611060300i corrected=1614222826i ancestor_timestamp=1614222826i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.378718006Z INFO solana_metrics::metrics] datapoint: replay-loop-timing-stats total_elapsed_us=1041000i collect_frozen_banks_elapsed=187i compute_bank_stats_elapsed=609i select_vote_and_reset_forks_elapsed=8i start_leader_elapsed=0i reset_bank_elapsed=1i voting_elapsed=0i select_forks_elapsed=10i compute_slot_stats_elapsed=0i generate_new_bank_forks_elapsed=7732i replay_active_banks_elapsed=28502i reset_duplicate_slots_elapsed=2547i wait_receive_elapsed=1000835i heaviest_fork_failures_elapsed=0i bank_count=0i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.407595464Z INFO solana_metrics::metrics] datapoint: retransmit-num_nodes count=646i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.407594760Z INFO solana_core::retransmit_stage] retransmit: packets_by_slot: {66728400: 415}
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.407614444Z INFO solana_metrics::metrics] datapoint: retransmit-stage total_time=44626i epoch_fetch=354i epoch_cache_update=4380i total_batches=335i total_packets=415i retransmit_total=10675i compute_turbine=26169i repair_total=0i discard_total=4i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.407631501Z INFO solana_core::retransmit_stage] retransmit: top packets_by_source: {19: "5.83.175.225:8005", 26: "89.202.64.28:58008", 27: "85.190.150.50:8005", 29: "35.243.134.140:11005", 32: "173.231.58.226:8006"} len: 131
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.537804832Z INFO solana_metrics::metrics] datapoint: shred_fetch_repair index_overrun=0i shred_count=208i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=74i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.592218234Z INFO solana_metrics::metrics] datapoint: recv-window-insert-shreds num_shreds=2240i total_elapsed=191282i insert_lock_elapsed=23i insert_shreds_elapsed=73234i shred_recovery_elapsed=53154i chaining_elapsed=65i commit_working_sets_elapsed=8673i write_batch_elapsed=48088i num_inserted=856i num_repair=101i num_recovered=632i num_recovered_inserted=632i num_recovered_failed_sig=0i num_recovered_failed_invalid=0i num_recovered_exists=0i
Feb 25 03:13:33 solana-production-lax chrt[15385]: [2021-02-25T03:13:33.748129519Z INFO solana_metrics::metrics] datapoint: poh-service ticks=184i hashes=2299816i elapsed_ms=349i total_sleep_ms=197i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.144808906Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=969i slot=66728400i last_index=1077i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.181827754Z INFO solana_metrics::metrics] datapoint: shred_fetch_tvu_forwards index_overrun=0i shred_count=2564i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.186630030Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error-instruction_error", "counts": 16108626, "samples": 15615000, "now": 1614222814186, "events": 2}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.186722293Z INFO solana_metrics::metrics] datapoint: shred_fetch index_overrun=0i shred_count=54i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.204247947Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133404322, "samples": 77649000, "now": 1614222814204, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.256974974Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings hash_accounts=81786i store_accounts=88282i update_index=5273i handle_reclaims=0i append_accounts=0i find_storage=0i num_accounts=2940i total_data=400498016i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.256999142Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings2 recycle_store_count=0i current_recycle_store_count=1000i current_recycle_store_bytes=6383095808i create_store_count=0i store_get_slot_store=0i store_find_existing=0i dropped_stores=0i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.403699622Z INFO solana_metrics::metrics] datapoint: cluster_slots_service-timing lowest_slot_elapsed=13045i update_completed_slots_elapsed=69193i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.412550624Z INFO solana_metrics::metrics] datapoint: replay-loop-timing-stats total_elapsed_us=1034000i collect_frozen_banks_elapsed=173i compute_bank_stats_elapsed=363i select_vote_and_reset_forks_elapsed=5i start_leader_elapsed=0i reset_bank_elapsed=1i voting_elapsed=0i select_forks_elapsed=5i compute_slot_stats_elapsed=0i generate_new_bank_forks_elapsed=2701i replay_active_banks_elapsed=528661i reset_duplicate_slots_elapsed=1463i wait_receive_elapsed=500254i heaviest_fork_failures_elapsed=0i bank_count=0i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.476467041Z INFO solana_metrics::counter] COUNTER:{"name": "vote-native", "counts": 19067001, "samples": 19067000, "now": 1614222814476, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.486246595Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38870112, "samples": 48355000, "now": 1614222814486, "events": 0}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.486266916Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55459082, "samples": 48355000, "now": 1614222814486, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.502151366Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34503200, "samples": 7706000, "now": 1614222814502, "events": 2}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.539534047Z INFO solana_metrics::metrics] datapoint: shred_fetch_repair index_overrun=0i shred_count=122i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=14i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.569806704Z INFO solana_core::replay_stage] bank frozen: 66728400
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.569827025Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728400i fetch_entries_time=3502i fetch_entries_fail_time=0i entry_poh_verification_time=32188i entry_transaction_verification_time=6252i replay_time=670348i replay_total_elapsed=1319938i total_entries=1146i total_shreds=1078i load_us=342780i execute_us=544428i store_us=286122i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.569902457Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=57i latest_slot_elapsed=0i read_lock_elapsed=0i load_account_elapsed=15i iterator_elapsed=7i num_keys_iterated=34i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.570015939Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=34i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.571460939Z INFO solana_runtime::bank] bank frozen: 66728400 hash: EZc7LVcwNtYg12vqBvy8dfykweVn7m9oJbY4C8eY8Unm accounts_delta: DrkWxDpFTWbcP7HQnNLNoUJCprddVnvUqZbTqtoShkpa signature_count: 1521 last_blockhash: HejvLx9AMMNHUmts7SHge2XJxcWiUsVoEmzeRFHhVDFv capitalization: 489650015328087848
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.571479988Z INFO solana_runtime::bank] accounts hash slot: 66728400 stats: BankHashStats { num_updated_accounts: 4631, num_removed_accounts: 12, num_lamports_stored: 5410681182823097, total_data_len: 658118210, num_executable_accounts: 14 }
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.571492168Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=2608i same_account_writes_size=429488383i unique_account_writes_size=228629827i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.571601765Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=37i num_slots=99i total_unique_writes_size=20096135200i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.572930600Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728397i root=66728307i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575959204Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728400i best_slot=66728400i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575960529Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728400 0 0 66728399
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575973272Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728400i weight="0"
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575989162Z INFO solana_core::replay_stage] validator fork confirmed 66728385 11521ms
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575994317Z INFO solana_core::replay_stage] validator fork confirmed 66728384 12759ms
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.575994647Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=11521i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576001801Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=12759i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576002918Z INFO solana_core::replay_stage] validator fork confirmed 66728382 15881ms
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576012785Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=15881i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576014095Z INFO solana_core::replay_stage] validator fork confirmed 66728383 14740ms
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576023294Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=14740i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576023776Z INFO solana_core::replay_stage] validator fork confirmed 66728386 10938ms
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576034237Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=10938i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576035677Z INFO solana_core::replay_stage] voting: 66728400 0
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576039743Z INFO solana_core::replay_stage] LEADER CHANGE at slot: 66728400 leader: Hqc2qT3vXvBSKozmz7Rd7gLF6jUJHuQEGBTnCHzEBnqk
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.576051415Z INFO solana_metrics::metrics] datapoint: tower-vote latest=66728400i root=66728330i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.583387399Z INFO solana_core::replay_stage] new root 66728330
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.587896058Z INFO solana_metrics::metrics] datapoint: block-commitment-cache aggregate-commitment-ms=4i highest-confirmed-root=66728311i highest-confirmed-slot=66728396i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.640852387Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=759i slot=66728401i last_index=682i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643053334Z INFO solana_core::replay_stage] vote bank: Some((66728400, SameFork)) reset bank: 66728400
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643074326Z INFO solana_metrics::metrics] datapoint: blocks_produced num_blocks_on_fork=39487i num_dropped_blocks_on_fork=20939i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643095056Z INFO solana_core::poh_recorder] reset poh from: BFjD2jXYcfpc839envbt49ndHm6BUnaM3ygRD12gCBUE,4270618132,66728399 to: HejvLx9AMMNHUmts7SHge2XJxcWiUsVoEmzeRFHhVDFv,66728400
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643114236Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp reset PoH to tick 4270617664 (within slot 66728400). My next leader slot is 66728408
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.643827745Z INFO solana_core::replay_stage] new fork:66728401 parent:66728400 root:66728330
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.644778859Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728401i block_height=61209988i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.646236463Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=314i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.646244950Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728401i from_genesis=1611060300i corrected=1614222827i ancestor_timestamp=1614222826i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.751775617Z INFO solana_metrics::metrics] datapoint: poh-service ticks=183i hashes=2296512i elapsed_ms=350i total_sleep_ms=129i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.767963857Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34505314, "samples": 7707000, "now": 1614222814767, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.874022833Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133405608, "samples": 77650000, "now": 1614222814874, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.883889678Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-forwarded_packets", "counts": 20723121, "samples": 4540000, "now": 1614222814883, "events": 1}
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.896183057Z INFO solana_metrics::metrics] datapoint: cluster_info_stats entrypoint=0i entrypoint2=0i push_vote_read=15i get_votes=4702i get_accounts_hash=0i all_tvu_peers=0i tvu_peers=2679i new_push_requests_num=1177i table_size=276695i purged_values_size=89237i failed_inserts_size=0i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.896205737Z INFO solana_metrics::metrics] datapoint: cluster_info_stats2 gossip_packets_dropped_count=0i retransmit_peers=2845i repair_peers=9606i new_push_requests=296738i new_push_requests2=287i purge=67173i process_gossip_packets_time=1601491i handle_batch_ping_messages_time=236i handle_batch_pong_messages_time=29i handle_batch_prune_messages_time=13518i handle_batch_pull_requests_time=700565i handle_batch_pull_responses_time=0i handle_batch_push_messages_time=672643i process_pull_resp=0i filter_pull_resp=0i process_pull_resp_count=0i pull_response_fail_insert=0i pull_response_fail_timeout=0i pull_response_success=0i process_pull_resp_timeout=0i push_response_count=6673i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.896213203Z INFO solana_metrics::metrics] datapoint: cluster_info_stats3 process_pull_resp_len=0i process_pull_requests=540i pull_request_ping_pong_check_failed_count=0i generate_pull_responses=685488i process_prune=284i process_push_message=60528i prune_received_cache=9392i epoch_slots_lookup=47i new_pull_requests=130149i mark_pull_request=4i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.896216944Z INFO solana_metrics::metrics] datapoint: cluster_info_stats4 skip_push_message_shred_version=0i skip_pull_response_shred_version=0i skip_pull_shred_version=0i push_message_count=5911i push_message_value_count=9162i new_pull_requests_count=5120i prune_message_count=253i prune_message_len=665i
Feb 25 03:13:34 solana-production-lax chrt[15385]: [2021-02-25T03:13:34.896220337Z INFO solana_metrics::metrics] datapoint: cluster_info_stats5 pull_requests_count=5590i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.039039919Z INFO solana_core::replay_stage] bank frozen: 66728401
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.039044301Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728401i fetch_entries_time=1719i fetch_entries_fail_time=0i entry_poh_verification_time=6616i entry_transaction_verification_time=4775i replay_time=378989i replay_total_elapsed=392731i total_entries=787i total_shreds=683i load_us=252940i execute_us=497260i store_us=196182i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.039168622Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=85i latest_slot_elapsed=0i read_lock_elapsed=0i load_account_elapsed=21i iterator_elapsed=9i num_keys_iterated=45i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.039281261Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=44i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.040531942Z INFO solana_runtime::bank] bank frozen: 66728401 hash: DpHBqWkaojGB62ahvmA8xV12Wzt3KQZxQ3chUH5cGTCL accounts_delta: BzYn8wxf4hTx5uzt5QUxUXiAdvN7CQre41UvYhUZ2sGS signature_count: 945 last_blockhash: AM74aiTrcPCZw8P8ogs37MhbHptm15o1oNawtpUSYbgM capitalization: 489650015325725348
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.040552153Z INFO solana_runtime::bank] accounts hash slot: 66728401 stats: BankHashStats { num_updated_accounts: 3587, num_removed_accounts: 5, num_lamports_stored: 4113889977373094, total_data_len: 569849007, num_executable_accounts: 39 }
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.040603047Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=2040i same_account_writes_size=352951390i unique_account_writes_size=216897617i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.040674661Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=38i num_slots=100i total_unique_writes_size=20313032817i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.042043302Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728397i root=66728307i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045166726Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728401 0 0 66728400
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045175783Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728401i best_slot=66728401i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045190910Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728401i weight="0"
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045191932Z INFO solana_core::replay_stage] validator fork confirmed 66728397 4635ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045199061Z INFO solana_core::replay_stage] validator fork confirmed 66728391 7930ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045199747Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=4635i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045203673Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=7930i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045206508Z INFO solana_core::replay_stage] validator fork confirmed 66728387 10919ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045211077Z INFO solana_core::replay_stage] validator fork confirmed 66728390 8386ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045212285Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=10919i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045215360Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=8386i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045217165Z INFO solana_core::replay_stage] validator fork confirmed 66728396 5662ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045223190Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=5662i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045224129Z INFO solana_core::replay_stage] validator fork confirmed 66728389 9265ms
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045237600Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=9265i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045238973Z INFO solana_core::replay_stage] voting: 66728401 0
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.045254067Z INFO solana_metrics::metrics] datapoint: tower-vote latest=66728401i root=66728331i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.050192874Z INFO solana_core::replay_stage] new root 66728331
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.050902766Z INFO solana_core::replay_stage] vote bank: Some((66728401, SameFork)) reset bank: 66728401
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.050917694Z INFO solana_metrics::metrics] datapoint: blocks_produced num_blocks_on_fork=39488i num_dropped_blocks_on_fork=20939i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.050934592Z INFO solana_core::poh_recorder] reset poh from: GMHPp7gg9jpZafCkkcyuXT2reFmF7ts6dm2D6WDGPysu,4270617738,66728400 to: AM74aiTrcPCZw8P8ogs37MhbHptm15o1oNawtpUSYbgM,66728401
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.050946662Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp reset PoH to tick 4270617728 (within slot 66728401). My next leader slot is 66728408
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.051625961Z INFO solana_core::replay_stage] new fork:66728402 parent:66728401 root:66728331
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.052215865Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728402i block_height=61209989i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.053571042Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=308i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.053576442Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728402i from_genesis=1611060300i corrected=1614222828i ancestor_timestamp=1614222827i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.054101174Z INFO solana_metrics::metrics] datapoint: block-commitment-cache aggregate-commitment-ms=3i highest-confirmed-root=66728311i highest-confirmed-slot=66728398i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.103474106Z INFO solana_metrics::metrics] datapoint: external_purge_slots_stats safety_checks_elapsed=0i remove_storages_elapsed=0i drop_storage_entries_elapsed=0i num_cached_slots_removed=0i num_stored_slots_removed=0i total_removed_storage_entries=0i total_removed_cached_bytes=0i total_removed_stored_bytes=0i recycle_stores_write_elapsed=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.121773260Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38871135, "samples": 48356000, "now": 1614222815121, "events": 1}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.121807069Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55460410, "samples": 48356000, "now": 1614222815121, "events": 1}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.163074833Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=843i slot=66728402i last_index=594i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.183496290Z INFO solana_metrics::metrics] datapoint: shred_fetch_tvu_forwards index_overrun=0i shred_count=2230i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.194662260Z INFO solana_metrics::metrics] datapoint: shred_fetch index_overrun=0i shred_count=47i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.258107663Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings hash_accounts=227769i store_accounts=133099i update_index=11996i handle_reclaims=20i append_accounts=0i find_storage=0i num_accounts=6972i total_data=1121170327i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.258132312Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings2 recycle_store_count=0i current_recycle_store_count=1000i current_recycle_store_bytes=6383095808i create_store_count=0i store_get_slot_store=0i store_find_existing=0i dropped_stores=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.403081048Z INFO solana_core::repair_service] repair_stats: [(66728402, 32), (66728400, 134), (66728403, 66), (66728401, 25)]
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.403114242Z INFO solana_metrics::metrics] datapoint: serve_repair-repair repair-total=257i shred-count=257i highest-shred-count=0i orphan-count=0i repair-highest-slot=0i repair-orphan=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.403126599Z INFO solana_metrics::metrics] datapoint: serve_repair-repair-timing set-root-elapsed=24i get-votes-elapsed=493i add-votes-elapsed=1693i get-best-orphans-elapsed=1035i get-best-shreds-elapsed=17603i send-repairs-elapsed=15285i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.430912283Z INFO solana_core::replay_stage] bank frozen: 66728402
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.430914628Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728402i fetch_entries_time=1596i fetch_entries_fail_time=0i entry_poh_verification_time=9348i entry_transaction_verification_time=3013i replay_time=361712i replay_total_elapsed=377277i total_entries=605i total_shreds=595i load_us=225291i execute_us=452647i store_us=179672i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.431014009Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=70i latest_slot_elapsed=0i read_lock_elapsed=0i load_account_elapsed=11i iterator_elapsed=8i num_keys_iterated=51i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.431130100Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=49i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.432589112Z INFO solana_runtime::bank] bank frozen: 66728402 hash: 6ii6xr1xPi68Xy4rqBBFGVmwkG1g75tuHiXCzCyCLJpr accounts_delta: AAhFAH845qDgdvP3bgC5MCo8BNafuVQeeNkcqFy9v8Dp signature_count: 772 last_blockhash: Hb6JarNs8yRYUezdVrVitYsbxhKFdMzNGHNAbDRJFHe5 capitalization: 489650015323795348
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.432607415Z INFO solana_runtime::bank] accounts hash slot: 66728402 stats: BankHashStats { num_updated_accounts: 3373, num_removed_accounts: 7, num_lamports_stored: 4143336525519064, total_data_len: 567248037, num_executable_accounts: 29 }
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.432624235Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=2020i same_account_writes_size=349271306i unique_account_writes_size=217976731i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.432714132Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=39i num_slots=101i total_unique_writes_size=20531009548i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.433484749Z INFO solana_metrics::metrics] datapoint: retransmit-num_nodes count=0i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.433490273Z INFO solana_metrics::metrics] datapoint: retransmit-stage total_time=445265i epoch_fetch=4153i epoch_cache_update=8108i total_batches=3660i total_packets=4653i retransmit_total=101990i compute_turbine=293446i repair_total=151i discard_total=29i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.433487890Z INFO solana_core::retransmit_stage] retransmit: packets_by_slot: {66728400: 1429, 66728401: 1168, 66728402: 984, 66728403: 1072}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.433518072Z INFO solana_core::retransmit_stage] retransmit: top packets_by_source: {227: "135.181.19.7:8005", 248: "35.243.134.140:11005", 321: "89.202.64.28:58008", 362: "173.231.58.226:8006", 368: "85.190.150.50:8005"} len: 423
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.434108100Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728397i root=66728307i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.436858850Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728402i best_slot=66728402i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.436863826Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728402i weight="0"
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.436860153Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728402 0 0 66728401
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.436894566Z INFO solana_core::replay_stage] voting: 66728402 0
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.436908689Z INFO solana_metrics::metrics] datapoint: tower-vote latest=66728402i root=66728332i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.442466661Z INFO solana_core::replay_stage] new root 66728332
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.446325785Z INFO solana_metrics::metrics] datapoint: block-commitment-cache aggregate-commitment-ms=3i highest-confirmed-root=66728311i highest-confirmed-slot=66728398i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.452513492Z INFO solana_metrics::metrics] datapoint: optimistic_slot_elapsed average_elapsed_ms=2522i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.452524300Z INFO solana_metrics::metrics] datapoint: optimistic_slot slot=66728400i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.532682469Z INFO solana_core::replay_stage] vote bank: Some((66728402, SameFork)) reset bank: 66728402
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.532731514Z INFO solana_core::poh_recorder] reset poh from: 6QdQTpC6XPwg8ByJfW3U6GQCfXrmUFXCqinxFiYPfU3J,4270617816,66728401 to: Hb6JarNs8yRYUezdVrVitYsbxhKFdMzNGHNAbDRJFHe5,66728402
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.532743194Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp reset PoH to tick 4270617792 (within slot 66728402). My next leader slot is 66728408
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.532754314Z INFO solana_metrics::metrics] datapoint: blocks_produced num_blocks_on_fork=39489i num_dropped_blocks_on_fork=20939i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.532768748Z INFO solana_metrics::metrics] datapoint: replay-loop-timing-stats total_elapsed_us=1120000i collect_frozen_banks_elapsed=140i compute_bank_stats_elapsed=12061i select_vote_and_reset_forks_elapsed=17i start_leader_elapsed=0i reset_bank_elapsed=183i voting_elapsed=168450i select_forks_elapsed=1i compute_slot_stats_elapsed=105i generate_new_bank_forks_elapsed=6967i replay_active_banks_elapsed=930646i reset_duplicate_slots_elapsed=1222i wait_receive_elapsed=1i heaviest_fork_failures_elapsed=0i bank_count=3i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.533391174Z INFO solana_core::replay_stage] new fork:66728403 parent:66728402 root:66728332
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.534285206Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728403i block_height=61209990i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.535646129Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=288i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.535652328Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728403i from_genesis=1611060301i corrected=1614222828i ancestor_timestamp=1614222828i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.543338350Z INFO solana_core::cluster_info]
Feb 25 03:13:35 solana-production-lax chrt[15385]: IP Address |Age(ms)| Node identifier | Version |Gossip| TPU |TPUfwd| TVU |TVUfwd|Repair|ServeR|ShredVer
Feb 25 03:13:35 solana-production-lax chrt[15385]: ------------------+-------+----------------------------------------------+---------+------+------+------+------+------+------+------+--------
Feb 25 03:13:35 solana-production-lax chrt[15385]: 37.10.126.90 me| 3951 | DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.228.5.168 | 4306 | BqDtx8vYedBwzD3nMZHYmxTPpTRsmnzMdGkHZDhhT4Rx | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 173.231.10.234 | 4441 | AfDqsQKrpuDEHy65fsHMzVVeh4FcsRomxoe5nDLPERE8 | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 148.251.87.15 | 4695 | 3vYPCtncFxQ1RVtSpB2HRg1udHfeVPWPpWALuJaMcLx3 | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 52.214.236.99 | 2801 | CHZ1YEbNhbJWiPPQ2mG3rGpQNqGVQ2Gr6bXrjLPSxBGA | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 198.55.56.165 | 1609 | 9XV114Dg7cQF5zbxEoEnTpuYXR9TgdjHSimZtkzh4epF | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.179.181 | 1575 | G4dd6rLMW5aQEKFcYFHw148T8afjyavMyabsc86zACmq | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 89.163.130.214 | 3842 | 5rNErxSxMj3WysMx8bC8vHkbrt9QmwMeG9H6aTp71485 | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 45.34.1.46 | 5158 | CjmXSapt1ouz3CZzgkRJckBEwMSo5fVdVrizLeRscwYD | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.183.149 | 6591 | GWccEztr4AFmiMvvvXcib4feDZXCi6U13XrxponUHFWC | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.89.195.78 | 3187 | 2mKEUVkcttHeMeaZK8jjwkuwGSdCBm23xDgzXgbhTdPe | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 46.4.31.53 | 500 | HtzxUabNfYNJR43FUmcpkgmtANZahbq5iASB5oiboXzF | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.199.135.145 | 4245 | 776BzpbpsZU1rbCkNHizEP5r8RE8QL12Xqm49krkLPLy | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 49.12.132.138 | 8071 | 9YDu59tKDysB9zT9P8cgvaogmuy64R1Nxbr57QHztNrW | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 88.198.22.177 | 5141 | DohaxzeUj6ma9shCykxGxi7FbWnMyW9hzNjwQjZHEDV7 | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 18.216.115.104 | 3052 | tDw82DpNQwC4sUqRt5zCihm1N9ktta51ZyXbWewMsWp | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.248.81.9 | 1609 | BJevND8rrW5f9AHSysSGTtDWKcARxSpzTyDAvCm26Qms | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.96.239.203 | 3779 | CakcnaRDHka2gXyfbEd2d3xsvkJkqsLw2akB3zsN1D2S | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.19.46 | 2084 | 3nRhescC7HMYC8gKti3ENiBe8LnKZUs2gzYPAjYniQCP | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.142.122 | 5278 | 3nwmifffA54NDWqiZH1oYMKHaS21Evmy7rjPeL9veegs | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.211.245 | 1001 | 4rhWUqqNbdoVsGGw7P6Hzc81FB8C9jgR3UGF7aUgKAcY | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.179.50 | 6784 | A1GgCvSs374GeXguQk1u91sWSLZqGVUsfJ4B4KrKjEhp | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.179.125 | 891 | 3omj2Ajqtb7ZjCwxaYPXPrERhKDnwQRFr2ti7F23Kd6A | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 116.202.84.113 | 5802 | 6DcjiCqt6E65w8P352JvAN7qDkdQc7YQJHBrGf5aVAze | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.212.119 | 2031 | GKu2xfGZopa8C9K11wduQWgP4W4H7EEcaNdsUb7mxhyr | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.113.227 | 7348 | 2xte5CBkCBEBLNviyAfvSaTkMy6tvg99Cy3XJj9EJJs2 | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.248.129.20 | 1579 | 2c8aL96TH5DtPEgk3u7dCiHgqXXpGLUoCViD4iU3Yjbd | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.220.141.132 | 7132 | 3ibmP48UNJFRADFk64JD6DQyibAdocdxMgn3Ab4FCjX9 | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.18.249 | 1609 | 69QvoqgDazuAqD4ygG6YsA31HBV31L497XqmQohF5ajH | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 188.40.72.106 | 4448 | 2B5wMmBQkMHu9V5JbUyJuf2mJJUU286qKPsZzvQQjTNQ | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.170.47.27 | 5809 | 6ZomMAu9XSu9fzkRjqM6HbAXagw6Jo9fTsfsAADTZMSp | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 193.176.85.146 | 2609 | 4h5muqwz35tyPQdAXkZMyVM5cnGN5oXouTZL2AFA1Fjh | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 92.253.237.52 | 6873 | GRmtMtAeSL8HgX1p815ATQjaYU4Sk7XCP21i4yoFd3KS | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.91.31.21 | 6485 | 14aSHemkv2GN9e4UA4eQFoNMVMyQkQcLtCFTSzzBexx6 | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 89.202.64.28 | 381 | Awes4Tr6TX8JDzEhCZY2QVNimT6iD1zWHzf1vNyGvpLM | 1.5.8 | 58003| 58006| 58007| 58004| 58005| 58009| 58010| 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.56.229 | 2570 | rusx3KV69WGvsEbWa2HxjXp9GfHpjojM94BqsnfxKhx | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.115.61 | 6390 | Gdo6FaCtTQqGYsmDQrX2icSZeqDCdVizGzBDNbiqCGbJ | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.222.109.76 | 2002 | 9uAtx66puPQZLaP6fMKNKKyRtGzonhaUEdbVopgeWcfS | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 18.166.174.189 | 3228 | AUAS8prC4LdBKMmdN7hku247RcemsnTez3VdHQpDUmEv | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.130.82 | 6298 | 8vnrJNMDERZRwWgUMSqwLyYHEPkQQg3Ww6BM9AH4uX5R | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.135.44 | 1482 | 6zxkTupZL736phbbktUkWQSqWTzeYKbTFoKMENoNnJW3 | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.208.161 | 5202 | narPxmKTwkUxvcXhueccHT8xbE8og2Vb7NrLBm8kcrh | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.170.39.9 | 1776 | A79u1awz7CqnxmNYEVtzWwSzup3eKPNW6w2Jrd56oZ3y | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.222.109.78 | 4818 | 7DBhzr38xGJeALbZB9bpA5bnzVL8N9oGCjFfWuN6t8cG | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.121.58 | 164 | GVjtyyy9HrgBmQ62TxjyUuaQDvuHNbnnrZgi9gqwpVYv | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.195.60.238 | 1482 | 5cshESzkc3hmUA3qnp5ridF6WTeiVVLUYkZUaCPYfbid | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.0.100 | 2349 | Bx6R7GBNsFCt7KJUZw5yrbvdhL1EYcXPhkUBnS2t3c7E | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.210.217.12 | 5887 | 8c95uL2WKofQGfr3rAMZHmJ4V1UJW5puTmpw96n47MX | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 159.69.74.148 | 7684 | EEN4pf92jyVoASZ6pQQMHcKXTF4d5T3cY1a942QhRasc | 1.5.8 | 8021 | 8024 | 8025 | 8022 | 8023 | 8027 | 8028 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.216.244.8 | 3111 | 9of5uVqC4EYZ4LLJzPecynNM4GsQWiT1WtHfA39VqcCR | 1.5.8 | 8021 | 8024 | 8025 | 8022 | 8023 | 8027 | 8028 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.177.155 | 2089 | HW4zorvt6xDwhU36RqjcWNwU8YMj9tiqnAafBKW4cqV | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.178.137 | 2949 | 7PwCuKPmGF3ZqWHgn8zXPtsWJ7Ud2q1DFggRkzctwJnJ | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.178.6 | 6591 | EssmJHKwUffWWDBK4mb84QRQjWJEnuDui41T8ufcoqeZ | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.181.59 | 1609 | HPca8Y8aMnkrTi87MJFHDvMtJVkvyMxFvkuLsoFEoELy | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 195.201.181.248 | 7568 | DkycekX1rxCUr9FtBHfacHEgCTfRdRLaKYTiz7fXHMQ7 | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 88.198.6.218 | 6809 | CgX9oSHcpXjKKxUpLbrgNKWrk3ff4cQidfsf96AkMBke | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.131.158 | 7405 | 914RFshndUeZaNPjf8UWDCyo49ahQ1XQ2w9BnEMwpHKF | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.78.95 | 7050 | A31PGH4i5xGn7SHWpsQRhpBYUwanRuqNrHBp8bSeCSEr | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.239.108.47 | 1776 | 9QsFvmFWH2weMKYivw31wy6qCztnSEAgbvgAA8gMoUWH | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.177.10 | 1368 | 3xGDUST5CKZsiW4L5PPp9E63X3PdqRvCJfDM3q9EYcB4 | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 37.120.245.150 | 8063 | 6cgsK8ph5tNUCiKG5WXLMZFX1CoL4jzuVouTPBwPC8fk | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.207.211 | 2801 | D2UwKTrNJGNLM1h66qjoSDTK6CLcPSzmga84MFuiWdiS | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 62.251.42.161 | 7374 | BFMufPp4wW276nFzB7FVHgtY8FTahzn53kxxJaNpPGu6 | 1.5.8 | 10001| 10004| 10005| 10002| 10003| 10007| 10008| 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.214.97 | 5977 | 4JryygoiM1j324fYkeBzcQDcwRfd2WpgkEzUePFj1rJY | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.212.39 | 2765 | FdmF6aFAy3pisaTwcQnvLf43z3pd1QnqrNzFMa2vKABA | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.204.230 | 5012 | AGsrW2sp9mqNp7g9Nqw6g1A9wMyDYysqTN6d8oaw2W4s | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.216.62.174 | 3052 | 7a5LzTSypUjVm9FsKT23MGksFUUTqbBcyof3AE5vS692 | - | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.109.190 | 1421 | DFKj3e6WeQmLxQkRBHq7nqcEXjwkcfJGCt22VySeDiKx | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.125.4.18 | 6031 | cZCvgqgrdX2LCScVku8CprMnAUZtSicBDJ8eiowfonn | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.4.249 | 3061 | DJHsoHQvqYjb8G2Ni6XSbBSHxmycMAsZksRDytQ2bntK | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.125.4.201 | 812 | Azg1hC9mg7pkSq6Q5sAESsBsrxHoUuyRnUYSCJMJMdup | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 46.4.107.188 | 6696 | EXCMwETx5Txcvxt6YYqxFmhSpQKH5BVjdat3NE5eJJ6a | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.178.136 | 2031 | Hsb14Gkhjbp6FinDcPRwrThS8BYsTnrhGY8Ui4f3EY7V | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.192.28.244 | 3810 | Et6LRD8K8RGxXd2hscYkjNMNuFhYsNeBY1Eh2r5xpa2c | - | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.113.223 | 2460 | CVAAQGA8GBzKi4kLdmpDuJnpkSik6PMWSvRk3RDds9K8 | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.19.231 | 2636 | 9rVx9wo6d3Akaq9YBw4sFuwc9oFGtzs8GsTfkHE7EH6t | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.125.97.30 | 3787 | DViARWAWKkxAzp4UCgbw5B9pLSrBY3PaztFErcwgVUKX | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.230.51 | 3558 | GSXEn8TVBgiqfiLP5c8VmUrdAX8sWDZVE9M6p2kZFehG | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.177.79 | 1518 | 8CzsSMYcmtFmcGpYYv98kcoQQaWQLVtpQRUzEw6awPHU | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.183.233 | 3787 | 55rEq5xznJEMEShWB9GFv5WNX5NfCZckLZbXXDyW2seb | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.92.0.44 | 381 | ba4MuwPdsx6DKXY6vVCbheAi5UTiMgmBefCGbVhfeQY | - | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 85.190.150.227 | 2548 | G2TBEh2ahNGS9tGnuBNyDduNjyfUtGhMcssgRb8b6KfH | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.113.25 | 3950 | DTF5DM36Jc4vkVPJXbSm7wRLe6eeX1UWo72WQhxKJpR2 | 1.5.8 | 8001 | 8003 | 8004 | 8000 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 10.0.104.71 | 7918 | 8sBc7j6pwLBNP9ypxv72YJPfKPiP4V1THophBaqDK7h3 | - | 9000 | 9003 | 9004 | 9001 | 9002 | 9006 | 9007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 144.76.105.203 | 1579 | Zb8KTJXwFvBTnbEDbyxWs8AVWjjipbXNFAfc1Jsbhey | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 116.202.33.67 | 6591 | CVRr5oHCAAooVbYze7CvXtRp4FUtkMCSqBZU7MVu8v8e | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.183.35 | 2940 | FCWkGAHDWK41ANjiaoPudkCZRkvTecaEkoZQugezUnpr | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 199.127.60.135 | 3577 | 692qK4TkXnrGfDZfoSq9aFfnoE2WNW5TpMRnN7M3sumF | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.179 | 2327 | ECVbrGZPifC3W8KcxZH81JXkRnbyx73Nn1gt4dXPw6WX | - | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.140.158 | 1776 | EUVBn58XXTX9RBTm1R7Wd8n8JkvBMQfc9uSn5wPhbdBL | 1.5.8 | 8001 | 8004 | 8005 | 8002 | 8003 | 8007 | 8008 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.224.148 | 7465882 | J5MroSHMzcPUTXcnpXygeCFnXJ39NBG5RRQRYD29ZwNy | 1.5.8 | 8000 | 8003 | 8004 | 8001 | 8002 | 8006 | 8007 | 13490
--
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.90.36.12 | 5131 | DE1bawNcRJB9rVm3buyMVfr8mBEoyyu73NBovf2oXJsJ | 1.5.8 | 80 | 80 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.91.68.60 | 5166 | 8cauUtCTNHzFVikbFAnkyA19QCQwQKXgz2Qd3eqTGKrM | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.125.104.36 | 6015 | BAHNFqttxYMMZUDqMm1JQPnxkZoHLnpash1ouM7pnLEA | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 37.120.245.134 | 1573 | 3KNGMiXwhy2CAWVNpLoUt25sNngFnX1mZpaiEeVccBA6 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.196.211 | 490 | AWHfhBSMN7rX7NEDrKNfjnUyR7W1xpfistTy6w9GqT6U | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 87.255.8.92 | 3750 | DeCcxJU8AqxPRZ27wrKYKRgmNHwCUK7MvW5XPGWh8WZF | 1.5.8 | 30333| 30334| 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.38.168 | 1863 | 9xsgKAU3pyKZZddPXdh5wLRqjdw2Fc93BL41JszhEpZz | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.137.91 | 4170 | EwUVzgSPe1zy2hfUGZxJAEP7Y1wheNgNsgratbzPELru | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.2.250 | 2767 | Arvv3uwEyDPKckw3wEFiCq9hgxMw8kawFU6doxFAWGYR | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.166.31 | 4608 | FCQTtjeFK7Fj64aVDwdahfyxiG94uLnUjkmmXUq2esuf | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.90.18.128 | 4659 | 13aMTrudPy9Bup52R8TSmDAHv9qun9jKDwpw7to4PDgC | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.208.166 | 4493 | nSGZ3tv2UhskkPqiB666yDVj7PTi9qKgDqvjHyw5JgM | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.211.186 | 7376 | 5HXxjDZwm7MAZAm2aCgGcGRr3SKiwugcQymoByyd7pfv | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 188.40.80.202 | 2803 | 9UsSQ9m5QemVf9NFmKncDDXGFGzUXMiFay9Fv7rUmjtV | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 195.201.196.176 | 6786 | e1afFaogyDznnUBMWQbPgnZ3VUzkGVsEhyxBPH13BVx | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.178 | 5647 | E188uBYYTtgG9yrWykWAYBmzAP29ua8w2cZPpjTy8UUG | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.169.252.182 | 825 | ECj6cTT63iQgZh7cEiR5HayV6pJZDLTV2cNLFyBvajWz | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 136.143.1.48 | 7167 | FoigPJ6kL6Gth5Er6t9d1Nkh96Skadqw63Ciyjxc1f8H | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 51.83.223.200 | 749 | 9e7XGRqQqEvppx4Lkj6P1S7k65yWQpf3vcNzWecKSzDd | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.61.118 | 2238 | HwdfNWCqP2vXRvaHqQhoVUM2uPndaY8DDJzzBxCoPNHU | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.82.149.17 | 6992 | betaVcnkBhHKaWx9o6LoSYrGaoDCskQLm94cUVWqDLS | 1.6.0 | 80 | 80 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.165.80 | 4697 | nVmiYamBpwzEqxykaGBWvY9W4R7rmK1JudonPRhmkAw | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.162.212 | 457 | CcTtRsmLJEjqsv5iyfXSYwjaUJdfrRK7AU9cHMnQfTb3 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 148.251.121.52 | 636 | 8Ey5FDayWYgJdVoquScT2hJDKWk7nQQfqzfGBt1emJpx | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.42.251 | 4170 | ExyEA6EegthLVNEjkj37FDGUnokPHqtEEe58ncBAww7u | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 8.210.146.34 | 1003 | 4UPNtb4AhJzHauju5cW2Zs1DnGV52s6MsUnfLUU1cuGt | - | 30333| 30334| 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.83.175.225 | 2158 | Certusm1sa411sMpV9FPqU5dXAYhmmhygvxJ23S6hJ24 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.136.246 | 5316 | J78SNwDW6G86sMmh7djnBKGjewXNpjD74sJTjJ1iNgTH | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.172.154.65 | 383 | J2jV3gQsvX2htBXHeNStAVvMJaPe3RgNotwfav9pyS6y | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 188.40.99.246 | 7971 | 2UuVd6BMW97MRnj7mCpq8PhYmqmUYuojvDkqWstwASCm | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.177.11 | 2715 | 3P5hcynUJe7u4icW8pH4ZEAh646TwGnVZWh3YR3yyjsg | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.170.41.17 | 6992 | Diman2GphWLwECE3swjrAEAJniezpYLxK1edUydiDZau | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.237.115.241 | 6300 | GdnSyH3YtwcxFvQrVVJMm1JhTS4QVX7MFsX56uJLUfiZ | - | 80 | 80 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.211.185 | 3625 | ECULsxDc7pqadpQSQxFaNWAsemLW3wQq1vDKXg5P7GjW | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 136.144.57.207 | 7670 | a1phaKk6UbG1P2ZCpfMVFUeRM5E2EZhGvUjqWHRsrip | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.162.85 | 4079 | 42xkjBQvPyicSdCET8eTWwJayTBofFLGWyCiuodd1SoT | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.170.46.179 | 6021 | Cu9Ls6dsTL6cxFHZdStHwVSh1uy2ynXz8qPJMS5FRq86 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 157.90.5.119 | 2803 | DE37cgN2bGR26a1yQPPY42CozC1wXwXnTXDyyURHRsm7 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 178.170.42.23 | 814 | siriXy5CcarNiz4XL8ssBQGiy2PwReVLny3Bcxq6Ymb | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.132.210 | 893 | ALp2GdA1eJV8vZHMHazCtTxNXe3BLUSco9LDASgjDs8R | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.90.0.172 | 4066 | ba7p14iARCNfq8wrcAakfNXrqY4CtJ2C4eE5ic79mpF | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.236.145.202 | 6925 | J1PFE4A3Cj46YHf2aAx1WEbiZVT8xcF6xziJYpbQ2j2y | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.179.38 | 2028 | FaGBP8LJrXE5h3cFRtPxz8x8695LQAYnvYn3NGtVtvrw | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.118.121 | 2702 | Fw3khiQmpKLSdNyoVR52WxbTWT9gjFSXFsZewknwLGb5 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.228.22.62 | 1370 | Dc4nTmJkKyq1qGem4VWqrXHWC6d8qwTYra8Kf3tcLjCF | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.133.57 | 5674 | CYkkaM5KwoxaFtZcximkm1DFYnABdiUUUvJg1WURDRsh | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.216.26.22 | 2344 | 67joanjyAoVmb9nZLyX8p3Gx9tAxzXaUgHDe3kaUH4wf | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 95.217.44.164 | 2767 | BLPBUAuWmjTKT8rF6nXnHJCcuK4ZonH4xdYSD1gZiET9 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.116.9 | 5375 | 3LboiLyZ3U1556ZBnNi9384C8Gz1LxFmzRnAojumnCJB | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 136.243.40.56 | 893 | HzvGtvXFzMeJwNYcUu5pw8yyRxF2tLEvDSSFsAEBcBK2 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 143.110.233.187 | 3163 | FMcxJrnU61J7s74PhmNdbyJjDJ4b6npACF6Zs2bKeFWX | 1.4.20 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.183.17.247 | 6444 | 7F1jW7L67QKVf4tWrxVEuDXFH9WugLvUUKsoU9ii9sFD | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.91.224.67 | 636 | DHa1jredGwNGLd5VUVyT2pbBrkFwTzWu9JR2JriiJLpt | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.226.225.167 | 4490 | FAM2NHbXEeKeYfiLsQnE12x3X1kX5CM4Pz5SAkM9Mf5u | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.181 | 3063 | 7fu5HkZtSzB1tzbw9VtQj7HGz6TmRhhDCTvY6dtkpuBd | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.223.144.254 | 6768 | H61iRFShtpsG2RAgcTqtu27kkKmLZcSSSWNBxXbGFjZZ | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.236.124.218 | 7167 | BAbRkBYDhThcR8rn7wYtPYSxDnUCfRYx5dAjsuianuA6 | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 135.181.164.154 | 2554 | BvXzmS5rLW89nHD7K2qVjcERKigDdJ8Xhc74MQZumj9J | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 157.90.32.190 | 5666 | 8WjzRz9HM2bWBopD6UPbi3swyRE5kk9aJojhn6fBKTJk | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 72.182.108.27 | 5591 | BjuD62v9RysrburpKb65UKeaAWRSFyi7pFLLxdE3dPv | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.204.171.240 | 272 | ba2eZEU27TqR1MB9WUPJ2F7dcTrNsgdx38tBg53GexZ | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 157.90.91.171 | 153 | CLNszm8BPSKv7JgfBB5waQKPHAgXbyHazd6EGsLgktZY | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 10.4.189.91 | 5811 | Uzspsw1tdbaGQmadTdfGiqz8expWsuzc2SfV6qAMAPS | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 80.174.220.163 | 6300 | 5QfoepAhsuEZcP82jV1521o7p1hbZ8iaXAcahhW2TFW3 | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 54.171.10.198 | 2695 | 34cTh3LQgZtvCSeTLfRWc3atNWykZf7NimH5G2VtUDod | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 62.4.22.216 | 2499 | 7caoQbumZE1QYCaMoiV3CKgxtgZCwdHp2rxbgDZpr5VC | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 198.55.56.164 | 5204 | FshmkeZbT8Q7NveSjVpy8FZBgJ6sigK8Etz1cX7Jmyu5 | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 198.55.56.166 | 2803 | H5FD5GxuE46hqi5paMkcqt9WeHvszZA7RgBfMoMpfNDK | - | 14000| 14001| 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 15.237.67.160 | 3627 | 5GtUxJkFfGFxVqbjTvvJAwrAsvyPzqofQpYTcKzrhxQA | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.180 | 7167 | G6qU7GoNHTpPrMtL9g5stYum7A5f7wNaTzQ5gYmEEh5u | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.183 | 2686 | 3aQz2DYV1BXxgf4NhJPcZHaxc9Qwq2r6XFUTQXHbFMEH | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 34.64.218.187 | 272 | ba3zMkMp87HZg27Z7EDEkxE48zcKgJ59weFYtrKadY7 | 1.5.8 | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 104.198.102.145 | 5014 | 7Np41oeYqPefeNQEHSv1UDhYrehxin3NStELsSKCT4K2 | - | 80 | 80 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 5.62.126.182 | 2951 | FQfu1mRZXEdPL4pHsnM3ybNNRMeWrrEou5NcJfutzWdD | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: 35.236.197.1 | 4226 | ba5rfuZ37gxhrLcsgA5fzCg8BvSQcTERPqY14Qffa3J | - | 8899 | 8900 | 13490
Feb 25 03:13:35 solana-production-lax chrt[15385]: RPC Enabled Nodes: 101
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.556509042Z INFO solana_metrics::metrics] datapoint: shred_fetch_repair index_overrun=0i shred_count=67i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=18i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.672482474Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133406968, "samples": 77651000, "now": 1614222815672, "events": 1}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.733607969Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=1020i slot=66728403i last_index=646i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.755967099Z INFO solana_metrics::metrics] datapoint: poh-service ticks=183i hashes=2302222i elapsed_ms=351i total_sleep_ms=180i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.891272841Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38872206, "samples": 48357000, "now": 1614222815891, "events": 2}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.891302351Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55461753, "samples": 48357000, "now": 1614222815891, "events": 2}
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.945057789Z INFO solana_core::replay_stage] bank frozen: 66728403
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.945062232Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728403i fetch_entries_time=1796i fetch_entries_fail_time=0i entry_poh_verification_time=12937i entry_transaction_verification_time=3571i replay_time=389127i replay_total_elapsed=409318i total_entries=687i total_shreds=647i load_us=228758i execute_us=483825i store_us=166167i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.945154674Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=62i latest_slot_elapsed=1i read_lock_elapsed=0i load_account_elapsed=14i iterator_elapsed=7i num_keys_iterated=35i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.945264040Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=33i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.946554913Z INFO solana_runtime::bank] bank frozen: 66728403 hash: 2YGFKngtUNXBWaFZm9m9qUn6Evn4tx9sZu9eAGWGHXae accounts_delta: MM2QSGbwrzM7yYfQqgLBmR1bevUrrPc3uVDcxdDirTE signature_count: 816 last_blockhash: 3S7sEgwRdHmokXmPQiao3ktZLKAZZwkuweLqTQikrcHY capitalization: 489650015321755348
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.946574480Z INFO solana_runtime::bank] accounts hash slot: 66728403 stats: BankHashStats { num_updated_accounts: 3609, num_removed_accounts: 10, num_lamports_stored: 4883929332271520, total_data_len: 539639649, num_executable_accounts: 65 }
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.946591416Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=2271i same_account_writes_size=336722999i unique_account_writes_size=202916650i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.946683328Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=40i num_slots=102i total_unique_writes_size=20733926198i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.948006020Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728397i root=66728307i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.950723270Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728403 0 0 66728402
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.950754955Z INFO solana_core::replay_stage] voting: 66728403 0
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.950771083Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728403i best_slot=66728403i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.950798120Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728403i weight="0"
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.950801750Z INFO solana_metrics::metrics] datapoint: tower-vote latest=66728403i root=66728333i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.954552388Z INFO solana_core::replay_stage] new root 66728333
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.954906018Z INFO solana_core::replay_stage] vote bank: Some((66728403, SameFork)) reset bank: 66728403
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.954919485Z INFO solana_metrics::metrics] datapoint: blocks_produced num_blocks_on_fork=39490i num_dropped_blocks_on_fork=20939i
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.954952873Z INFO solana_core::poh_recorder] reset poh from: FHmE7GfzH9toQdGqRxRb4ms9TZ4ACDcuBqc4MZxTHhiy,4270617869,66728402 to: 3S7sEgwRdHmokXmPQiao3ktZLKAZZwkuweLqTQikrcHY,66728403
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.954963291Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp reset PoH to tick 4270617856 (within slot 66728403). My next leader slot is 66728408
Feb 25 03:13:35 solana-production-lax chrt[15385]: [2021-02-25T03:13:35.958509708Z INFO solana_metrics::metrics] datapoint: block-commitment-cache aggregate-commitment-ms=3i highest-confirmed-root=66728311i highest-confirmed-slot=66728398i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.063481048Z INFO solana_metrics::metrics] datapoint: optimistic_slot_elapsed average_elapsed_ms=610i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.063497980Z INFO solana_metrics::metrics] datapoint: optimistic_slot slot=66728401i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.374113454Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-tick_lock_contention", "counts": 897126, "samples": 8103000, "now": 1614222816374, "events": 0}
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.374130987Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-tick_overhead", "counts": 23115364, "samples": 8103000, "now": 1614222816374, "events": 0}
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.556805541Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34508435, "samples": 7708000, "now": 1614222816556, "events": 14}
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.561993852Z INFO solana_metrics::metrics] datapoint: replay-loop-timing-stats total_elapsed_us=1029000i collect_frozen_banks_elapsed=176i compute_bank_stats_elapsed=4208i select_vote_and_reset_forks_elapsed=9i start_leader_elapsed=0i reset_bank_elapsed=62i voting_elapsed=4147i select_forks_elapsed=6i compute_slot_stats_elapsed=11i generate_new_bank_forks_elapsed=7758i replay_active_banks_elapsed=409800i reset_duplicate_slots_elapsed=2333i wait_receive_elapsed=600393i heaviest_fork_failures_elapsed=0i bank_count=1i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.645937439Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-forwarded_packets", "counts": 20726946, "samples": 4541000, "now": 1614222816645, "events": 1}
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.658489974Z INFO solana_metrics::metrics] datapoint: recv-window-insert-shreds num_shreds=4244i total_elapsed=367216i insert_lock_elapsed=35i insert_shreds_elapsed=152656i shred_recovery_elapsed=97458i chaining_elapsed=64i commit_working_sets_elapsed=16229i write_batch_elapsed=86087i num_inserted=1465i num_repair=57i num_recovered=1135i num_recovered_inserted=1135i num_recovered_failed_sig=0i num_recovered_failed_invalid=0i num_recovered_exists=0i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.757982570Z INFO solana_metrics::metrics] datapoint: poh-service ticks=183i hashes=2293681i elapsed_ms=350i total_sleep_ms=197i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.793849515Z INFO solana_metrics::metrics] datapoint: optimistic_slot_elapsed average_elapsed_ms=730i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.793868017Z INFO solana_metrics::metrics] datapoint: optimistic_slot slot=66728402i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.830807171Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34512866, "samples": 7709000, "now": 1614222816830, "events": 23}
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.913960902Z INFO solana_metrics::metrics] datapoint: shred_fetch_tvu_forwards index_overrun=0i shred_count=172i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.922295985Z INFO solana_metrics::metrics] datapoint: shred_fetch index_overrun=0i shred_count=1i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.966848622Z INFO solana_core::replay_stage] new fork:66728404 parent:66728403 root:66728333
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.967790675Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728404i block_height=61209991i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.968776914Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings hash_accounts=154050i store_accounts=85914i update_index=8243i handle_reclaims=11i append_accounts=0i find_storage=0i num_accounts=5322i total_data=813186560i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.968783361Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings2 recycle_store_count=0i current_recycle_store_count=1000i current_recycle_store_bytes=6383095808i create_store_count=0i store_get_slot_store=0i store_find_existing=0i dropped_stores=0i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.969083887Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=296i
Feb 25 03:13:36 solana-production-lax chrt[15385]: [2021-02-25T03:13:36.969087629Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728404i from_genesis=1611060301i corrected=1614222829i ancestor_timestamp=1614222828i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.095397523Z INFO solana_metrics::metrics] datapoint: cluster_info_stats entrypoint=0i entrypoint2=0i push_vote_read=44i get_votes=6276i get_accounts_hash=0i all_tvu_peers=0i tvu_peers=1192i new_push_requests_num=1655i table_size=276711i purged_values_size=90021i failed_inserts_size=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.095420197Z INFO solana_metrics::metrics] datapoint: cluster_info_stats2 gossip_packets_dropped_count=0i retransmit_peers=2478i repair_peers=18541i new_push_requests=165833i new_push_requests2=237i purge=70428i process_gossip_packets_time=2154018i handle_batch_ping_messages_time=131i handle_batch_pong_messages_time=42i handle_batch_prune_messages_time=3548i handle_batch_pull_requests_time=1389420i handle_batch_pull_responses_time=0i handle_batch_push_messages_time=465100i process_pull_resp=0i filter_pull_resp=0i process_pull_resp_count=0i pull_response_fail_insert=0i pull_response_fail_timeout=0i pull_response_success=0i process_pull_resp_timeout=0i push_response_count=4578i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.095428054Z INFO solana_metrics::metrics] datapoint: cluster_info_stats3 process_pull_resp_len=0i process_pull_requests=578i pull_request_ping_pong_check_failed_count=0i generate_pull_responses=1334306i process_prune=220i process_push_message=141987i prune_received_cache=18845i epoch_slots_lookup=37i new_pull_requests=123330i mark_pull_request=4i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.095432057Z INFO solana_metrics::metrics] datapoint: cluster_info_stats4 skip_push_message_shred_version=0i skip_pull_response_shred_version=0i skip_pull_shred_version=0i push_message_count=15263i push_message_value_count=19009i new_pull_requests_count=5120i prune_message_count=289i prune_message_len=465i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.095435168Z INFO solana_metrics::metrics] datapoint: cluster_info_stats5 pull_requests_count=9325i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.115143183Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34517400, "samples": 7710000, "now": 1614222817115, "events": 18}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.178219282Z INFO solana_metrics::metrics] datapoint: shred_fetch_repair index_overrun=0i shred_count=5i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=1i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.195767685Z INFO solana_metrics::metrics] datapoint: optimistic_slot_elapsed average_elapsed_ms=401i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.195784909Z INFO solana_metrics::metrics] datapoint: optimistic_slot slot=66728403i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.307550687Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34521879, "samples": 7711000, "now": 1614222817307, "events": 16}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.434045917Z INFO solana_metrics::metrics] datapoint: retransmit-num_nodes count=646i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.434047057Z INFO solana_core::retransmit_stage] retransmit: packets_by_slot: {66728404: 962}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.434069184Z INFO solana_metrics::metrics] datapoint: retransmit-stage total_time=96617i epoch_fetch=975i epoch_cache_update=2038i total_batches=874i total_packets=962i retransmit_total=24358i compute_turbine=61015i repair_total=196i discard_total=11i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.434086679Z INFO solana_core::retransmit_stage] retransmit: top packets_by_source: {40: "5.83.175.225:8005", 69: "135.181.19.7:8005", 90: "89.202.64.28:58008", 95: "85.190.150.50:8005", 122: "173.231.58.226:8006"} len: 199
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.452618785Z INFO solana_core::replay_stage] new fork:66728408 parent:66728403 (leader) root:66728333
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.452619352Z INFO solana_metrics::metrics] datapoint: replay_stage-new_leader slot=66728408i leader="DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp"
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.452643221Z INFO solana_metrics::metrics] datapoint: replay_stage-my_leader_slot slot=66728408i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.453564974Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728408i block_height=61209991i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.454893494Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=267i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.454914444Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728408i from_genesis=1611060303i corrected=1614222830i ancestor_timestamp=1614222828i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.455185313Z INFO solana_core::replay_stage] LEADER CHANGE at slot: 66728408 leader: DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp. I am now the leader
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.455563207Z INFO solana_metrics::metrics] datapoint: cluster_info-num_nodes live_count=637i broadcast_count=646i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.460781863Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12273055, "samples": 30867000, "now": 1614222817460, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.461199076Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94533141, "samples": 45377000, "now": 1614222817461, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.468789593Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133409730, "samples": 77652000, "now": 1614222817468, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.474940613Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_lock_contention", "counts": 14242849, "samples": 1588000, "now": 1614222817474, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.474967704Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_ms", "counts": 1793631, "samples": 1588000, "now": 1614222817474, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.477486223Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76078172, "samples": 29350000, "now": 1614222817477, "events": 18}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.481365865Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12275416, "samples": 30868000, "now": 1614222817481, "events": 13}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.483344362Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94537610, "samples": 45378000, "now": 1614222817483, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.486986525Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133414272, "samples": 77653000, "now": 1614222817486, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.486992122Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-record_transactions", "counts": 1688344, "samples": 1589000, "now": 1614222817486, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.495167896Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76082796, "samples": 29351000, "now": 1614222817495, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.497280493Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12278287, "samples": 30869000, "now": 1614222817497, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.498489054Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94542362, "samples": 45379000, "now": 1614222817498, "events": 17}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.502685772Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133418745, "samples": 77654000, "now": 1614222817502, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.503722278Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error-blockhash_not_found", "counts": 697422, "samples": 463000, "now": 1614222817503, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.508505359Z INFO solana_metrics::metrics] datapoint: cluster_slots_service-timing lowest_slot_elapsed=10172i update_completed_slots_elapsed=94394i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.517772234Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76086761, "samples": 29352000, "now": 1614222817517, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.518847071Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12280289, "samples": 30870000, "now": 1614222817518, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.521868865Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94545942, "samples": 45380000, "now": 1614222817521, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.525307823Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133422010, "samples": 77655000, "now": 1614222817525, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.537926861Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76089275, "samples": 29353000, "now": 1614222817537, "events": 16}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.537954789Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12280954, "samples": 30871000, "now": 1614222817537, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.541568550Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94548231, "samples": 45381000, "now": 1614222817541, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.543900040Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133424217, "samples": 77656000, "now": 1614222817543, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.555942935Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281011, "samples": 30872000, "now": 1614222817555, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.557630457Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76091356, "samples": 29354000, "now": 1614222817557, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.560877877Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94550313, "samples": 45382000, "now": 1614222817560, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.562961917Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133426258, "samples": 77657000, "now": 1614222817562, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.576663438Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281046, "samples": 30873000, "now": 1614222817576, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.579514410Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76093238, "samples": 29355000, "now": 1614222817579, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.583518610Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133428179, "samples": 77658000, "now": 1614222817583, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.583851347Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94552225, "samples": 45383000, "now": 1614222817583, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.594703695Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38873217, "samples": 48358000, "now": 1614222817594, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.594736243Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55462962, "samples": 48358000, "now": 1614222817594, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.594965009Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281081, "samples": 30874000, "now": 1614222817594, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.597736497Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76095307, "samples": 29356000, "now": 1614222817597, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.598794869Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133430187, "samples": 77659000, "now": 1614222817598, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.599930494Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94554211, "samples": 45384000, "now": 1614222817599, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.613185125Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281130, "samples": 30875000, "now": 1614222817613, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.616110834Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133432078, "samples": 77660000, "now": 1614222817616, "events": 5}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.617029403Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76097251, "samples": 29357000, "now": 1614222817617, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.619379728Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94556105, "samples": 45385000, "now": 1614222817619, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.634419585Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281156, "samples": 30876000, "now": 1614222817634, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.636849689Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133434121, "samples": 77661000, "now": 1614222817636, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.639900363Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76099244, "samples": 29358000, "now": 1614222817639, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.640933533Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94558087, "samples": 45386000, "now": 1614222817640, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.652330649Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_lock_contention", "counts": 14252533, "samples": 1589000, "now": 1614222817652, "events": 12}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.652456534Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_ms", "counts": 1794831, "samples": 1589000, "now": 1614222817652, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.654779254Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281182, "samples": 30877000, "now": 1614222817654, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.656153660Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133436081, "samples": 77662000, "now": 1614222817656, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.662985638Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76101295, "samples": 29359000, "now": 1614222817662, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.663013784Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94560107, "samples": 45387000, "now": 1614222817663, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.668196584Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-record_transactions", "counts": 1689410, "samples": 1590000, "now": 1614222817668, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.675439935Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281208, "samples": 30878000, "now": 1614222817675, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.675985800Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133437951, "samples": 77663000, "now": 1614222817675, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.684270609Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94562072, "samples": 45388000, "now": 1614222817684, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.684787066Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76103281, "samples": 29360000, "now": 1614222817684, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.696561730Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133439938, "samples": 77664000, "now": 1614222817696, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.696720904Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281237, "samples": 30879000, "now": 1614222817696, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.704754626Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94563983, "samples": 45389000, "now": 1614222817704, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.705260056Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76105198, "samples": 29361000, "now": 1614222817705, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.714431068Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133441916, "samples": 77665000, "now": 1614222817714, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.715699438Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281271, "samples": 30880000, "now": 1614222817715, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.723179905Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38874103, "samples": 48359000, "now": 1614222817723, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.723213401Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55464114, "samples": 48359000, "now": 1614222817723, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.724711066Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error-instruction_error", "counts": 16109658, "samples": 15616000, "now": 1614222817724, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.725156137Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94566008, "samples": 45390000, "now": 1614222817725, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.726576268Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76107290, "samples": 29362000, "now": 1614222817726, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.733656840Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133443915, "samples": 77666000, "now": 1614222817733, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.734847072Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281294, "samples": 30881000, "now": 1614222817734, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.742601582Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94568086, "samples": 45391000, "now": 1614222817742, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.744535352Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76109370, "samples": 29363000, "now": 1614222817744, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.748933002Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133446002, "samples": 77667000, "now": 1614222817748, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.749929737Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281322, "samples": 30882000, "now": 1614222817749, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.757282309Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94570215, "samples": 45392000, "now": 1614222817757, "events": 3}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.758788853Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76111484, "samples": 29364000, "now": 1614222817758, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.760451580Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-rebuffered_packets", "counts": 63866561, "samples": 8062000, "now": 1614222817760, "events": 55}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.760501353Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-consumed_buffered_packets", "counts": 76672956, "samples": 8062000, "now": 1614222817760, "events": 57}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.762709198Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133448095, "samples": 77668000, "now": 1614222817762, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.764076359Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281350, "samples": 30883000, "now": 1614222817764, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.764530380Z INFO solana_metrics::metrics] datapoint: poh-service ticks=154i hashes=1923176i elapsed_ms=418i total_sleep_ms=107i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.773049734Z INFO solana_metrics::counter] COUNTER:{"name": "broadcast_service-entries_received", "counts": 1744904, "samples": 1064000, "now": 1614222817773, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.773902050Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94572299, "samples": 45393000, "now": 1614222817773, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.775977336Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76113631, "samples": 29365000, "now": 1614222817775, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.778345501Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133450171, "samples": 77669000, "now": 1614222817778, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.779493684Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281375, "samples": 30884000, "now": 1614222817779, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.788425539Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94574457, "samples": 45394000, "now": 1614222817788, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.790793237Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76115792, "samples": 29366000, "now": 1614222817790, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.792848888Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133452300, "samples": 77670000, "now": 1614222817792, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.793837623Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281395, "samples": 30885000, "now": 1614222817793, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.805314596Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94576587, "samples": 45395000, "now": 1614222817805, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.808040444Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76117940, "samples": 29367000, "now": 1614222817808, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.809874532Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133454425, "samples": 77671000, "now": 1614222817809, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.810501978Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281415, "samples": 30886000, "now": 1614222817810, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.820093346Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94578793, "samples": 45396000, "now": 1614222817820, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.822004012Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76120123, "samples": 29368000, "now": 1614222817822, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.822512292Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133456569, "samples": 77672000, "now": 1614222817822, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.823662388Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281440, "samples": 30887000, "now": 1614222817823, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.829714161Z INFO solana_metrics::metrics] datapoint: replay-loop-timing-stats total_elapsed_us=1268000i collect_frozen_banks_elapsed=235i compute_bank_stats_elapsed=694i select_vote_and_reset_forks_elapsed=10i start_leader_elapsed=2591i reset_bank_elapsed=0i voting_elapsed=0i select_forks_elapsed=10i compute_slot_stats_elapsed=0i generate_new_bank_forks_elapsed=8645i replay_active_banks_elapsed=251535i reset_duplicate_slots_elapsed=2846i wait_receive_elapsed=1000584i heaviest_fork_failures_elapsed=0i bank_count=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.833926358Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94581039, "samples": 45397000, "now": 1614222817833, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.835679446Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76122349, "samples": 29369000, "now": 1614222817835, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.836376259Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133458803, "samples": 77673000, "now": 1614222817836, "events": 3}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.837009264Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281457, "samples": 30888000, "now": 1614222817837, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.849844813Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94583155, "samples": 45398000, "now": 1614222817849, "events": 7}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.852597624Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133460942, "samples": 77674000, "now": 1614222817852, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.853290279Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76124581, "samples": 29370000, "now": 1614222817853, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.855380135Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281483, "samples": 30889000, "now": 1614222817855, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.866490627Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94585345, "samples": 45399000, "now": 1614222817866, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.867899315Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133463102, "samples": 77675000, "now": 1614222817867, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.870005022Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76126843, "samples": 29371000, "now": 1614222817870, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.871139595Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281510, "samples": 30890000, "now": 1614222817871, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.882576192Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94587626, "samples": 45400000, "now": 1614222817882, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.883747611Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133465352, "samples": 77676000, "now": 1614222817883, "events": 6}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.885794447Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76129080, "samples": 29372000, "now": 1614222817885, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.886474930Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281532, "samples": 30891000, "now": 1614222817886, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.895892462Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94589883, "samples": 45401000, "now": 1614222817895, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.896572480Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133467603, "samples": 77677000, "now": 1614222817896, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.900088051Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76131396, "samples": 29373000, "now": 1614222817900, "events": 3}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.900554365Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281550, "samples": 30892000, "now": 1614222817900, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.907769963Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_lock_contention", "counts": 14261682, "samples": 1590000, "now": 1614222817907, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.907795218Z INFO solana_metrics::counter] COUNTER:{"name": "poh_recorder-record_ms", "counts": 1795980, "samples": 1590000, "now": 1614222817907, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.912934735Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94592138, "samples": 45402000, "now": 1614222817912, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.913236793Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133469833, "samples": 77678000, "now": 1614222817913, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.915559007Z INFO solana_metrics::metrics] datapoint: shred_fetch_tvu_forwards index_overrun=0i shred_count=2113i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.917462941Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76133695, "samples": 29374000, "now": 1614222817917, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.917672236Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281574, "samples": 30893000, "now": 1614222817917, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.923489889Z INFO solana_metrics::metrics] datapoint: shred_fetch index_overrun=0i shred_count=45i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.927927420Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94594456, "samples": 45403000, "now": 1614222817927, "events": 10}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.927961622Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133472092, "samples": 77679000, "now": 1614222817927, "events": 2}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.932805649Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281597, "samples": 30894000, "now": 1614222817932, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.932883282Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76136010, "samples": 29375000, "now": 1614222817932, "events": 4}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.934714986Z INFO solana_core::poh_recorder] poh_record: max_tick_height 4270618176 reached, clearing working_bank 66728408
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.934842495Z INFO solana_core::banking_stage] process transactions: max height reached slot: 66728408 height: 4270618176
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.934885093Z INFO solana_core::banking_stage] process transactions: max height reached slot: 66728408 height: 4270618176
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.934913104Z INFO solana_metrics::metrics] datapoint: broadcast-process-shreds-stats slot=66728408i shredding_time=115338i receive_time=91316i num_data_shreds=1596i slot_broadcast_time=479956i get_leader_schedule_time=24595i serialize_shreds_time=7429i gen_data_time=105809i gen_coding_time=60935i sign_coding_time=91147i coding_send_time=60935i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.934848003Z INFO solana_core::banking_stage] process transactions: max height reached slot: 66728408 height: 4270618176
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.935525264Z INFO solana_core::replay_stage] bank frozen: 66728408
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.935614226Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728408i fetch_entries_time=0i fetch_entries_fail_time=0i entry_poh_verification_time=0i entry_transaction_verification_time=0i replay_time=0i replay_total_elapsed=379348i total_entries=0i total_shreds=0i load_us=0i execute_us=0i store_us=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.935695336Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34525050, "samples": 7712000, "now": 1614222817935, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.936309401Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=573i latest_slot_elapsed=1i read_lock_elapsed=0i load_account_elapsed=359i iterator_elapsed=19i num_keys_iterated=203i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.936897640Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=196i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.938797892Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34526874, "samples": 7713000, "now": 1614222817938, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.939267209Z INFO solana_runtime::bank] bank frozen: 66728408 hash: 7oS6FugGU14REMsiNEUGveUokLoLBz8dRP3WnGdXQ5x8 accounts_delta: GHJgjKqS52pNmRZRGHQpGAsgdGTyJuFnGTT5euDfT6Z1 signature_count: 2377 last_blockhash: 9FBTsM5FpfTdjTmRdDkXNdRNp2vW4KxV8umcLH7WJNDQ capitalization: 489650015315812848
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.939289008Z INFO solana_runtime::bank] accounts hash slot: 66728408 stats: BankHashStats { num_updated_accounts: 10751, num_removed_accounts: 57, num_lamports_stored: 14743944588127385, total_data_len: 1716985732, num_executable_accounts: 161 }
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.939383343Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=8502i same_account_writes_size=1448043409i unique_account_writes_size=268942158i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.939483242Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=41i num_slots=104i total_unique_writes_size=21163375854i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.969138916Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings hash_accounts=518681i store_accounts=465897i update_index=47704i handle_reclaims=11i append_accounts=0i find_storage=0i num_accounts=13138i total_data=1963644520i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.969158916Z INFO solana_metrics::metrics] datapoint: accounts_db_store_timings2 recycle_store_count=0i current_recycle_store_count=1000i current_recycle_store_bytes=6383095808i create_store_count=0i store_get_slot_store=0i store_find_existing=0i dropped_stores=0i
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.984169754Z INFO solana_metrics::counter] COUNTER:{"name": "vote-native", "counts": 19068001, "samples": 19068000, "now": 1614222817984, "events": 1}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.988783136Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38874880, "samples": 48360000, "now": 1614222817988, "events": 0}
Feb 25 03:13:37 solana-production-lax chrt[15385]: [2021-02-25T03:13:37.988802578Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55465217, "samples": 48360000, "now": 1614222817988, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.112468556Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-buffered_packets", "counts": 34528915, "samples": 7714000, "now": 1614222818112, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.126788452Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728397i root=66728307i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.129671086Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728408i best_slot=66728408i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.129683662Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728408i weight="0"
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.129671994Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728408 0 0 66728403
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.129715349Z INFO solana_core::replay_stage] voting: 66728408 0
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.129726316Z INFO solana_metrics::metrics] datapoint: tower-vote latest=66728408i root=66728333i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.137682467Z INFO solana_metrics::metrics] datapoint: block-commitment-cache aggregate-commitment-ms=4i highest-confirmed-root=66728311i highest-confirmed-slot=66728398i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159081208Z INFO solana_core::replay_stage] vote bank: Some((66728408, SameFork)) reset bank: 66728408
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159102143Z INFO solana_metrics::metrics] datapoint: blocks_produced num_blocks_on_fork=39491i num_dropped_blocks_on_fork=20943i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159120874Z INFO solana_core::poh_recorder] reset poh from: fwWLyx1duuyVkWR3zLth1bq7rUYos9Hp93xEXvQmQPg,4270618217,66728408 to: 9FBTsM5FpfTdjTmRdDkXNdRNp2vW4KxV8umcLH7WJNDQ,66728408
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159186105Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp reset PoH to tick 4270618176 (within slot 66728408). My next leader slot is 66728409
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159201065Z INFO solana_core::replay_stage] new fork:66728409 parent:66728408 (leader) root:66728333
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159204338Z INFO solana_metrics::metrics] datapoint: replay_stage-new_leader slot=66728409i leader="DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp"
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.159213463Z INFO solana_metrics::metrics] datapoint: replay_stage-my_leader_slot slot=66728409i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.160119699Z INFO solana_metrics::metrics] datapoint: bank-new_from_parent-heights slot_height=66728409i block_height=61209992i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.161422495Z INFO solana_metrics::metrics] datapoint: bank-timestamp get_timestamp_estimate_us=218i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.161441411Z INFO solana_metrics::metrics] datapoint: bank-timestamp-correction slot=66728409i from_genesis=1611060303i corrected=1614222831i ancestor_timestamp=1614222830i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.165323068Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133473898, "samples": 77680000, "now": 1614222818165, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.168800290Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94596534, "samples": 45404000, "now": 1614222818168, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.169070340Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-record_transactions", "counts": 1690433, "samples": 1591000, "now": 1614222818169, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.177607246Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12281792, "samples": 30895000, "now": 1614222818177, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.178798658Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76138443, "samples": 29376000, "now": 1614222818178, "events": 20}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.181966639Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133476306, "samples": 77681000, "now": 1614222818181, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.187044631Z INFO solana_metrics::metrics] datapoint: shred_fetch_repair index_overrun=0i shred_count=884i slot_bad_deserialize=0i index_bad_deserialize=0i index_out_of_bounds=0i slot_out_of_range=0i duplicate_shred=58i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.187540350Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=1279i slot=66728404i last_index=1171i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.188321779Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94598780, "samples": 45405000, "now": 1614222818188, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.196508838Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12282423, "samples": 30896000, "now": 1614222818196, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.199742375Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76140495, "samples": 29377000, "now": 1614222818199, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.201088634Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133478292, "samples": 77682000, "now": 1614222818201, "events": 3}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.208053999Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94600704, "samples": 45406000, "now": 1614222818208, "events": 2}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.215418374Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12283171, "samples": 30897000, "now": 1614222818215, "events": 2}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.217797894Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133480265, "samples": 77683000, "now": 1614222818217, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.219443567Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76142462, "samples": 29378000, "now": 1614222818219, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.219803327Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error-duplicate_signature", "counts": 409584, "samples": 384000, "now": 1614222818219, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.225226831Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94602766, "samples": 45407000, "now": 1614222818225, "events": 8}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.234213078Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12283702, "samples": 30898000, "now": 1614222818234, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.236363094Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133482101, "samples": 77684000, "now": 1614222818236, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.239436606Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76144223, "samples": 29379000, "now": 1614222818239, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.245497870Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94604417, "samples": 45408000, "now": 1614222818245, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.254309634Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-txs", "counts": 38875703, "samples": 48361000, "now": 1614222818254, "events": 2}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.254656936Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12283917, "samples": 30899000, "now": 1614222818254, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.254669553Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-sigs", "counts": 55466389, "samples": 48361000, "now": 1614222818254, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.256263541Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133483710, "samples": 77685000, "now": 1614222818256, "events": 4}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.263787018Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76145807, "samples": 29380000, "now": 1614222818263, "events": 8}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.268677537Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94606146, "samples": 45409000, "now": 1614222818268, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.275970791Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12284002, "samples": 30900000, "now": 1614222818275, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.277253215Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133485435, "samples": 77686000, "now": 1614222818277, "events": 2}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.286760539Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76147510, "samples": 29381000, "now": 1614222818286, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.290782988Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94607693, "samples": 45410000, "now": 1614222818290, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.295747835Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12284014, "samples": 30901000, "now": 1614222818295, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.297197589Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133486896, "samples": 77687000, "now": 1614222818297, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.308240046Z INFO solana_core::replay_stage] bank frozen: 66728404
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.308282177Z INFO solana_metrics::metrics] datapoint: replay-slot-stats slot=66728404i fetch_entries_time=5887i fetch_entries_fail_time=0i entry_poh_verification_time=22306i entry_transaction_verification_time=11443i replay_time=635414i replay_total_elapsed=1339054i total_entries=1466i total_shreds=1172i load_us=337546i execute_us=666586i store_us=239889i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.309011451Z INFO solana_metrics::metrics] datapoint: load_to_collect_rent_eagerly_scan_elapsed total_elapsed=165i latest_slot_elapsed=12i read_lock_elapsed=0i load_account_elapsed=65i iterator_elapsed=19i num_keys_iterated=47i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.309237366Z INFO solana_metrics::metrics] datapoint: collect_rent_eagerly accounts=45i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.310039281Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-account_in_use", "counts": 76148984, "samples": 29382000, "now": 1614222818310, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.311560129Z INFO solana_runtime::bank] bank frozen: 66728404 hash: D2JnJZoUsJZUVQdoGHnYFfuir8k7kf7Ywzdf9NxbENPJ accounts_delta: UkXCP2NeNzriTuPUpJsKPVjyxvDcVeMhMh6yFe8d2sT signature_count: 1719 last_blockhash: Hvewe1Ft3xgXNdAYeP57UsjMrQFGYAnF2YS6DwQLZ1d4 capitalization: 489650015317457848
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.311585592Z INFO solana_runtime::bank] accounts hash slot: 66728404 stats: BankHashStats { num_updated_accounts: 4235, num_removed_accounts: 6, num_lamports_stored: 4281546357866352, total_data_len: 402723149, num_executable_accounts: 12 }
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.311609978Z INFO solana_metrics::metrics] datapoint: slot_repeated_writes same_account_writes=2182i same_account_writes_size=198882751i unique_account_writes_size=203840398i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.311774943Z INFO solana_metrics::metrics] datapoint: accounts_cache_size num_roots=41i num_slots=105i total_unique_writes_size=21436840117i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.313418390Z INFO solana_metrics::metrics] datapoint: tower-observed slot=66728403i root=66728314i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.315352332Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions-error_count", "counts": 94609245, "samples": 45411000, "now": 1614222818315, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.315850447Z INFO solana_metrics::metrics] datapoint: shred_insert_is_full total_time_ms=1253i slot=66728408i last_index=1595i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.316279083Z INFO solana_metrics::metrics] datapoint: broadcast-insert-shreds-stats slot=66728408i end_to_end_elapsed=861293i insert_shreds_elapsed=1669920i num_shreds=3192i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317378766Z INFO solana_metrics::metrics] datapoint: best_slot slot=66728404i best_slot=66728404i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317407395Z INFO solana_metrics::metrics] datapoint: bank_weight slot=66728404i weight="0"
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317381094Z INFO solana_core::replay_stage] DDnAqxJVFo2GVTujibHt5cjevHMSE9bo8HJaydHoshdp slot_weight: 66728404 0 0 66728403
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317440801Z INFO solana_core::replay_stage] validator fork confirmed 66728399 7065ms
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317451667Z INFO solana_core::replay_stage] validator fork confirmed 66728398 7475ms
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317451822Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=7065i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317623931Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=7475i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317644892Z INFO solana_core::replay_stage] validator fork confirmed 66728400 5067ms
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.317661785Z INFO solana_metrics::metrics] datapoint: validator-confirmation duration_ms=5067i
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.319302807Z INFO solana_metrics::counter] COUNTER:{"name": "bank-process_transactions", "counts": 133488496, "samples": 77688000, "now": 1614222818319, "events": 1}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.319476108Z INFO solana_metrics::counter] COUNTER:{"name": "banking_stage-dropped_tx_before_forwarding", "counts": 12284026, "samples": 30902000, "now": 1614222818319, "events": 0}
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.323175407Z INFO solana_core::replay_stage] Waiting to switch vote to 66728404, resetting to slot None on same fork for now
Feb 25 03:13:38 solana-production-lax chrt[15385]: [2021-02-25T03:13:38.324154636Z INFO solana_core::replay_stage] new fork:66728405 parent:66728404 root:66728333
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment