Skip to content

Instantly share code, notes, and snippets.

View siladu's full-sized avatar

Simon Dudley siladu

View GitHub Profile
@siladu
siladu / besu-resync-with-flatdb-testing.md
Last active January 24, 2024 20:41
Besu Resync with FlatDB Testing

TEST: DB size of long running node should be the same before and after resync (except for natural state growth).

With --Xsnapsync-synchronizer-flat-db-healing-enabled, after resyncing and waiting for flat db to fully heal, we should expect only an increase in BLOCKCHAIN and TRIE_BRANCH_STORAGE

LIMIT TRIE LOGS NODE RESULT: decrease of 2 GB from 883 GB to 881 GB

  • BLOCKCHAIN: Increased by 1 GB
  • ACCOUNT_INFO_STATE: Decreased by 1 GB
  • TRIE_BRANCH_STORAGE: Decreased by 13 GB
  • ACCOUNT_STORAGE_STORAGE: Decreased by 2 GB
  • 2 - (13 + 1 + 2 - 1) = 13 GB decrease unaccounted for.
@siladu
siladu / besu-reorg-test.sh
Created November 20, 2023 10:56
Besu Reorg Test
# 1. Copy content of genesis multiline comment into genesis.json
# 2. Run besu using this genesis
# 3. Run script against besu
# built: 07/11/2023, 07:26:56commit: 9598db0d What is Hive?
# Test: Invalid Missing Ancestor ReOrg, StateRoot, EmptyTxs=True, Invalid P10 (Paris) (besu)
# starting main client: /opt/besu/bin/besu --logging=TRACE --data-storage-format=BONSAI --reorg-logging-threshold=0 --Xbonsai-trie-log-pruning-enabled=true --Xbonsai-trie-log-retention-threshold=1 --genesis-file=/genesis.json --min-gas-price=1 --tx-pool-price-bump=0 --network-id=7 --host-allowlist=* --rpc-http-enabled --rpc-http-api=DEBUG,ETH,NET,WEB3,ADMIN --rpc-http-host=0.0.0.0 --rpc-ws-enabled --rpc-ws-api=DEBUG,ETH,NET,WEB3,ADMIN --rpc-ws-host=0.0.0.0 --engine-host-allowlist=* --engine-jwt-enabled --engine-jwt-secret /jwtsecret
####################
### genesis.json ###
@siladu
siladu / besu-resync-testing.md
Last active April 5, 2024 16:08
Besu Resync Testing

TEST: DB size of long running node should be the same before and after resync (except for natural state growth).

With --Xsnapsync-synchronizer-flat-db-healing-enabled, after resyncing and waiting for flat db to fully heal, we should expect only an increase in BLOCKCHAIN and TRIE_BRANCH_STORAGE

Node: dev-elc-besu-teku-mainnet-simon-flatdb-8c35ce1-prune

Ran debug_resyncWorldState on 2014-02-02

Using du -ksch /data/besu/database every 24 hours starting from 2024-02-01 16:00:00 UTC: 885G -> 902G -> 884G -> 891G

{
"type": "BLOB_SIDECAR",
"signingRoot": "0xaa2e0c465c1a45d7b6637fcce4ad6ceb71fc12064b548078d619a411f0de8adc",
"fork_info": {
"fork": {
"previous_version": "0x00000001",
"current_version": "0x00000001",
"epoch": "1"
},
"genesis_validators_root": "0x04700007fabc8282644aed6d1c7c9e21d38a03a0c4ba193f3afe428824b3a673"
@siladu
siladu / keybase.md
Last active December 31, 2019 10:00

Keybase proof

I hereby claim:

  • I am siladu on github.
  • I am simondudley (https://keybase.io/simondudley) on keybase.
  • I have a public key ASBdCQVHamE07oxJMlZTOItY_dJKn_Bz57P4K9NwAaYaRAo

To claim this, I am signing this object:

@siladu
siladu / parish_region.kml
Created April 21, 2018 10:27
Parish Regions for IOW
This file has been truncated, but you can view the full file.
<?xml version="1.0" encoding="UTF-8"?>
<kml xmlns="http://www.opengis.net/kml/2.2">
<Document>
<name>parish_region</name>
<Style id="poly-000000-1000-0-normal">
<LineStyle>
<color>ff000000</color>
<width>1</width>
</LineStyle>
<PolyStyle>