Skip to content

Instantly share code, notes, and snippets.

@hmijail
Created November 10, 2020 10:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hmijail/36ad488b73caf1b05f686b8aeeeb8df9 to your computer and use it in GitHub Desktop.
Save hmijail/36ad488b73caf1b05f686b8aeeeb8df9 to your computer and use it in GitHub Desktop.
$ python merklificator.py segments-9000000.json.gz -s 8 16 24 32 40 48 -m 8 16 24 32 -d 0
Chunking for tree arity=2, chunk size=[8, 16, 24, 32, 40, 48], hash size=[8, 16, 24, 32]
file segments-9000000.json.gz: exec=77460.3K
chunksize= 8 chunk_oh= 9.4% (10.85M chunks) + 3.37M hashes
hashsize= 8 hash_oh= 34.0% total_oh= 43.5%
hashsize=16 hash_oh= 68.1% total_oh= 77.5%
hashsize=24 hash_oh=102.1% total_oh=111.5%
hashsize=32 hash_oh=136.1% total_oh=145.6%
chunksize=16 chunk_oh= 16.5% (5.78M chunks) + 2.67M hashes
hashsize= 8 hash_oh= 27.0% total_oh= 43.5%
hashsize=16 hash_oh= 53.9% total_oh= 70.4%
hashsize=24 hash_oh= 80.9% total_oh= 97.4%
hashsize=32 hash_oh=107.8% total_oh=124.4%
chunksize=24 chunk_oh= 22.8% (4.06M chunks) + 2.27M hashes
hashsize= 8 hash_oh= 22.9% total_oh= 45.7%
hashsize=16 hash_oh= 45.9% total_oh= 68.7%
hashsize=24 hash_oh= 68.8% total_oh= 91.6%
hashsize=32 hash_oh= 91.7% total_oh=114.5%
chunksize=32 chunk_oh= 29.1% (3.20M chunks) + 2.05M hashes
hashsize= 8 hash_oh= 20.7% total_oh= 49.8%
hashsize=16 hash_oh= 41.3% total_oh= 70.4%
hashsize=24 hash_oh= 62.0% total_oh= 91.1%
hashsize=32 hash_oh= 82.7% total_oh=111.8%
chunksize=40 chunk_oh= 34.9% (2.68M chunks) + 1.88M hashes
hashsize= 8 hash_oh= 19.0% total_oh= 53.9%
hashsize=16 hash_oh= 37.9% total_oh= 72.8%
hashsize=24 hash_oh= 56.9% total_oh= 91.8%
hashsize=32 hash_oh= 75.8% total_oh=110.7%
chunksize=48 chunk_oh= 40.8% (2.33M chunks) + 1.68M hashes
hashsize= 8 hash_oh= 16.9% total_oh= 57.7%
hashsize=16 hash_oh= 33.9% total_oh= 74.6%
hashsize=24 hash_oh= 50.8% total_oh= 91.6%
hashsize=32 hash_oh= 67.7% total_oh=108.5%
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment