aws s3 ls s3://softwareheritage/graph/2018-09-25/parquet/ --recursive --human-readable --summarize
aws s3 ls s3://russomi-gcp-data-transfer --recursive --human-readable --summarize
Start: 2021-08-24 21:31:05 235.7 MiB content/006b35033d914c6fb1413adafd54e177.parquet End: 2021-08-24 23:53:36 52.4 MiB snapshot_branches/fda5f03c987c45c5bee9be08741a2220.parquet
~ 180 MiB/s
Total Objects: 3277 Total Size: 1.1 TiB
aws s3 sync s3://softwareheritage/graph/2018-09-25/parquet/ s3://russomi-gcp-data-transfer
How much storage is a TiB?
One tebibyte is equal to 240 or 1,099,511,627,776 bytes. One terabyte is equal to 1012 or 1,000,000,000,000 bytes. A tebibyte equals nearly 1.1 TB. That's about a 10% difference between the size of a tebibyte and a terabyte, which is significant when talking about storage capacity.
for an approximate result, multiply the digital storage value by 1100
https://stackoverflow.com/questions/8905164/how-do-i-calculate-mb-s-mib-s https://www.majordifferences.com/2018/03/differences-between-megabyte-and.html
MiB/s = mebibyte per second
