DataGen output

datagen_out.txt

~/DataGen/src $ python main.py 20000 10 test
Lines: 20000, Files: 10, Base Name: test, Bucket: None, Prefix: None
[ 10%]  Process #1 complete. (1.24 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3592368  Ratio: 0.473
[ 20%]  Process #2 complete. (1.25 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1703936  Uncompressed: 3592484  Ratio: 0.474
[ 30%]  Process #3 complete. (1.26 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3592838  Ratio: 0.473
[ 40%]  Process #4 complete. (1.26 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3592434  Ratio: 0.473
[ 50%]  Process #5 complete. (1.26 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3591948  Ratio: 0.473
[ 60%]  Process #6 complete. (1.26 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3591822  Ratio: 0.473
[ 70%]  Process #7 complete. (1.25 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3591930  Ratio: 0.473
[ 80%]  Process #8 complete. (1.25 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1703936  Uncompressed: 3592259  Ratio: 0.474
[ 90%]  Process #9 complete. (1.25 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3592694  Ratio: 0.473
[100%]  Process #10 complete. (1.26 s) Hash: d41d8cd98f00b204e9800998ecf8427e
        Compressed: 1699840  Uncompressed: 3592170  Ratio: 0.473


Done.

Generated 200000 lines in 10 files in 6.29 seconds (31801.387 lines/second).
Cumulative generation time: 12.53 seconds (Average 15963.769 lines/second).
Total Speedup: 1.992x.
17006592 bytes (35922947 bytes uncompressed. Ratio: 0.473).