Skip to content

Instantly share code, notes, and snippets.

@larsgeorge

larsgeorge/hdfs-timing.txt

Created January 8, 2014 09:22
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save larsgeorge/8314000 to your computer and use it in GitHub Desktop.
Save larsgeorge/8314000 to your computer and use it in GitHub Desktop.
Download ZIP
Measure time it takes to create and read a file in HDFS
Raw
hdfs-timing.txt
$ time dd if=/dev/zero bs=1G count=1 | hadoop fs -put - 1g.bin
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB) copied, 64.4632 s, 16.7 MB/s
real 1m5.239s
user 0m9.560s
sys 0m3.394s
$ time hadoop fs -get 1g.bin - > /dev/null
real 0m16.005s
user 0m3.909s
sys 0m1.798s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment