Skip to content

Instantly share code, notes, and snippets.

@terrancesnyder

terrancesnyder/gzip-hdfs

Created October 29, 2013 18:34
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 5 You must be signed in to fork a gist
  • Save terrancesnyder/7220179 to your computer and use it in GitHub Desktop.
Save terrancesnyder/7220179 to your computer and use it in GitHub Desktop.
Download ZIP
Hadoop GZIP command line
Raw
gzip-hdfs
hadoop fs -cat /Work/lon_text/lon_order_data_t/cdw320_lon_order_data_t.1.txt | head -100 | gzip > test.csv.gz
cat cdw320_lon_order_data_t.1.txt | head -100 | gzip > ../../tsnyder/cdw320_lon_order_data_t.1.txt.gz
hadoop fs -cat /Work/tsnyder/cdw320_lon_order_data_t.1.txt.gz | gunzip
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment