Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
Hadoop GZIP command line
hadoop fs -cat /Work/lon_text/lon_order_data_t/cdw320_lon_order_data_t.1.txt | head -100 | gzip > test.csv.gz
cat cdw320_lon_order_data_t.1.txt | head -100 | gzip > ../../tsnyder/cdw320_lon_order_data_t.1.txt.gz
hadoop fs -cat /Work/tsnyder/cdw320_lon_order_data_t.1.txt.gz | gunzip
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment