Skip to content

Instantly share code, notes, and snippets.

@m0smith

m0smith/SplitCSVStorm

Created August 5, 2021 16:37
Show Gist options
  • Save m0smith/20ecd65caf5ac864b188a2bb110096c9 to your computer and use it in GitHub Desktop.
Save m0smith/20ecd65caf5ac864b188a2bb110096c9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
SplitCSVStorm
cd ~/annals/storm/
mkdir Storm202{0,1}
cat Storm\ 2020\ Transactions.csv | parallel --header : --pipe -N500000 'cat >Storm2020/Storm2020_{#}.csv'
cat Storm\ 2021\ Transactions.csv | parallel --header : --pipe -N500000 'cat >Storm2021/Storm2021_{#}.csv'
zip -r storm.zip Storm202[01]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment