Skip to content

Instantly share code, notes, and snippets.

@cswinter
Created August 12, 2018 18:10
Show Gist options
  • Save cswinter/d2942180ccf4591e8c941094c9be1e3f to your computer and use it in GitHub Desktop.
Save cswinter/d2942180ccf4591e8c941094c9be1e3f to your computer and use it in GitHub Desktop.
time (for filename in /home/clemens/Dropbox/nyc-taxi-data-denormalized/trips_x*.csv.gz; do
gunzip -c $filename | \
python trans.py | \
clickhouse-client \
--query="INSERT INTO trips FORMAT CSV"
done)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment