Skip to content

Instantly share code, notes, and snippets.

@cswinter

cswinter/clickhouse-log-import

Created August 12, 2018 18:10
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save cswinter/d2942180ccf4591e8c941094c9be1e3f to your computer and use it in GitHub Desktop.
Save cswinter/d2942180ccf4591e8c941094c9be1e3f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
clickhouse-log-import
time (for filename in /home/clemens/Dropbox/nyc-taxi-data-denormalized/trips_x*.csv.gz; do
gunzip -c $filename | \
python trans.py | \
clickhouse-client \
--query="INSERT INTO trips FORMAT CSV"
done)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment