Skip to content

Instantly share code, notes, and snippets.

@aborruso

aborruso/read_opencup.sh

Created March 5, 2024 08:00
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save aborruso/e485a47e075b6db97485a3cfe5b4219d to your computer and use it in GitHub Desktop.
Save aborruso/e485a47e075b6db97485a3cfe5b4219d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
read_opencup.sh
#!/bin/bash
duckdb -c "SET preserve_insertion_order=false;COPY (select * from read_csv_auto('Opendata*.csv',ignore_errors=true,parallel=FALSE,delim=';',header = true,dateformat='%d-%b-%Y',filename=true,types={'DATA_ULTIMA_MODIFICA_SSC':'DATE','DATA_ULTIMA_MODIFICA_UTENTE':'DATE','DATA_CHIUSURA_REVOCA':'DATE','DATA_GENERAZIONE_CUP':'DATE'})) TO 'opencup_complessivo.parquet' (FORMAT 'parquet', COMPRESSION 'zstd', ROW_GROUP_SIZE 100_000)"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment