Skip to content

Instantly share code, notes, and snippets.

@tom-clickhouse
Last active August 17, 2023 12:10
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tom-clickhouse/d11e56ea677be787dac1198017a64141 to your computer and use it in GitHub Desktop.
Save tom-clickhouse/d11e56ea677be787dac1198017a64141 to your computer and use it in GitHub Desktop.
INSERT INTO wikistat WITH
parseDateTimeBestEffort(extract(_file, '^pageviews-([\\d\\-]+)\\.gz$')) AS time,
splitByChar(' ', line) AS values,
splitByChar('.', values[1]) AS projects
SELECT
time,
projects[1] AS project,
projects[2] AS subproject,
decodeURLComponent(values[2]) AS path,
CAST(values[3], 'UInt64') AS hits
FROM s3Cluster('default',
'https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20220{1..6}*.gz',
'LineAsString')
WHERE length(values) >= 3
SETTINGS
parallel_distributed_insert_select = 2,
max_insert_threads = 16;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment