Skip to content

Instantly share code, notes, and snippets.

@tom-clickhouse
Created August 27, 2023 15:26
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save tom-clickhouse/4431d998f24304917976e118c2e95b88 to your computer and use it in GitHub Desktop.
INSERT INTO wikistat WITH
parseDateTimeBestEffort(extract(_file, '^pageviews-([\\d\\-]+)\\.gz$')) AS time,
splitByChar(' ', line) AS values,
splitByChar('.', values[1]) AS projects
SELECT
time,
projects[1] AS project,
projects[2] AS subproject,
decodeURLComponent(values[2]) AS path,
CAST(values[3], 'UInt64') AS hits
FROM s3Cluster('default',
'https://clickhouse-public-datasets.s3.amazonaws.com/wikistat/original/pageviews-20220{1..6}*.gz',
'LineAsString')
WHERE length(values) >= 3
SETTINGS
parallel_distributed_insert_select = 2,
max_insert_threads = 30;
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment