Skip to content

Instantly share code, notes, and snippets.

@1ambda

1ambda/df-hive-partition.py

Created December 26, 2021 23:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1ambda/12e0e811758b5e0a81287f68d1586ef4 to your computer and use it in GitHub Desktop.
Save 1ambda/12e0e811758b5e0a81287f68d1586ef4 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
df-hive-partition.py
SELECT *
FROM udon_db.udon_topping_sales
WHERE
dt BETWEEN '20211001' AND '20211031' -- Partition 필터링 (데이터를 읽지 않고 스킵)
AND (created_dt >= DATE('20211001') AND created_dt <= DATE('20211031')) -- Row 필터링 (데이터를 읽어서 판별)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment