Skip to content

Instantly share code, notes, and snippets.

@1ambda

1ambda/df-partition.py

Created December 20, 2021 14:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1ambda/29432cc88fdf5169adacbad47ef8e3d8 to your computer and use it in GitHub Desktop.
Save 1ambda/29432cc88fdf5169adacbad47ef8e3d8 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
df-partition.py
print(f"Partition Count of Dataframe df:\t\t{df.rdd.getNumPartitions()}")
print(f"Partition Count of Dataframe dfSelected:\t{dfSelected.rdd.getNumPartitions()}")
print(f"Partition Count of Dataframe dfConverted:\t{dfConverted.rdd.getNumPartitions()}")
# 출력 결과
Partition Count of Dataframe df: 1
Partition Count of Dataframe dfSelected: 1
Partition Count of Dataframe dfConverted: 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment