mkaranasou/pyspark_column_dtypes.py

Created February 5, 2021 12:09

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/mkaranasou/d45b98c0b4b024dbd0a3cfc76a9714da.js"></script>
Save mkaranasou/d45b98c0b4b024dbd0a3cfc76a9714da to your computer and use it in GitHub Desktop.

Download ZIP

Get the data type of a spark dataframe column.

Raw

pyspark_column_dtypes.py

	df = spark.DataFrame(...)
	dict(df.dtypes).get('features')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment