Skip to content

Instantly share code, notes, and snippets.

@kvnkho

kvnkho/whylogs_fugue_spark.py

Created September 28, 2022 20:22
Show Gist options
  • Save kvnkho/75711d629b73f5d099ee0e53f2a7e87b to your computer and use it in GitHub Desktop.
Save kvnkho/75711d629b73f5d099ee0e53f2a7e87b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
whylogs_fugue_spark.py
from whylogs.api.fugue import fugue_profile
from pyspark.sql import SparkSession
spark = SparkSession.builder.getOrCreate()
fugue_profile(spark_df, engine=spark)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment