Skip to content

Instantly share code, notes, and snippets.

@khuyentran1401

khuyentran1401/data_engineering.py

Last active December 20, 2021 20:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save khuyentran1401/ffc825c4b96f36066dbeae3930e376e8 to your computer and use it in GitHub Desktop.
Save khuyentran1401/ffc825c4b96f36066dbeae3930e376e8 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
data_engineering.py
from prefect.engine.results import LocalResult
@task(target="{date:%a_%b_%d_%Y_%H:%M:%S}/{task_name}_output",
result = LocalResult(dir='data/processed'))
def split_data(data: pd.DataFrame, test_data_ratio: float, classes: list) -> Dict[str, Any]:
"""Task for splitting the classical Iris data set into training and test
sets, each split into features and labels.
"""
...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment