I hereby claim:
- I am matthewchoy88 on github.
- I am matthewchoy (https://keybase.io/matthewchoy) on keybase.
- I have a public key ASC7XwGD8I2M-ylHvfY_SmXK7sHwVFAAoW-ov0eO3OB36Qo
To claim this, I am signing this object:
I hereby claim:
To claim this, I am signing this object:
from pyspark.dbutils import DBUtils | |
from pyspark.sql import SparkSession | |
import json | |
from IPython.core.magic import register_cell_magic | |
from IPython import get_ipython | |
from IPython.core.magics.execution import capture_output | |
# Register the %%job_wrapper_handle notebook magic | |
# This runs a cells contents in a try-except block and on exception exits the notebook gracefully to the parent job. | |
@register_cell_magic('job_wrapper_handle') |