Skip to content

Instantly share code, notes, and snippets.

View FerrariDG's full-sized avatar
👾

Daniel Ferrari FerrariDG

👾
View GitHub Profile
@FerrariDG
FerrariDG / emr_sensor.py
Created October 13, 2023 13:44
Custom Airflow EMR Sensor for Multiple Steps
"""Custom EMR Sensor to check for failed steps."""
from typing import Any, Sequence
from airflow.exceptions import AirflowException
from airflow.providers.amazon.aws.sensors.emr import EmrBaseSensor
from airflow.sensors.base import poke_mode_only
@poke_mode_only
class EmrStepCustomSensor(EmrBaseSensor):

Keybase proof

I hereby claim:

  • I am ferraridg on github.
  • I am ferraridg (https://keybase.io/ferraridg) on keybase.
  • I have a public key ASD-TeVdid_j96RUh0VgwfOxz4XMFIH484loG5bSpCtxawo

To claim this, I am signing this object: