Skip to content

Instantly share code, notes, and snippets.

@kikiya
Created April 3, 2019 21:09
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kikiya/1c45d3bf72c2aca89a2142da65949f86 to your computer and use it in GitHub Desktop.
Save kikiya/1c45d3bf72c2aca89a2142da65949f86 to your computer and use it in GitHub Desktop.
Connected Car Pipeline Data Model and Streamlet Description

Connected Car Pipeline Data Model and Streamlet Description

Data Model

  1. pipelines.connectedcar.sensordata.ConnectedCarERecord
  2. pipelines.connectedcar.sensordata.HourlyByAgg

Streamlets

  1. name: pipelines.connectedcar.sensordata.CarEDataIngress, type: Ingress, output-schema: pipelines.connectedcar.sensordata.ConnectedCarERecord
  2. name: pipelines.connectedcar.sensordata.CarSpeedFilter, type: Processor, input-schema: pipelines.connectedcar.sensordata.ConnectedCarERecord, output-schema: pipelines.connectedcar.sensordata.ConnectedCarERecord
  3. name: pipelines.connectedcar.aggregations.MovingAverageSparklet, type: Processor, input-schema: pipelines.connectedcar.sensordata.ConnectedCarERecord, output-schema: pipelines.connectedcar.sensordata.HourlyByAgg
  4. name: pipelines.connectedcar.aggregations.SparkConsoleEgress, type: Egress, output-schema: pipelines.connectedcar.sensordata.HourlyByAgg
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment