Skip to content

Instantly share code, notes, and snippets.

View tarpdalton's full-sized avatar
🍕

James Dalton tarpdalton

🍕
View GitHub Profile

Getting Started

This will help you get started on running your first Gobblin pipeline to extract file metadata from HDFS and store it in Ground with Kafka being the intermediary.

Setup

The following need to be set up and running before you start the pipelines :

  • Ground
  • HDFS

Keybase proof

I hereby claim:

  • I am tarpdalton on github.
  • I am tarp (https://keybase.io/tarp) on keybase.
  • I have a public key whose fingerprint is 9B28 75B4 501E 4B47 5D4F 72A6 BDF7 3486 BBBF 0BFC

To claim this, I am signing this object: