Skip to content

Instantly share code, notes, and snippets.

@gschmutz
Created December 8, 2019 17:33
Show Gist options
  • Save gschmutz/8d5b5621298f49f3697d0d9d3ac55802 to your computer and use it in GitHub Desktop.
Save gschmutz/8d5b5621298f49f3697d0d9d3ac55802 to your computer and use it in GitHub Desktop.
CREATE SOURCE CONNECTOR tweet_c WITH (
'connector.class'='com.github.jcustenborder.kafka.connect.twitter.TwitterSourceConnector',
'twitter.oauth.consumerKey' = 'XXXXXX',
'twitter.oauth.consumerSecret' = 'YYYYYY',
'twitter.oauth.accessToken' = 'XXXXXX',
'twitter.oauth.accessTokenSecret' = 'YYYYYY',
'process.deletes' = 'false',
'filter.keywords' = 'trump',
'kafka.status.topic' = 'tweet-raw-v2',
'transforms.createKey.type' = 'org.apache.kafka.connect.transforms.ValueToKey',
'transforms' = 'createKey,extractInt',
'transforms.createKey.fields' = 'Id',
'transforms.extractInt.type' = 'org.apache.kafka.connect.transforms.ExtractField$Key',
'transforms.extractInt.field' = 'Id'
);
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment