kunickiaj
/ jmxdemo.yml
Created
January 12, 2016 21:59
StreamSets Data Collector JMX Monitoring Docker Compose Demo
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| datacollector: | |
| image: 'streamsets/datacollector:1.1.4' | |
| environment: | |
| - 'SDC_JAVA_OPTS=-Dcom.sun.management.jmxremote.port=1105 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false' | |
| expose: | |
| - '1105' | |
| ports: | |
| - '18630:18630' | |
| grafana: | |
| image: 'grafana/grafana:latest' |
kunickiaj
/ collectd2influx.py
Last active
November 15, 2015 23:38
Python script to convert collectd records to influxdb format
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # Sample Jython code | |
| # | |
| # Available Objects: | |
| # | |
| # records: an array of records to process, depending on Jython processor | |
| # processing mode it may have 1 record or all the records in the batch. | |
| # | |
| # state: a dict that is preserved between invocations of this script. | |
| # Useful for caching bits of data e.g. counters. |
kunickiaj
/ spark-streaming-kafka.diff
Created
November 10, 2015 00:15
Patch to rebuild spark-streaming-kafka jar to work with HDP 2.3.2
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| diff --git a/external/kafka/pom.xml b/external/kafka/pom.xml | |
| index 8a43eb7..59e9b62 100644 | |
| --- a/external/kafka/pom.xml | |
| +++ b/external/kafka/pom.xml | |
| @@ -28,6 +28,7 @@ | |
| <artifactId>spark-streaming-kafka_2.10</artifactId> | |
| <properties> | |
| <sbt.project.name>streaming-kafka</sbt.project.name> | |
| + <kafka.version>0.8.2.2.3.2.0-2950</kafka.version> | |
| </properties> |
kunickiaj
/ StreamSets Data Collector Example Dashboard
Last active
January 12, 2016 22:38
Example Grafana Dashboard for StreamSetse Data Collector
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "id": 1, | |
| "title": "StreamSets Data Collector", | |
| "originalTitle": "StreamSets Data Collector", | |
| "tags": [], | |
| "style": "dark", | |
| "timezone": "utc", | |
| "editable": true, | |
| "hideControls": false, | |
| "sharedCrosshair": false, |
NewerOlder