Dan Chaffelson Chaffelson
Chaffelson
/ piwinifisolrdashboard
Created
June 30, 2016 17:53
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "title": "Sensor Dashboard", | |
| "services": { | |
| "query": { | |
| "idQueue": [ | |
| 1, | |
| 2, | |
| 3, | |
| 4 | |
| ], |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "configurations": { | |
| "core-site": { | |
| "fs.trash.interval": "4320" | |
| }, | |
| "ams-grafana-env": { | |
| "metrics_grafana_password": "StrongPassword" | |
| }, | |
| "hdfs-site": { | |
| "dfs.replication" : "1", |
Chaffelson
/ deployHdf3OnCentos7.sh
Created
June 9, 2017 20:16
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Note that all files below are in the HWX GDrive share as well for convenience | |
| # https://drive.google.com/open?id=0B5rwmN9n_UhOOVZRLU1ZTVNxZmc | |
| #Only accessible by HWX accounts! | |
| # Login to preferred AWS EC2 Zone | |
| # Launch Instance | |
| # Centos 7 HVM (with updates) | |
| # t2.xlarge | |
| # 25GiB SSD (Delete on Term) | |
| # Security Group - All Traffic / MyIp |
Chaffelson
/ truckspeedevents.avsc
Created
June 10, 2017 20:45
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "type" : "record", | |
| "namespace" : "hortonworks.hdp.refapp.trucking", | |
| "name" : "truckspeedevent", | |
| "fields" : [ | |
| { "name" : "eventTime" , "type" : "string" }, | |
| { "name" : "eventSource" , "type" : "string" }, | |
| { "name" : "truckId" , "type" : "int" }, | |
| { "name" : "driverId" , "type" : "int"}, | |
| { "name" : "driverName" , "type" : "string"}, |
Chaffelson
/ rawtruckevents.avsc
Created
June 10, 2017 20:46
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "type" : "record", | |
| "namespace" : "hortonworks.hdp.refapp.trucking", | |
| "name" : "truckgeoevent", | |
| "fields" : [ | |
| { "name" : "eventTime" , "type" : "string" }, | |
| { "name" : "eventSource" , "type" : "string" }, | |
| { "name" : "truckId" , "type" : "int" }, | |
| { "name" : "driverId" , "type" : "int"}, | |
| { "name" : "driverName" , "type" : "string"}, |
Chaffelson
/ geotruckevents.avsc
Created
June 10, 2017 20:46
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "type" : "record", | |
| "namespace" : "hortonworks.hdp.refapp.trucking", | |
| "name" : "truckgeoeventkafka", | |
| "fields" : [ | |
| { "name" : "eventTime" , "type" : "string" }, | |
| { "name" : "eventSource" , "type" : "string" }, | |
| { "name" : "truckId" , "type" : "int" }, | |
| { "name" : "driverId" , "type" : "int"}, | |
| { "name" : "driverName" , "type" : "string"}, |
Chaffelson
/ NiFiSamTemplate.xml
Last active
June 10, 2017 22:02
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <?xml version="1.0" ?> | |
| <template encoding-version="1.1"> | |
| <description></description> | |
| <groupId>7c84501d-d10c-407c-b9f3-1d80e38fe36a</groupId> | |
| <name>NiFiSamTemplate</name> | |
| <snippet> | |
| <controllerServices> | |
| <id>e49634e5-fbf3-35b0-0000-000000000000</id> | |
| <parentGroupId>46f95fe5-3024-31d8-0000-000000000000</parentGroupId> | |
| <bundle> |
Chaffelson
/ deploySAMTruckingDemo.sh
Last active
June 10, 2017 22:31
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Schema Registry Swagger docco: http://localhost:7788/api/swagger#/ | |
| # #! | |
| # Setup | |
| sudo yum install -y jq xml2 | |
| # Download schemas | |
| curl -ssLO https://gist.githubusercontent.com/Chaffelson/2b7801007f65a10b13cf5690b6921eb6/raw/06e986f22f1c384a2d9c3c2d6b45f9c1b1f4c052/rawtruckevents.avsc | |
| curl -ssLO https://gist.githubusercontent.com/Chaffelson/0e8f90ab153ea19295b6992b7512307e/raw/8cae7efd1115c2e1d6862e40959d9c924ff7615e/geotruckevents.avsc | |
| curl -ssLO https://gist.githubusercontent.com/Chaffelson/5b757ee6db17f5a0947facf530a4d429/raw/94aa12eb6f5180d6f76e69d3e7afb1c2d91c8c72/truckspeedevents.avsc | |
| # Create Schemas in Registry | |
| curl -H "Content-Type: application/json" -X POST -d '{ "type": "avro", "schemaGroup": "truck-sensors-kafka", "name": "raw-truck_events_avro", "description": "Raw Geo events from trucks in Kafka Topic", "compatibility": "BACKWARD", "evolve": true}' http://localhost:7788/api/v1/schemaregistry/schemas |
Chaffelson
/ profile.yml
Last active
September 23, 2018 09:21
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| RENAME THIS FILE TO .profile.yml before putting your secrets in it, so you don't commit them to the repo! | |
| Then delete these two lines - they are here to cause an error if you don't read instructions | |
| infra: | |
| EC2: # EC2 matches the Provider Service name that libcloud uses, do not change for AWS users | |
| key: ... # Key for your AWS Credential | |
| secret: ... # Secret for your AWS Credential | |
| region: eu-central-1 # Region to deploy everything in | |
| infraarn: arn:aws:iam::<account>:instance-profile/<InfRoleName> # ARN for Cloudbreak Credential, see bottom note #1 | |
| credarn: arn:aws:iam::<account>:instance-profile/<CredRoleName> # ARN for Cloudbreak Credential, see bottom note #1 |
Chaffelson
/ gist:9ddf8afd55adf487485b90d75b665703
Created
May 22, 2019 18:06
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Link to this https://tinyurl.com/y3rk7yzt | |
| Cloudbreak URL: https://3.213.189.153/clusters user: admin@example.com password:supersecret1 | |
| DPS: https://18.215.106.73/infra/clusters user: admin password:supersecret1 | |
| Add to /etc/hosts file "3.216.131.122 ip-10-0-1-245.ec2.internal | |
| 35.174.248.28 ip-10-0-1-43.ec2.internal | |
| 3.216.68.195 ip-10-0-1-170.ec2.internal | |
| 34.224.171.214 ip-10-0-1-24.ec2.internal | |
| 18.209.145.213 ip-10-0-1-59.ec2.internal" |
OlderNewer