randyzwitch

# Install clusterdock.
pip3 install clusterdock

# Clone the Apache Kafka topology for clusterdock.
git clone https://github.com/clusterdock/topology_apache_kafka.git

# Start Apache Kafka (defaults to node-1.cluster, node-2.cluster, node-3.cluster)
clusterdock -v start topology_apache_kafka --brokers node-1 node-2 node-3 --kafka-version 1.0.0

# Start StreamSets Data Collector on the same cluster network.

randyzwitch

Resize a Hard Disk for a Virtual Machine

Our Virtual Machines are provisioned using Vagrant from a Linux base box to run using VirutalBox. If the Hard Disk space runs out and you cannot remove files to free-up space, you can resize the Hard Disk using some VirtualBox and Linux commands.

Some assumptions

The following steps assume you've got a set-up like mine, where:

randyzwitch

REQUEST:
{  
   "reportDescription":{  
      "dateFrom":"2013-01-01",
      "dateTo":"2013-11-16",
      "reportSuiteID":"",
      "segment_id":"53c059aee4b07cd3c4332163",
      "metrics":[  
         {  
            "id":"bouncerate"

randyzwitch

# Install the Redshift R library:
# https://github.com/pingles/redshift-r
# install.packages("~/Downloads/redshift-r-master", dependencies = T, repos = NULL, type = "source")

library(redshift)

redshift <- redshift.connect("jdbc:postgresql://REDSHIFT_DB:5439/DB_NAME", "LOGIN", "PASSWORD")

# Example Query:
data <- dbGetQuery(redshift, "SELECT COUNT(*) FROM table")