Skip to content

Instantly share code, notes, and snippets.


Richard Hightower RichardHightower

View GitHub Profile
$ git status
On branch third-step-adding-akka-remote
Your branch is up-to-date with 'origin/third-step-adding-akka-remote'.
Changes to be committed:
  (use "git reset HEAD <file>..." to unstage)

        deleted:    userService/settings.gradle
RichardHightower /
Last active Nov 28, 2016
reading system logs from go
package main 

import (
RichardHightower /
Last active Jul 3, 2020
Setting up aws log agent to send journalctl from DC/OS logs to Amazon Log Service

In this example, we are using Centos7, journalctl and systemctl so that we can monitor logs from DC/OS instances (masters, agents and public agents). It is useful for anyone using systemd, journald in an AWS EC2 enviroment that wants logging. The nice thing about Amazon CloudWatch is that it integrates well with Amazon EMR and Amazon Elasticsearch. (For more background on this subject see this article which covers using CloudFormation, Packr, etc. for Immutable Infrastructure to build DC/OS and deploy it to Amazon Web Services.)

We will install journald-cloudwatch-logs. We are going to setup a daemon into systemd that forwards logs to Amazon CloudWatch log streams.

This utility ***journald-cloudwat

RichardHightower /
Last active Nov 11, 2016
Using CloudFormation, Packr, etc. for Immutable Infrastructure to build DC/OS and deploy it to Amazon Web Services

We setup a dev env for DC/OS in AWS (subnets, multi-az, ags groups, ami images, etc), tagged everything as dcos-dev, and then used Cloudformer to generate a starter AWS CloudFormation script. Cloudformer allows you to reverse engineer your AWS environment into cloudformation scripts. We then modified what cloudformer produced (to make it work as cloudformer just gets you about 90% of the way there), and then we added mappings, parameters and outputs to our cloudformation script.

Included are the cloudformation and packer scripts. Hope it helps you get setup. Feedback is welcome.

We in this case is my client, DC/OS support, Amazon support, and I. We did this instead of using the canned Amazon support because we needed to run masters, and agents in [multiple AZs](

RichardHightower /
Last active Nov 3, 2016
Immutable DC/OS CentOS AMI image creator using docker

installing aws on a box (logged in as su)

mkdir /tmp/awscli; cd /tmp/awscli
curl "" -o ""
 ./awscli-bundle/install -i /usr/lib/aws -b /usr/bin/aws
RichardHightower /
Last active Mar 3, 2017
Using ansible to install Java on an ec2 box running in the cloud

I am writing this down so I don't forget. I started this task but had to stop a few times, and then remember where I left off and at some point, others will need to know how to get started.

Install ansible

brew install ansible

Install Amazon EC2 Ansible integration tool

RichardHightower / logback.xml
Last active Aug 24, 2016
Java setup for Mesos/Gradle/QBit zip that uses logback/sl4j and virtual hosting
View logback.xml
<appender name="STASH-UDP" class="net.logstash.logback.appender.LogstashSocketAppender">
<appender name="STDOUT" class="ch.qos.logback.core.ConsoleAppender">
## Setup docker repo
sudo apt-get install apt-transport-https ca-certificates
sudo apt-key adv --keyserver hkp:// --recv-keys 58118E89F3A912897C070ADBF76221572C52609D
sudo touch /etc/apt/sources.list.d/docker.list
sudo echo "deb ubuntu-xenial main" > /etc/apt/sources.list.d/docker.list
## Install Docker
sudo apt-get update
sudo apt-get install -y linux-image-extra-$(uname -r) linux-image-extra-virtual
You can’t perform that action at this time.