Richard Hightower RichardHightower
- United States
In this example, we are using
systemctl so that we can monitor logs from DC/OS instances (masters, agents and public agents). It is useful for anyone using
journald in an AWS EC2 enviroment that wants logging. The nice thing about Amazon CloudWatch is that it integrates well with Amazon EMR and Amazon Elasticsearch. (For more background on this subject see this article which covers using CloudFormation, Packr, etc. for Immutable Infrastructure to build DC/OS and deploy it to Amazon Web Services.)
We will install journald-cloudwatch-logs. We are going to setup a daemon into systemd that forwards logs to Amazon CloudWatch log streams.
This utility ***journald-cloudwat
We setup a dev env for DC/OS in AWS (subnets, multi-az, ags groups, ami images, etc), tagged everything as
dcos-dev, and then used Cloudformer to generate a starter AWS CloudFormation script. Cloudformer allows you to reverse engineer your AWS environment into cloudformation scripts. We then modified what cloudformer produced (to make it work as cloudformer just gets you about 90% of the way there), and then we added mappings, parameters and outputs to our cloudformation script.
Included are the cloudformation and packer scripts. Hope it helps you get setup. Feedback is welcome.
We in this case is my client, DC/OS support, Amazon support, and I. We did this instead of using the canned Amazon support because we needed to run masters, and agents in [multiple AZs](http://docs.aws.amazon.co
We created a packer AMI builder based on the advanced DC/OS install guide support for CentOS7. We use the official CentOS7 AMIs as a base.
Download and install packer.
$ brew install packer
|<appender name="STASH-UDP" class="net.logstash.logback.appender.LogstashSocketAppender">|
|<appender name="STDOUT" class="ch.qos.logback.core.ConsoleAppender">|
|## Setup docker repo|
|sudo apt-get install apt-transport-https ca-certificates|
|sudo apt-key adv --keyserver hkp://p80.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D|
|sudo touch /etc/apt/sources.list.d/docker.list|
|sudo echo "deb https://apt.dockerproject.org/repo ubuntu-xenial main" > /etc/apt/sources.list.d/docker.list|
|## Install Docker|
|sudo apt-get update|
|sudo apt-get install -y linux-image-extra-$(uname -r) linux-image-extra-virtual|