Skip to content

Instantly share code, notes, and snippets.

@githoov
Created October 15, 2016 16:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save githoov/508c1b4878e2f0202c6e9454327504fa to your computer and use it in GitHub Desktop.
Save githoov/508c1b4878e2f0202c6e9454327504fa to your computer and use it in GitHub Desktop.
  1. make sure an inbound rule is set up for ssh on port 22 from anywhere
  2. sudo yum update
  3. sudo yum install –y aws-kinesis-agent
  4. vi /etc/aws-kinesis/agent.json and enter the following:
    {
      "cloudwatch.emitMetrics": true,
      "kinesis.endpoint": "",
      "firehose.endpoint": "https://firehose.us-east-1.amazonaws.com",
    
      "flows": [
        {
          "filePattern": "/tmp/app.log*",
          "kinesisStream": "yourkinesisstream",
          "partitionKeyOption": "RANDOM"
        },
        {
          "filePattern": "/tmp/*.log",
          "deliveryStream": "log-gen"
        }
      ]
    }
    
  5. sudo service aws-kinesis-agent start
  6. tail -f /var/log/aws-kinesis-agent/aws-kinesis-agent.log check if it's up then exit if ok
  7. gem install apache-loggen
  8. cd /tmp
  9. apache-loggen --rate=1000 > test.log
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment