Skip to content

Instantly share code, notes, and snippets.

@ericxyan
Last active April 28, 2020 02:35
Show Gist options
  • Star 6 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ericxyan/910e9c816346eccfab5faee67ceaccb0 to your computer and use it in GitHub Desktop.
Save ericxyan/910e9c816346eccfab5faee67ceaccb0 to your computer and use it in GitHub Desktop.
TICK Stack vs ELK Stack

TICK Stack

Solution for collecting, storing, visualizing and alerting on time-series data at scale. All components of the platform are designed to work together seamlessly.

  • Telegraf: Collects time-series data from a variety of sources
  • InfluxDB:
  • Chronograf: Visualizes and graphs
  • Kapacitor: Alerting, ETL and detects anomalies in time-series data

Why Influx?

  • Open Source - MIT
  • Integrated - Data collection, storage, visualization and alerting
  • Distributed & Clustered
  • Real-Time Downsampling - Continuous queries precompute large amounts of data on-the-fly before being written
  • Efficient Storage - High compression and retention policies lower storage footprints and costs
  • InfluxData is designed from the ground up to do one thing, manage time-series data at scale.

ELK Stack

AWS Cluster

Youtube

Amazon Linux AMI

Commands

sudo su

yum update -y

cd /root

wget https://download.elastic.co/elasticsearch/release/org/elasticsearch/distribution/rpm/elasticsearch/2.3.2/elasticsearch-2.3.2.rpm

yum install elasticsearch-1.7.2.noarch.rpm -y

rm -f elasticsearch-1.7.2.noarch.rpm

cd /usr/share/elasticsearch/

./bin/plugin -install mobz/elasticsearch-head

./bin/plugin -install lukas-vlcek/bigdesk

./bin/plugin install elasticsearch/elasticsearch-cloud-aws/2.7.1

./bin/plugin --install lmenezes/elasticsearch-kopf/1.5.7

cd /etc/elasticsearch

nano elasticsearch.yml

Config

cluster.name: awstutorialseries

cloud.aws.access_key: ACCESS_KEY_HERE

cloud.aws.secret_key: SECRET_KEY_HERE

cloud.aws.region: us-east-1

discovery.type: ec2

discovery.ec2.tag.Name: "AWS Tutorial Series - Elasticsearch"

http.cors.enabled: true

http.cors.allow-origin: "*"

Commands

service elasticsearch start

Logstash 1.5.4-1

Commands

sudo su

yum update -y

cd /root

wget https://download.elastic.co/logstash/logstash/packages/centos/logstash-1.5.4-1.noarch.rpm

yum install logstash-1.5.4-1.noarch.rpm -y

rm -f logstash-1.5.4-1.noarch.rpm

nano /etc/logstash/conf.d/logstash.conf

Config

input { file { path => "/tmp/logstash.txt" } } output { elasticsearch { host => "ELASTICSEARCH_URL_HERE" protocol => "http" } }

Commands

service logstash start

Kibana 4.1.2

Commands

sudo su

yum update -y

cd /root

wget https://download.elastic.co/kibana/kibana/kibana-4.1.2-linux-x64.tar.gz

tar xzf kibana-4.1.2-linux-x64.tar.gz

rm -f kibana-4.1.2-linux-x64.tar.gz

cd kibana-4.1.2-linux-x64

nano config/kibana.yml 

Config

elasticsearch_url: "ELASTICSEARCH_URL_HERE"

Commands

nohup ./bin/kibana &

Navigate In Browser

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment