Skip to content

Instantly share code, notes, and snippets.

View catherinewills's full-sized avatar

Catherine Wills catherinewills

View GitHub Profile
@catherinewills
catherinewills / Golf Twitter Code Pipeline Analysis ELK Stack Configuration File
Created March 2, 2021 01:49
Twitter Pipeline Configuration File for Analysis of posts of Genesis Invitational 2021 and PGA Tour. Also, Tiger Woods' vehicle accident altered data regarding invitational
#Used Homebrew in MacOS in BigSur
#Make sure everything is the most updated versions
#Download and run Elasticsearch, Kibana, and Logstash
#Elasticsearch and Kibana ./kibana and ./elasticsearch
#Make sure all 3 host websites are up and running
#In Logstash, make a file called logstash either by itself or in conf file using mkdir to make the file and then nano twitter_pipeline.conf to type in configuriaton file
#Insert below configuration file using your key, click exit and Y when they ask you to save it
#Sometimes you can run into problems with elasticsearch if your drive has no room or if logstash has already been ran, must fix pathway or stop running lgostash. This was tricky.
#Run using ./logstash or bin something.. see doc