Skip to content

Instantly share code, notes, and snippets.

@iamhowardtheduck
Created November 10, 2018 18:40
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save iamhowardtheduck/ae242b14ed9da784a28a193acef35852 to your computer and use it in GitHub Desktop.
Save iamhowardtheduck/ae242b14ed9da784a28a193acef35852 to your computer and use it in GitHub Desktop.
# Begin welcome screen.
clear
echo -e "\n\n\n\n\n\n\n\n\n\n\n\n"
echo "Welcome to the $(tput setaf 1)ArcSight$(tput setaf 7) Investigate for the $(tput setaf 4)Masses$(tput setaf 7) 1.0."
echo
echo "Before we begin, we're going to need wget & kafka."
yum install wget -y
wget http://apache.claz.org/kafka/2.0.0/kafka_2.11-2.0.0.tgz
echo "Now let's unwrap our Kafka present!"
tar xvf kafka_2.11-2.0.0.tgz
cd kafka_2.11-2.0.0
echo "What is the IP of the interface designated for Kafka? It must be different then the Vertica IP."
echo
echo
read kafkaIP
echo "What topic will Investigate consume from? Not the eb-internal-avro topic, this will be the destination we're applying on our smartconnectors. I would recommend the name \"Investigate\""
echo
echo
read kafkaTopic
echo "How many hours do you want to retain data in your $kafkaTopic topic? Recommend no more than 8 to 12 hours."
read kafkaHours
echo
echo
echo "Now we'll modify our Kafka config JMX setting and listening IP."
sed -i "31s//#listeners=PLAINTEXT:\/\/:9092/listeners=PLAINTEXT:\/\/$kafkaIP:9092/" config/server.properties
sed -i "103s/log.retention.hours=168/log.retention.hours=8/" config/server.properties
sed -i "123s/zookeeper.connect=localhost:2181/zookeeper.connect=$kafkaIP:2181/" config/server.properties
sed -i -e '$a\export JMX_PORT=9999' bin/kafka-server-start.sh
sed -i "168s/KAFKA_JMX_OPTS=\"-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false \"/KAFKA_JMX_OPTS=\"-Dcom.sun.management.jmxremote=true -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djava.rmi.server.hostname=arcmc -Djava.net.preferIPv4Stack=true\"" bin/kafka-run-class.sh
echo "Now let's run the vEBDoK.sh app"
;;
@iamhowardtheduck
Copy link
Author

Early build, still in work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment