Instantly share code, notes, and snippets.

Embed
What would you like to do?
Setup Kafka (0.8.0) on OSX
brew install sbt
cd /tmp
wget http://apache.spd.co.il/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz
tar -zxvf kafka_2.8.0-0.8.0.tar.gz -C /usr/local/
cd /usr/local/kafka_2.8.0-0.8.0
sbt update
sbt package
cd /usr/local
ln -s kafka_2.8.0-0.8.0 kafka
echo "" >> ~/.bash_profile
echo "" >> ~/.bash_profile
echo "# KAFKA" >> ~/.bash_profile
echo "export KAFKA_HOME=/usr/local/kafka" >> ~/.bash_profile
source ~/.bash_profile
echo "export KAFKA=$KAFKA_HOME/bin" >> ~/.bash_profile
echo "export KAFKA_CONFIG=$KAFKA_HOME/config" >> ~/.bash_profile
source ~/.bash_profile
$KAFKA/zookeeper-server-start.sh $KAFKA_CONFIG/zookeeper.properties
$KAFKA/kafka-server-start.sh $KAFKA_CONFIG/server.properties
@thomascool

This comment has been minimized.

thomascool commented Feb 25, 2015

wget http://apache.spd.co.il/kafka/0.8.2.0/kafka_2.11-0.8.2.0.tgz
tar -zxvf kafka_2.11-0.8.2.0.tgz -C /usr/local/
cd /usr/local/kafka_2.11-0.8.2.0

sbt update
sbt package

cd /usr/local
ln -s kafka_2.11-0.8.2.0 kafka

@levbrie

This comment has been minimized.

levbrie commented May 24, 2015

Also, keep in mind that you want the first set of numbers to match up with the version of scala you have installed. To make this a little more ovbious:

# KAFKA INSTALLER:
# downloads, un-tars, moves to /usr/local, simlinks from full versioned name
# to kafka, exports into path in `.bash_profile`, and then starts
# zookeeper and kafka server

brew install sbt # ensure sbt is installed first!

# current kafka for scala 2.11: http://apache.spd.co.il/kafka/0.8.2.1/kafka_2.11-0.8.2.1.tgz

SCALA_VERSION="2.11"
KAFKA_VERSION="0.8.2.1"
KAFKA_VERSIONED_NAME="kafka_${SCALA_VERSION}-${KAFKA_VERSION}"
APACHE_DOWNLOAD_BASEPATH="http://apache.spd.co.il/kafka"
KAFKA_DOWNLOAD_URL="${APACHE_DOWNLOAD_BASEPATH}/${KAFKA_VERSION}/${KAFKA_VERSIONED_NAME}.tgz"

echo "DOWNLOAD URL"
echo "${KAFKA_DOWNLOAD_URL}"

cd /tmp

wget "${KAFKA_DOWNLOAD_URL}"
tar -zxvf "${KAFKA_VERSIONED_NAME}.tgz" -C /usr/local/
cd "/usr/local/${KAFKA_VERSIONED_NAME}"

sbt update
sbt package

cd /usr/local
ln -s "${KAFKA_VERSIONED_NAME}" kafka

echo "" >> ~/.bash_profile
echo "" >> ~/.bash_profile
echo "# KAFKA" >> ~/.bash_profile
echo "export KAFKA_HOME=/usr/local/kafka" >> ~/.bash_profile
source ~/.bash_profile

echo "export KAFKA=$KAFKA_HOME/bin" >> ~/.bash_profile
echo "export KAFKA_CONFIG=$KAFKA_HOME/config" >> ~/.bash_profile
source ~/.bash_profile
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment