Skip to content

Instantly share code, notes, and snippets.

@zoltanctoth
Last active April 9, 2018 11:30
Show Gist options
  • Save zoltanctoth/5528402 to your computer and use it in GitHub Desktop.
Save zoltanctoth/5528402 to your computer and use it in GitHub Desktop.
How to install twitter's elephant-bird on EMR
# Get a proper Maven
wget http://xenia.sote.hu/ftp/mirrors/www.apache.org/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz
tar xzf apache-maven-3.0.5-bin.tar.gz
export PATH=/home/hadoop/apache-maven-3.0.5/bin:$PATH
echo 'export PATH=/home/hadoop/apache-maven-3.0.5/bin:$PATH' >> ~/.bash_profile
# Install a supported version of protobuf
sudo apt-get remove protobuf-compiler
wget https://protobuf.googlecode.com/files/protobuf-2.4.1.tar.gz
tar xzf protobuf-2.4.1.tar.gz
cd protobuf-2.4.1
./configure && make && sudo make install && sudo ldconfig
cd
# Install ruby-dev (required by thrift)
sudo apt-get install ruby-dev
# Install thrift
wget http://archive.apache.org/dist/thrift/0.7.0/thrift-0.7.0.tar.gz
tar xzf thrift-0.7.0.tar.gz
cd thrift-0.7.0
chmod 755 configure
./configure && make && sudo make install
cd
# Install elephant-bird
git clone git://github.com/kevinweil/elephant-bird.git
cd elephant-bird
mvn package
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment