Skip to content

Instantly share code, notes, and snippets.

@reisjr
Created July 7, 2017 17:39
Show Gist options
  • Save reisjr/b360676b2e3d0c6b2e6b96804deba642 to your computer and use it in GitHub Desktop.
Save reisjr/b360676b2e3d0c6b2e6b96804deba642 to your computer and use it in GitHub Desktop.
Script to install parquet-tools in Amazon EC2
#!/bin/bash
wget http://mirror.nbtelecom.com.br/apache/maven/maven-3/3.5.0/binaries/apache-maven-3.5.0-bin.tar.gz
tar zxvf apache-maven-3.5.0-bin.tar.gz
sudo yum install -y git java-devel
git clone https://github.com/Parquet/parquet-mr.git
cd parquet-mr/parquet-tools/
sed -i 's/1.6.0rc3-SNAPSHOT/1.6.0/g' pom.xml
~/apache-maven-3.5.0/bin/mvn clean package -Plocal
java -jar target/parquet-tools-1.6.0.jar schema ~/000000_0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment