Skip to content

Instantly share code, notes, and snippets.

@rajkrrsingh

rajkrrsingh/LLAP_DEMO.md

Last active February 20, 2018 13:18
Show Gist options
  • Star 2 You must be signed in to star a gist
  • Fork 1 You must be signed in to fork a gist
  • Save rajkrrsingh/3bf23db5427f4cc63c796a1bfd3834e5 to your computer and use it in GitHub Desktop.
Save rajkrrsingh/3bf23db5427f4cc63c796a1bfd3834e5 to your computer and use it in GitHub Desktop.
Download ZIP
LLAP Application demo on HDP2.5 using tpc-ds dataset
Raw
LLAP_DEMO.md 
su - hdfs 
wget https://github.com/hortonworks/hive-testbench/archive/hive14.zip
unzip hive14.zip
cd hive-testbench-hive14/
vi hive-testbench-hive14/settings/load-partitioned.sql -- remove G1GC and use Parrallel GC scheme
cd hive-testbench-hive14/
yum install gcc
echo 'export JAVA_HOME=/usr/jdk64/jdk1.8.0_77' >> ~/.bashrc
echo 'PATH=$PATH:$JAVA_HOME/bin' >> ~/.bashrc
source ~/.bashrc
javac -version
cd hive-testbench-hive14/
./tpcds-build.sh
./tpcds-setup.sh 5
cd sample-queries-tpcds
lsof -i:10500 -- check hiveserver2 interactive is running
beeline -i testbench.settings -u jdbc:hive2://localhost:10500/tpcds_bin_partitioned_orc_30
set hive.llap.execution.mode=none -- without llap
!run query12.sql
set hive.llap.execution.mode=all --enable llap
!run query12.sql
see the differnece between time of execution with n wo llap
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment