Skip to content

Instantly share code, notes, and snippets.

@versvs
Last active February 16, 2018 11:27
Show Gist options
  • Save versvs/94c8f2b199eaa096f4271a16aaef50d3 to your computer and use it in GitHub Desktop.
Save versvs/94c8f2b199eaa096f4271a16aaef50d3 to your computer and use it in GitHub Desktop.
Start cloudera inside a Docker container
# Pulls the image (4Gb!)
docker pull cloudera/quickstart
# Ports to be opened (most commonly used)
# - 8888 expose hue interface
# - 7180 expose cloudera manager
# - 80 expose cloudera examples
# - 8983 expose port of Web UI solr search
# - 50070 expose name node web ui interface
# - 50090 expose secondary name node
# - 50075 expose data node
# - 50030 expose job tracker
# - 50060 expose task trackers
# - 60010 expose hbase master status
# - 60030 expose hbase region server
# - 9095 expose hbase thrift server
# - 8020 expose hdfs port
# - 8088 expose job tracker port
# - 4040 expose port of spark
# - 18088 expose history server web interface
ports="-p 8888:8888 -p 7180:7180 -p 80:80 -p 4040:4040 -p 4041:4041 -p 4042:4042 -p 4043:4043 -p 9092:9092 -p 2181:2181 -p 8020:8020 -p 18088:18088"
# Volume used to exchange stuff with the running container
localVolumeDir=/home/me/cloudera_exchange_dir
# Runs it, exposing ports for Hue, Cloudera Manager and a tutorial
containerId=`docker run --hostname=quickstart.cloudera -d \
-v $localVolumeDir:/volume \
--privileged=true -t -i $ports cloudera/quickstart /usr/bin/docker-quickstart`
# Now you can start Cloudera Manager (from within the container)
# sudo su
# cd /home/cloudera/
# ./cloudera-manager
echo Started Cloudera Quickstart (containerId=$containerId)
# Kafka does not come with Cloudera Quickstart
# See https://kafka.apache.org/quickstart
# > bin/kafka-server-start.sh config/server.properties
# you need to enter the container itself using
# `~# docker exec -it [container-id] bash`
# then start kafka-server using the `.sh` script above
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment