Chef-bach can be used to create a hadoop test cluster using virtual machines on an hypervisor host with enough resources. The resulting cluster will be a 4 node cluster with one of the nodes acting as the bootstrap node which will host a chef server.The other three nodes will be hadoop nodes. 2 out of 3 nodes will be master nodes and one node will be the worker node. The following are the steps to go about creating the test cluster. This has been tested on hypervisor hosts running Mac OS and Ubuntu.
- Install
curl
on the hypervisor host - Install
virtualbox
on the hypervisor host - Install
vagrant
on the hypervisor host - Delete the default
DHCP server
inbuilt invirtualbox
- Run
sudo pkill -f VBox
on the hypervisor host - Clone chef-bach repository onto the hypervisor host
git clone https://github.com/bloomberg/chef-bach.git
- rename
chef-bach
tochef-bcpc
directory on the hypervisor host