Thank you to Changjiang as most of the code here comes from this tutorial and I have only added a few lines in order to get caffe working.
Install Anaconda (for Python 2.7) Then clone the caffe repository somewhere:
git clone git@github.com:BVLC/caffe.git