public
Last active

Turn an Ubuntu 10.04 linode into a StatsD/Graphite server

  • Download Gist
setup-statsd.sh
Shell
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71
# install git
sudo apt-get install g++ curl libssl-dev apache2-utils
sudo apt-get install git-core
# download the Node source, compile and install it
git clone https://github.com/joyent/node.git
cd node
./configure
make
sudo make install
# install the Node package manager for later use
curl http://npmjs.org/install.sh | sudo sh
npm install express
# clone the statsd project
git clone https://github.com/etsy/statsd.git
# download everything for graphite
mkdir graphite
cd graphite/
wget "http://launchpad.net/graphite/trunk/0.9.6/+download/carbon-0.9.6.tar.gz"
wget "http://launchpad.net/graphite/trunk/0.9.6/+download/whisper-0.9.6.tar.gz"
wget "http://launchpad.net/graphite/trunk/0.9.6/+download/graphite-web-0.9.6.tar.gz"
tar xzvf whisper-0.9.6.tar.gz
tar xzvf carbon-0.9.6.tar.gz
tar xzvf graphite-web-0.9.6.tar.gz
# install whisper - Graphite's DB system
cd whisper-0.9.6
sudo python setup.py install
popd
# install carbon - the Graphite back-end
cd carbon-0.9.6
python setup.py install
cd /opt/graphite/conf
cp carbon.conf.example carbon.conf
# copy the example schema configuration file, and then configure the schema
# see: http://graphite.wikidot.com/getting-your-data-into-graphite
cp storage-schemas.conf.example storage-schemas.conf
# install other graphite dependencies
sudo apt-get install python-cairo
sudo apt-get install python-django
sudo apt-get install memcached
sudo apt-get install python-memcache
sudo apt-get install python-ldap
sudo apt-get install python-twisted
sudo apt-get install apache2 libapache2-mod-python
cd ~/graphite/graphite-web-0.9.6
python setup.py install
# copy the graphite vhost example to available sites, edit it to you satisfaction, then link it from sites-enabled
cp example-graphite-vhost.conf /etc/apache2/sites-available/graphite.conf
ln -s /etc/apache2/sites-available/graphite.conf /etc/apache2/sites-enabled/graphite.conf
apache2ctl restart
# I had to create these log files manually
/opt/graphite/storage/log/webapp
touch info.log
chmod 777 info.log
touch exception.log
chmod 777 exception.log
# make sure to change ownership of the storage folder to the Apache user/group - mine was www-data
sudo chown -R www-data:www-data /opt/graphite/storage/
cd /opt/graphite/webapp/graphite
# copy the local_settings example file to creating the app's settings
# this is where both carbon federation and authentication is configured
cp local_settings.py.example local_settings.py
# run syncdb to setup the db and prime the authentication model (if you're using the DB model)
sudo python manage.py syncdb
# start the carbon cache
cd /opt/graphite/bin/carbon-cache.py start
# copy the the statsd config example to create the config file
# unless you used non-default ports for some other feature of the system, the defaults in the config file are fine
cd ~/statsd
cp exampleConfig.js local.js
# start statsd
node stats.js local.js

trying this out on ubuntu hardy. lulz may ensue.

EDIT: fails at npm thinking node isn't installed. that was quick!

I know very little about Ubuntu and linux in general, but the script as written works on Linode. Try Linode.

Should line 51 begin with "cd "?

Yep. Thanks @nickhoffman.

Thanks for posting this, mate! Very helpful.

You're welcome. I don't have a production use for it yet, but it's a really cool product.

This was a really helpful post, thanks!

Things I changed:
Add pkg-config to line 2, to get rid of the openssl error when using ./configure
After using git clone, "git checkout v0.4.9" to make node 0.4.9 the active version so that express is compatible with it using npm.

The URLs for graphite are now:
wget http://launchpad.net/graphite/1.0/0.9.8/+download/graphite-web-0.9.8.tar.gz
wget http://launchpad.net/graphite/1.0/0.9.8/+download/carbon-0.9.8.tar.gz
wget http://launchpad.net/graphite/1.0/0.9.8/+download/whisper-0.9.8.tar.gz

I would love to incorporate your changes into my own gist. Do you have the whole scripts somewhere, including your modifications?

Aaron,

Is there a way for me to push changes to your script via github? Or do you know what the standard way to contribute is? I've been wanting to get involved in open source projects and this could be a good simple way to start.

I woul like to finish going through the process one more time to ensure the changes are correct an then I'd be happy to either send the script to you or update it directly, if you prefer.

On Sep 28, 2011, at 6:12 PM, Aaron Collegeman reply@reply.github.com wrote:

I would love to incorporate your changes into my own gist. Do you have the whole scripts somewhere, including your modifications?

Reply to this email directly or view it on GitHub:
https://gist.github.com/862471

Here's a full-fledged Git project for you to contribute to:

https://github.com/collegeman/ubuntu-statsd/blob/master/setup-statsd.sh

Just click Edit this file, make your changes, and I'll get a pull request.

Did you get the pull request? Do I need to do anything else to send the request?

Please sign in to comment on this gist.

Something went wrong with that request. Please try again.