Skip to content

Instantly share code, notes, and snippets.

@duggan

duggan/install.sh

Last active March 3, 2019 21:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 2 You must be signed in to fork a gist
  • Save duggan/5226491 to your computer and use it in GitHub Desktop.
Save duggan/5226491 to your computer and use it in GitHub Desktop.
Download ZIP
Setup ArchiveTeam Warrior supervisor config (Ubuntu EC2)
Raw
install.sh
#!/bin/bash
USERDATA=$(ec2metadata --user-data)
NICKNAME="hackernews"
if [ "$USERDATA" != "unavailable" ] ; then
NICKNAME=$USERDATA
fi
# Setup Supervisor
echo "[program:warrior]
command=run-pipeline --concurrent 2 /home/ubuntu/yahoomessages-grab/pipeline.py $NICKNAME
numprocs=1" \
> /etc/supervisor/conf.d/warrior.conf
/etc/init.d/supervisor stop
sleep 1
/etc/init.d/supervisor start
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment