Log into your server with ssh, something like
ssh -i "my_secret.pem" ubuntu@12.123.12.123
If it's a new server, you'll need to install a few things.
Install conda with
#!/bin/bash | |
# Might as well ask for password up-front, right? | |
sudo -v | |
# Keep-alive: update existing sudo time stamp if set, otherwise do nothing. | |
while true; do sudo -n true; sleep 60; kill -0 "$$" || exit; done 2>/dev/null & | |
# Example: do stuff over the next 30+ mins that requires sudo here or there. | |
function wait() { |
Log into your server with ssh, something like
ssh -i "my_secret.pem" ubuntu@12.123.12.123
If it's a new server, you'll need to install a few things.
Install conda with
#!/bin/bash | |
## FORSTWOOF UBUNTU PRESEED :: BUILD SCRIPT | |
# Quit on first error | |
set -e | |
# Temporary directory for the build | |
TMP="/var/tmp/ubuntu-build" |
#!/bin/bash | |
#Enables Playing on a moonlight server via an ssh tunnel. This is useful on restricted networks, as only the ssh port is needed. | |
#Needs the complimentary script, redirectudp, running on the ssh server to function. | |
#needs a private key for the ssh server | |
#sudo apt install ssh socat snap | |
#snap install moonlight |
#!/bin/bash | |
# Basic Script to Automate Docker Deployment | |
# - Details for how this script works, see here: | |
# - https://gist.github.com/christopher-talke/11c655de511dd799a1d9c3cf156e7a94#gistcomment-2935112 | |
# Created By: christopher.talke <christopher.talke@gmail.com> | |
##### VARIABLES SECTION ##### |
Allocate 3 nodes with 1 task of 24 cpus each:
salloc -N 3 -n 3 -c 24
Within the allocation, make sure you have dask etc (e.g. by activating a virtual or conda env).
Start a scheduler (on the first node) and three workers (one per node):
$ srun -n1 -N1 -r0 dask-scheduler --scheduler-file scheduler.json &>> scheduler.log &