Setup ngrok and run TensorBoard on Colab
!wget https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-linux-amd64.zip
!unzip ngrok-stable-linux-amd64.zip
LOG_DIR = './log'
get_ipython().system_raw(
# Install | |
# via http://askubuntu.com/questions/510056/how-to-install-google-chrome | |
wget -q -O - https://dl-ssl.google.com/linux/linux_signing_key.pub | sudo apt-key add - | |
sudo sh -c 'echo "deb http://dl.google.com/linux/chrome/deb/ stable main" >> /etc/apt/sources.list.d/google-chrome.list' | |
sudo apt-get update | |
sudo apt-get install google-chrome-stable | |
# Update |
model.zero_grad() # Reset gradients tensors | |
for i, (inputs, labels) in enumerate(training_set): | |
predictions = model(inputs) # Forward pass | |
loss = loss_function(predictions, labels) # Compute loss function | |
loss = loss / accumulation_steps # Normalize our loss (if averaged) | |
loss.backward() # Backward pass | |
if (i+1) % accumulation_steps == 0: # Wait for several backward steps | |
optimizer.step() # Now we can do an optimizer step | |
model.zero_grad() # Reset gradients tensors | |
if (i+1) % evaluation_steps == 0: # Evaluate the model when we... |
# -*- coding: utf-8 -*- | |
""" | |
Pure Python 3.6 example of doing binary space partioning for rectangles | |
Note the example is meant to be illustrative rather than performant, idiomatic or compact | |
Copyright 2019 Dustin Andrews | |
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: | |
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. |
Setup ngrok and run TensorBoard on Colab
!wget https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-linux-amd64.zip
!unzip ngrok-stable-linux-amd64.zip
LOG_DIR = './log'
get_ipython().system_raw(
Google Colab: https://colab.research.google.com/
Use apt to install the necessary packages:
sudo apt install -y slurm-wlm slurm-wlm-doc
Load file:///usr/share/doc/slurm-wlm/html/configurator.html in a browser (or file://wsl%24/Ubuntu/usr/share/doc/slurm-wlm/html/configurator.html on WSL2), and:
SlurmctldHost
and NodeName
.CPUs
as appropriate, and optionally Sockets
, CoresPerSocket
, and ThreadsPerCore
. Use command lscpu
to find what you have.RealMemory
to the number of megabytes you want to allocate to Slurm jobs,StateSaveLocation
to /var/spool/slurm-llnl
.ProctrackType
to linuxproc
because processes are less likely to escape Slurm control on a single machine config.# Add this in a Google Colab cell to install the correct version of Pytorch Geometric. | |
import torch | |
def format_pytorch_version(version): | |
return version.split('+')[0] | |
TORCH_version = torch.__version__ | |
TORCH = format_pytorch_version(TORCH_version) | |
def format_cuda_version(version): |