willprice

Kinetics Numeric/String labels

These are mapping files that go between class IDs to class names. These are generated from the training CSV files from each dataset by collecting the unique classes, sorting them, and then numbering them from 0 upwards.

willprice

PBS Pro command cheat sheet

List nodes and their features

$ pbsnodes

---

willprice

def relative_symlink(target: Union[Path, str], destination: Union[Path, str]):
    """Create a symlink pointing to ``target`` from ``location``.

    Args:
        target: The target of the symlink (the file/directory that is pointed to)
        destination: The location of the symlink itself.
    """
    target = Path(target)
    destination = Path(destination)
    target_dir = destination.parent

willprice

# The following steps are based on
# https://docs.fast.ai/performance.html#installation

$ conda install -y -c conda-forge gxx_linux-64 
$ conda uninstall -y --force jpeg libtiff
$ conda install -y -c conda-forge libjpeg-turbo --no-deps
$ pip uninstall -y pillow
$ export CXX=x86_64-conda-linux-gnu-g++
$ export CC=x86_64-conda-linux-gnu-gcc

willprice

# Ruby is our language as asciidoctor is a ruby gem.
lang: ruby
before_install:
  - sudo apt-get install pandoc
  - gem install asciidoctor
script:
  - make
after_success:
  - .travis/push.sh
env:

willprice

Resources

• Andrej Karpathy top-5 errors (twitter0
• Practical Advice for Building Deep Neural Networks
• CS231n sanity checks
• CrossValidated: "What should I do when my neural network doesn't learn
• TFCheck - a paper about a TF library for detecting common training errors
• Debugging using hooks in pytorch

Debugging training

willprice

import numpy as np
from PIL import Image

def vstack(images):
    if len(images) == 0:
        raise ValueError("Need 0 or more images")

    if isinstance(images[0], np.ndarray):
        images = [Image.fromarray(img) for img in images]
    width = max([img.size[0] for img in images])

willprice

USB ID 2357:0120 -> https://github.com/aircrack-ng/rtl8812au
USB ID 2357:0138 -> https://github.com/RinCat/RTL88x2BU-Linux-Driver (follow the manual DKMS setup guide)

willprice

Install OpenCV 4.1.2 on Raspbian Buster

$ chmod +x *.sh
$ ./download-opencv.sh
$ ./install-deps.sh
$ ./build-opencv.sh
$ cd ~/opencv/opencv-4.1.2/build
$ sudo make install

willprice

FFmpeg Cheatsheet for video ML practitioners

Dump single frame from a video:

$ ffmpeg -ss 0.5 -i in.mp4 -t 1 -s 1920x1080 -f image2 out.jpg
# -ss specifies the start position in seconds, or timestamp
# -t the number of frames, in this case 1
# -s size of output
# -f image2 forces image output