Skip to content

Instantly share code, notes, and snippets.

View dsdickinson's full-sized avatar

Steve Dickinson dsdickinson

3 followers · 2 following
View GitHub Profile
@dsdickinson
dsdickinson / pytorch-source-build.md
Last active February 27, 2025 17:08
Jetson Orin Nano - Build PyTorch from source.

Jetson Orin Nano - Build PyTorch from source.

Get PyTorch repository.
> pip uninstall torch torchvision torchaudio
> git clone https://github.com/pytorch/pytorch.git
> cd pytorch
> git submodule sync && git submodule update --init --recursive
@dsdickinson
dsdickinson / triton-server-start.md
Last active February 21, 2025 18:45
Jetson Orin Nano - Triton Server Start

Jetson Orin Nano - Start a Triton Server

Launch the Triton Server docker image

> sudo docker run -d --gpus=1 --runtime=nvidia --rm -p8000:8000 -p8001:8001 -p8002:8002 -v/models:/models nvcr.io/nvidia/tritonserver:24.01-py3-igpu tritonserver --model-repository=/models --strict-model-config=false

Validations.

Validate server is running.
@dsdickinson
dsdickinson / dphys-swapfile.md
Last active February 21, 2025 18:45
Jetson Orin Nano - Configure SWAP space

Jetson Orin Nano - Configure SWAP space to facilitate building from source.

While building applications from source on a Jetson Orin Nano, you may run into performance issues .. notably running out of resources which causes lock-ups and reboots as it only has 8 GB of RAM. This gist explains how to give yourself more SWAP space to better the chances of getting a successful build.

Install SWAP file software.
sudo apt-get install -y dphys-swapfile
Configure SWAP sizes.