Skip to content

Instantly share code, notes, and snippets.

@mcarilli
Created October 12, 2018 00:43
Show Gist options
  • Save mcarilli/03b22d26422db15f577351d5710e4c1e to your computer and use it in GitHub Desktop.
Save mcarilli/03b22d26422db15f577351d5710e4c1e to your computer and use it in GitHub Desktop.
python -m torch.distributed.launch --nproc_per_node=2 main.py -a resnet50 -b 32 --epochs=1 --workers 4 -p 10 --fp16 --prof 100 --deterministic ..
nvprof --profile-from-start off --profile-child-processes -fo %p.nvprof python -m torch.distributed.launch --nproc_per_node=2 main.py -a resnet50 -b 32 --epochs=1 --workers 4 -p 10 --fp16 --prof 100 --deterministic ..
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment