Skip to content

Instantly share code, notes, and snippets.

@wookim3

wookim3/PyTorch-XLA-Dist-Wrapper.py

Created September 29, 2020 04:46
Show Gist options
  • Save wookim3/9fdf48ae2c06fe5e6c0e732424b240ba to your computer and use it in GitHub Desktop.
Save wookim3/9fdf48ae2c06fe5e6c0e732424b240ba to your computer and use it in GitHub Desktop.
Download ZIP
Raw
PyTorch-XLA-Dist-Wrapper.py
python -m torch_xla.distributed.xla_dist \
--tpu=$TPU_NAME \
--conda-env=torch-xla-1.6 \
--env ANY_ENV_VAR=VALUE \
-- \
python /path/to/your/code.py --train_arg1 \
--train_arg2 ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment