How to run tests of PyTorch Distributed module Run all distributed tests python test/run_test.py -pt -vi distributed/test_distributed Run a single test python test/run_test.py -vi distributed/test_distributed -- -k test_DistributedDataParallel