Skip to content

Instantly share code, notes, and snippets.

@gaocegege
Created August 20, 2021 09:50
Show Gist options
  • Save gaocegege/66745040c994e6444fb2a14493550b6a to your computer and use it in GitHub Desktop.
Save gaocegege/66745040c994e6444fb2a14493550b6a to your computer and use it in GitHub Desktop.
PyTorch Elastic
import torch.distributed as dist
import os
import time
def main():
dist.init_process_group(
backend="gloo"
)
time.sleep(3600)
if __name__ == "__main__":
main()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment