Skip to content

Instantly share code, notes, and snippets.

@janvarev

janvarev/deepspeedrun.py

Created April 15, 2023 11:15
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save janvarev/8b6563b5da269533f9ec4e92e0327451 to your computer and use it in GitHub Desktop.
Save janvarev/8b6563b5da269533f9ec4e92e0327451 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
deepspeedrun.py
from deepspeed.launcher.runner import main
import sys
import os
if sys.platform == "win32":
os.environ["PL_TORCH_DISTRIBUTED_BACKEND"] = "gloo"
if __name__ == '__main__':
main()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment