Skip to content

Instantly share code, notes, and snippets.

@sighingnow

sighingnow/pipeline-model-parallel-visualization.ipynb

Last active December 25, 2023 02:02
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save sighingnow/ce6aef69aaa379517ac4b68bc2873a9c to your computer and use it in GitHub Desktop.
Save sighingnow/ce6aef69aaa379517ac4b68bc2873a9c to your computer and use it in GitHub Desktop.
Download ZIP
Visualizing various different pipeline model parallel scheduling algorithms: GPipe, Pipedream(1F1B), Pipedream-2BW(async, no-flushes), and eager-1F1B
Display the source blob
Display the rendered blob
Raw
pipeline-model-parallel-visualization.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@sighingnow
Copy link
Author

nbviewer: https://nbviewer.org/gist/sighingnow/ce6aef69aaa379517ac4b68bc2873a9c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment