Skip to content

Instantly share code, notes, and snippets.

@sighingnow

sighingnow/pipeline-model-parallel-visualization.ipynb

Last active September 18, 2023 02:29
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Embed
What would you like to do?
Learn more about clone URLs
Download ZIP
Visualizing various different pipeline model parallel scheduling algorithms: GPipe, Pipedream(1F1B), Pipedream-2BW(async, no-flushes), and eager-1F1B
Display the source blob
Display the rendered blob
Raw
pipeline-model-parallel-visualization.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@sighingnow
Copy link
Author

nbviewer: https://nbviewer.org/gist/sighingnow/ce6aef69aaa379517ac4b68bc2873a9c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment