This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
""" Methods for Training on a distributed Network """ | |
""" | |
The session is set up to be run in a distributed local environment. | |
The workers should be assigned to GPUs because they do most of the | |
heavy lifting in the compuation. Assign a different domain:port double | |
for each GPU available on the local host. | |
The parameter servers should simply be assigned to CPUs. See the |