zilunpeng/share_model_decoder.py

Created March 23, 2021 22:19

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/zilunpeng/e6c6b479152456501b6dacda3313c563.js"></script>
Save zilunpeng/e6c6b479152456501b6dacda3313c563 to your computer and use it in GitHub Desktop.

Download ZIP

Put model and decoder to shared memory. Code below is part of the distributed inference notebook (https://git.io/JYeQQ).

Raw

share_model_decoder.py

	model_id = ray.put(model)
	decoder_id = ray.put(decoder)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment