Skip to content

Instantly share code, notes, and snippets.

@simon-mo

simon-mo/Batch Inference in RayServe.ipynb

Created April 21, 2020 01:46
Show Gist options
  • Save simon-mo/b5be0b95d6b79f27780d569073f5588a to your computer and use it in GitHub Desktop.
Save simon-mo/b5be0b95d6b79f27780d569073f5588a to your computer and use it in GitHub Desktop.
Download ZIP
Display the source blob
Display the rendered blob
Raw
Batch Inference in RayServe.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@crypdick
Copy link

Is it possible to assign fractional resources to ImageModel?

@simon-mo
Copy link
Author

@crypdick yes! in BackendConfig, you can specifies num_cpus and num_gpus the BackendConfig class to assign fractional resource

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment