Created
January 5, 2021 16:19
-
-
Save caleb-kaiser/531efbd784483d2cc378651b70d07e54 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- name: <string> # API name (required) | |
kind: RealtimeAPI | |
predictor: | |
type: python | |
path: <string> # path to a python file with a PythonPredictor class definition, relative to the Cortex root (required) | |
server_side_batching: # (optional) | |
max_batch_size: <int> # the maximum number of requests to aggregate before running inference | |
batch_interval: <duration> # the maximum amount of time to spend waiting for additional requests before running inference on the batch of requests |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment