Skip to content

Instantly share code, notes, and snippets.

@Jooho
Last active June 13, 2024 20:48
Show Gist options
  • Save Jooho/ec6fa05508ed46a01eb0a8963b705afc to your computer and use it in GitHub Desktop.
Save Jooho/ec6fa05508ed46a01eb0a8963b705afc to your computer and use it in GitHub Desktop.
apiVersion: serving.kserve.io/v1alpha1
kind: ServingRuntime
metadata:
name: kserve-sklearnserver
spec:
annotations:
prometheus.io/port: '8080'
prometheus.io/path: "/metrics"
serving.knative.openshift.io/enablePassthrough: "true"
sidecar.istio.io/inject: "true"
sidecar.istio.io/rewriteAppHTTPProbers: "true"
supportedModelFormats:
- name: sklearn
version: "1"
autoSelect: true
priority: 1
protocolVersions:
- v1
- v2
containers:
- name: kserve-container
image: docker.io/kserve/sklearnserver:latest
args:
- --model_name={{.Name}}
- --model_dir=/mnt/models
- --http_port=8080
resources:
requests:
cpu: "1"
memory: 2Gi
limits:
cpu: "1"
memory: 2Gi
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment