israel-hdez

Introduction

This guide describes the steps needed to generate a build and deploy/install the needed components that add authorization capabilities to the ODH KServe stack.

The authorization capabilities are implemented in two pull requests:

• opendatahub-io/opendatahub-operator#784
  • This pull request enables the ODH operator to install an Authorino instance, and to configure the Service Mesh to work with Authorino as an authorization provider. Additionally, when KServe is enabled, some additional configurations are installed whih are specific for KServe.
• opendatahub-io/odh-model-controller#130

israel-hdez

#!/usr/bin/env bash

# Deploy to new namespace
oc new-project kserve-test

# Create a ServingRuntime
curl -s https://raw.githubusercontent.com/opendatahub-io/kserve/master/config/runtimes/kserve-sklearnserver.yaml | \
  sed 's/ClusterServingRuntime/ServingRuntime/' | \
  sed "s|kserve-sklearnserver:replace|docker.io/kserve/sklearnserver:latest|" | \
  oc apply -f -

israel-hdez

kind: BuildConfig
apiVersion: build.openshift.io/v1
metadata:
  name: kserve-controller-bc
spec:
  source: 
    git:
      uri: https://github.com/opendatahub-io/kserve.git
      ref: master
    contextDir: "."

israel-hdez

FROM quay.io/opendatahub/openvino_model_server:2022.3-release

USER root
RUN mkdir /models && chown ovms:ovms /models

USER ovms
RUN curl --create-dirs \
  https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/face-detection-retail-0004/FP32/face-detection-retail-0004.xml \
  https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/face-detection-retail-0004/FP32/face-detection-retail-0004.bin \
  -o /models/1/face-detection-retail-0004.xml \

israel-hdez

#!/bin/bash

set -e

: ${ISTIO_DIR:="$HOME/apps/istio-1.9.0"}
ISTIOCTL=$ISTIO_DIR/bin/istioctl

: ${BOOKINFO_NS:=bookinfo}

: ${CTX1:=kukulcan}

israel-hdez

apiVersion: apps/v1
kind: Deployment
metadata:
  name: workload-a
  labels:
    app: workload-a
    version: v1
spec:
  replicas: 1
  selector: