Skip to content

Instantly share code, notes, and snippets.

View johnmcollier's full-sized avatar

John Collier johnmcollier

  • Red Hat
  • Toronto, CA
View GitHub Profile
from llama_stack_client.lib.agents.event_logger import EventLogger
base_url = "http://localhost:8321"
from llama_stack_client import LlamaStackClient
import json
client = LlamaStackClient(
base_url=base_url
)
model = "llama3.1:8b"
dynamicPlugins:
frontend:
red-hat-developer-hub.backstage-plugin-ai-experience:
mountPoints:
- mountPoint: global.header/application-launcher
importName: HeaderButton
config:
section: "Red Hat AI"
priority: 180,
props:
@johnmcollier
johnmcollier / model-catalog.yaml
Created August 16, 2024 20:06
model-catalog.yaml
---
apiVersion: backstage.io/v1alpha1
kind: System
metadata:
name: parasol-insurance-llm
spec:
owner: user1
---
apiVersion: backstage.io/v1alpha1
kind: API
---
apiVersion: backstage.io/v1alpha1
kind: System
metadata:
name: parasol-insurance-llm
spec:
owner: user1
---
apiVersion: backstage.io/v1alpha1
kind: API
@johnmcollier
johnmcollier / granite-20b-lws.yaml
Created June 10, 2024 18:11
granite-20b-lws.yaml
apiVersion: leaderworkerset.x-k8s.io/v1
kind: LeaderWorkerSet
metadata:
name: vllm
spec:
replicas: 1
leaderWorkerTemplate:
size: 4
restartPolicy: RecreateGroupOnPodRestart
leaderTemplate:
@johnmcollier
johnmcollier / sample-workbench.yaml
Last active May 29, 2024 14:39
sample-workbench.yaml
apiVersion: kubeflow.org/v1
kind: Notebook
metadata:
annotations:
notebooks.opendatahub.io/inject-oauth: 'true'
opendatahub.io/image-display-name: code-server
opendatahub.io/accelerator-name: ''
openshift.io/description: ''
openshift.io/display-name: workbench-test-two
notebooks.opendatahub.io/last-image-selection: 'code-server-notebook:2024.1'
@johnmcollier
johnmcollier / apiresourceschema_rename.yaml
Created November 4, 2022 16:52
apiresourceschema_rename.yaml
# This file is generated from CRDs by ./hack/generate-kcp-api.sh script.
# Please do not modify!
apiVersion: apis.kcp.dev/v1alpha1
kind: APIResourceSchema
metadata:
creationTimestamp: null
name: v202211031702.applications.appstudio.redhat.com
spec:
group: appstudio.redhat.com
@johnmcollier
johnmcollier / apiexport-rename.yaml
Created November 4, 2022 16:51
apiexport-rename.yaml
# This file is generated from CRDs by ./hack/generate-kcp-api.sh script.
# Please do not modify!
apiVersion: apis.kcp.dev/v1alpha1
kind: APIExport
metadata:
name: application-api
spec:
permissionClaims:
- group: ""
@johnmcollier
johnmcollier / has-binding.yaml
Created November 1, 2022 16:02
has-binding.yaml
apiVersion: apis.kcp.dev/v1alpha1
kind: APIBinding
metadata:
name: has
spec:
reference:
workspace:
path: root:redhat-appstudio
exportName: application-service
permissionClaims:
@johnmcollier
johnmcollier / spi-binding.yaml
Created November 1, 2022 15:59
spi-binding.yaml
apiVersion: apis.kcp.dev/v1alpha1
kind: APIBinding
metadata:
name: application-api-binding
spec:
reference:
workspace:
exportName: spi
path: root:redhat-appstudio
permissionClaims: