rinormaloku

# Voxtype with Parakeet (CUDA) — Install Notes

**System:** AMD Ryzen 9 7950X · NVIDIA RTX 4070 · Ubuntu 26.04 · CUDA 12.4 runtime

---

## 1. Install the ONNX binary

The default voxtype binary only supports Whisper. Parakeet requires the `onnx-cuda-12` variant.

rinormaloku

#!/usr/bin/env bash

number=$1
name=$2
region=$3
zone=$4
twodigits=$(printf "%02d\n" $number)

if [ -z "$3" ]; then
  region=us-east-1

rinormaloku

"domains": [
  "catalog.prod.svc.cluster.local"
],
"name": "catalog.prod.svc.cluster.local:80",
"routes": [
  {
    "match": {
      "headers": [
        {
          "name": "x-dark-launch",

rinormaloku

Debugging Pilot with Delve

First build pilot with GCFLAGS="all=-n -l":

GCFLAGS="all=-N -l" DEBUG=1 HUB=docker.io/slandow TAG=slandow BUILD_IN_CONTAINER=1 make docker.pilot

Then we can wrap that image in one that includes delve:

rinormaloku

kubectl --context=cluster1 create ns echo
kubectl --context=cluster1 label ns echo istio-injection=enabled
kubectl --context=cluster1 -n echo apply -f https://git.io/JyIRn
kubectl --context=cluster1 -n echo apply -f https://git.io/JyqPy

kubectl kubectl --context=mgmt apply -f - <<EOF
---
apiVersion: networking.enterprise.mesh.gloo.solo.io/v1beta1
kind: RateLimitServerConfig
metadata:

rinormaloku

apiVersion: v1
kind: Service
metadata:
  name: keycloak
  labels:
    app: keycloak
spec:
  ports:
  - name: http
    port: 8080

rinormaloku

apiVersion: v1
kind: Service
metadata:
  labels:
    app: echo-v2
  name: echo-v2
spec:
  ports:
  - name: http
    port: 8080

rinormaloku

apiVersion: v1
kind: Service
metadata:
  labels:
    app: echo-v1
  name: echo-v1
spec:
  ports:
  - name: http
    port: 8080

rinormaloku

# go and find a deeply nested key with the name accessLog
jq  '.. |."accessLog"? | select(. != null)'

rinormaloku

{
  "annotations": {
    "list": [
      {
        "builtIn": 1,
        "datasource": "-- Grafana --",
        "enable": true,
        "hide": true,
        "iconColor": "rgba(0, 211, 255, 1)",
        "name": "Annotations & Alerts",