illimarnb

Onboarding: Cortex Agent Evaluation Framework

This guide walks you through the eval framework using Cortex Code CLI skills. Each step uses natural language commands — Cortex Code handles the scripts and configuration for you.

---

Prerequisites

1. Cortex Code CLI installed (installation guide)
2. Git access to this repository (EDH/EDH)

illimarnb

Cortex Agent Evaluation Framework - Tutorial

The Loop

Deploy → Evaluate → Analyze → Fix → Repeat

---

illimarnb

Cortex Agent Skills Tutorial

Audience: Engineers working on the Wholesale Open Orders Cortex Agent
Duration: ~45 minutes
Prerequisites: Cortex Code CLI installed, Snowflake connection configured ()

---

Agenda

illimarnb

End-to-End Framework Test Plan

Comprehensive testing plan for the Cortex Agent Evaluation Framework using Cortex Code CLI.

---

Prerequisites Checklist

Before starting, verify you have:

illimarnb

Cortex Agent Evaluation & Improvement Framework

Architecture Overview

flowchart TB
    subgraph CORE["Agent Development Loop"]
        direction LR
        D["Deploy"] --> E["Evaluate"] --> A["Analyze"] --> F["Fix"]
 F --> D

illimarnb

Cortex Agent Evaluation & Improvement Framework

Architecture Overview

flowchart TB
    subgraph CORE["Agent Development Loop"]
        direction LR
        D["Deploy"] --> E["Evaluate"] --> A["Analyze"] --> F["Fix"]
 F --> D