realvz
/ EAIG Grafana Dashboard.json
Created
October 8, 2025 18:05
This dashboard visualizes metrics for the Envoy AI Gateway (EAIG), providing insights into model usage, latency, and traffic patterns. It relies on Prometheus as its data source and is designed for environments where EAIG proxies requests to foundation models such as Anthropic Claude and OpenAI GPT. The dashboard displays token usage, latency, a…
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "annotations": { | |
| "list": [ | |
| { | |
| "builtIn": 1, | |
| "datasource": { | |
| "type": "grafana", | |
| "uid": "-- Grafana --" | |
| }, | |
| "enable": true, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import boto3 | |
| us_east_1_ami_id = 'ami-dea4d5a1' | |
| us_west_2_ami_id = 'ami-73a6e20b' | |
| worker_nodes_cfn_template_url = 'https://amazon-eks.s3-us-west-2.amazonaws.com/1.10.3/2018-06-05/amazon-eks-nodegroup.yaml' | |
| key_pair_name = 'YOUR_KEY_NAME_HERE' | |
| eks = boto3.client('eks') | |
| cloudformation = boto3.client('cloudformation') |