Skip to content

Instantly share code, notes, and snippets.

View rvennam's full-sized avatar

Ram Vennam rvennam

View GitHub Profile
@rvennam
rvennam / 034-production-observability-and-scaling.md
Last active March 13, 2026 03:51
Enterprise AgentGateway: Production Observability, Alerting, and Scaling Guide

Production Observability, Alerting, and Scaling Guide

This lab provides a complete production-readiness guide for Enterprise AgentGateway: a metrics reference for every component, recommended Prometheus alerting rules, horizontal pod autoscaling configuration, graceful shutdown for long-lived AI connections, pod spreading, and disruption budgets.

Pre-requisites

This lab assumes that you have completed the setup in 001 and 002.

Lab Objectives

  • Understand every metric exposed by the data plane, control plane, and rate limiter
  • Deploy production-grade Prometheus alerting rules
@rvennam
rvennam / 001-set-up-oss-agentgateway.md
Created March 12, 2026 16:48
OSS Agentgateway Workshop - Install, OpenAI Routing, and MCP Connectivity

Install Agentgateway (Open Source)

In this workshop, you'll deploy the open-source Agentgateway and complete hands-on labs that showcase routing, observability, and Gen AI features.

Pre-requisites

  • Kubernetes > 1.30
  • Kubernetes Gateway API
  • helm package manager installed

Lab Objectives

@rvennam
rvennam / 033-remote-a2a-hostname.md
Created March 12, 2026 00:53
AgentGateway: Route to Remote A2A Agent by Hostname

Route to a Remote A2A Agent by Hostname

Pre-requisites

This lab assumes that you have completed the setup in 001 and 002

Lab Objectives

  • Route to a remote A2A agent by hostname (not IP address) through AgentGateway
  • Preserve full A2A protocol detection, including "protocol":"a2a" and a2a.method in access logs
  • Handle port and path differences on the remote agent
  • Validate A2A connectivity and observability through the gateway
@rvennam
rvennam / external-redis-global-rate-limiting.md
Last active March 11, 2026 21:21
Enterprise AgentGateway: Global Rate Limiting with External (BYO) Redis

Global Rate Limiting with External Redis

Lab Objectives

  • Deploy an external Redis instance separate from the built-in ext-cache
  • Configure the Enterprise AgentGateway rate limiter to use the external Redis via a deployment overlay
  • Apply global rate limiting to LLM routes using RateLimitConfig and EnterpriseAgentgatewayPolicy
  • Verify rate limit counters are stored in the external Redis

Overview

Configure Route to Remote A2A Agent

Pre-requisites

This lab assumes that you have completed the setup in 001 and 002

Lab Objectives

  • Deploy a mock A2A agent and expose it as a remote service
  • Route to the remote A2A agent through AgentGateway
  • Validate A2A connectivity through the gateway
  • Observe A2A traffic in access logs

Solo Enterprise for Agentgateway - Feature List

A comprehensive list of functional features available in Solo Enterprise for Agentgateway, categorized by LLM and MCP capabilities.


LLM Features

Multi-Provider Routing

  • Route to OpenAI
@rvennam
rvennam / issue1-config-dump-relevant.json
Created February 23, 2026 18:20
Issue: Multiple AgentgatewayPolicies targeting same backend - relevant policies only
{
"policies": [
{
"key": "backend/enterprise-agentgateway/aliases-policy:ai:enterprise-agentgateway/openai",
"name": {
"kind": "AgentgatewayPolicy",
"name": "aliases-policy",
"namespace": "enterprise-agentgateway"
},
"target": {
@rvennam
rvennam / issue1-config-dump.json
Created February 23, 2026 18:20
Issue: Multiple AgentgatewayPolicies targeting same backend - full config dump
{
"workloads": [
{
"workloadIps": [
"10.20.0.28"
],
"protocol": "TCP",
"networkMode": "Standard",
"uid": "//Pod/agentcore/agentcore-a2a-proxy-546cfdb7f9-t2tzf",
"name": "agentcore-a2a-proxy-546cfdb7f9-t2tzf",
@rvennam
rvennam / issue-140-config-dump-relevant.json
Created February 23, 2026 17:26
Issue #140 config dump (jwt-test relevant sections only)
{
"policies": [
{
"key": "traffic/jwt-test/jwt-transform:jwt:jwt-test/jwt-route",
"name": {
"kind": "AgentgatewayPolicy",
"name": "jwt-transform",
"namespace": "jwt-test"
},
"target": {
@rvennam
rvennam / issue-140-config-dump.json
Created February 23, 2026 17:26
Issue #140 config dump - JWT claims not available in transformation CEL
{
"workloads": [
{
"workloadIps": [
"10.20.0.28"
],
"protocol": "TCP",
"networkMode": "Standard",
"uid": "//Pod/agentcore/agentcore-a2a-proxy-546cfdb7f9-t2tzf",
"name": "agentcore-a2a-proxy-546cfdb7f9-t2tzf",