AI Gateway
Centralized routing by agent name or alias across JSON-RPC, HTTP+JSON, and SSE streams. Handles agent card rewriting, caching, W3C trace context propagation, and graceful draining.
Sign in
Route AI requests, observe agent activity, and understand every interaction through one unified gateway.
Explore KyuremA2A Gateway & Observability Platform
A unified layer to route, monitor, and understand AI agent interactions across your infrastructure.
Built in Go to transparently proxy A2A v1.0 traffic over JSON-RPC, HTTP+JSON, and SSE streaming so tracing, trust, and resilience stay out of individual agent code.
Stateless request streaming paired with a bounded OpenTelemetry export queue ensures spans drop under extreme load before upstream traffic is ever delayed.
Dedicated listeners separate the A2A data path (:8080), operations
endpoints (:8081), and bearer-authenticated management API
(:8082).
Core Capabilities
Centralized routing by agent name or alias across JSON-RPC, HTTP+JSON, and SSE streams. Handles agent card rewriting, caching, W3C trace context propagation, and graceful draining.
Monitor requests, OpenTelemetry handoff spans, task traces, latency, and upstream errors through a bounded OTLP queue backed by in-memory ring or ClickHouse storage.
Visualize caller-to-upstream relationships and hop topologies across distributed tasks so multi-agent handoffs remain traceable end to end.
Track input and output token usage and calculate request costs across tasks and spans. When upstream providers omit usage, cost remains explicitly unknown rather than masked as zero.
Authenticate callers via bearer tokens or mTLS, verify agent card signatures against operator-configured keys, enforce deny-overrides rules, and inspect bounded audit records.
Protect upstream agents with bounded retry budgets, same-binding failover on
502/503/504 idempotent calls, and per-upstream
circuit breakers that trip after consecutive failures.
Management Dashboard
Kyurem’s React dashboard connects to the dedicated management API to turn raw OTLP handoff traces into diagnosable task timelines.
gen_ai.* / kyurem.* attributes
kyurem.retry and kyurem.failover span events surfaced per hop
Architecture
Agents point at the gateway without SDK rewrites while telemetry and control planes run out of band.
Router and resilience layers emit one OpenTelemetry handoff span into a bounded async queue.
Traces export via OTLP to an OpenTelemetry Collector backed by ClickHouse or an in-memory ring.
Prometheus scrapes :8081/metrics while the dashboard queries the :8082 management API.
Developer Experience
Configure Kyurem with a single strict YAML file validated at startup—unknown keys are
rejected early and scalar fields can be overridden with KYUREM_*
environment variables.
kyurem validate
api/openapi.yaml for the management API
# Validate configuration strictly before serving
go run ./gateway/cmd/kyurem validate --config config/kyurem.example.yaml
# Build and run the Go demo walkthrough
make build build-demo
make run-demo
# Failover walkthrough with Python agents + dashboard
make python-install dashboard-install
make demo-m6
Bring visibility and control to your AI infrastructure with Kyurem.
Explore Kyurem on GitHub