AI-Assisted Software DevelopmentSep 2, 2026

NVIDIA opened a proxy that lets one application speak both the OpenAI and Anthropic APIs

Switchyard is an Apache-2.0 Rust proxy and library from NVIDIA's NeMo group. It decodes an incoming request into provider-neutral types, routes it (passthrough, random, an LLM classifier, or a staged router), and translates the response back into whichever API the caller used. The stated purpose is model selection, benchmarking and cost or performance tuning without rewriting the calling application.

What it means Changing model or provider is normally an application rewrite; a translating proxy turns it into a routing rule you can measure both sides of.

Where it came from NVIDIA

Back to the Stream