NVIDIA: Switchyard
Switchyard is an open-source model routing system that switches between multiple models to optimize the cost of requests.
- Input / Output
- Priced after the answer
- Context
- 1M
- Max output
- —
- Published
- Sep 21, 2026
- Maker
- NVIDIA
Free plan prices, in Toman at today's rate. Plans and prices
Priced after the answer
This model is a router: for each request it chooses a model itself, and the cost of the model it chose, with your plan's margin, is charged once the answer is complete. Before the request the most it could cost is held on your wallet, and the rest is returned.
Capabilities
- Text
What it takes and gives
Accepts
- Text
Creates
- Text
Call it
Pass nvidia/switchyard as the model name, or let router/auto choose for you.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://ai.fluxcdn.cloud/api/v1",
api_key=os.environ["FLUXCDN_API_KEY"],
)
resp = client.chat.completions.create(
model="router/auto",
messages=[{"role": "user", "content": "Hello"}],
)
print(resp.choices[0].message.content)
