Skip to content
FluxCDNFluxCDN
esc

NVIDIA: Switchyard

Switchyard is an open-source model routing system that switches between multiple models to optimize the cost of requests.

Input / Output
Priced after the answer
Context
1M
Max output
—
Published
Sep 21, 2026
Maker
NVIDIA

Free plan prices, in Toman at today's rate. Plans and prices

Priced after the answer

This model is a router: for each request it chooses a model itself, and the cost of the model it chose, with your plan's margin, is charged once the answer is complete. Before the request the most it could cost is held on your wallet, and the rest is returned.

Capabilities

  • Text

What it takes and gives

Accepts
  • Text
Creates
  • Text

Call it

Pass nvidia/switchyard as the model name, or let router/auto choose for you.

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://ai.fluxcdn.cloud/api/v1",
    api_key=os.environ["FLUXCDN_API_KEY"],
)

resp = client.chat.completions.create(
    model="router/auto",
    messages=[{"role": "user", "content": "Hello"}],
)

print(resp.choices[0].message.content)