Skip to content
FluxCDNFluxCDN
esc

Meta: Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

Input
259,616 Toman/M tokens
Output
259,616 Toman/M tokens
Context
131K
Max output
8K
Published
Jul 23, 2024
Maker
Meta

Free plan prices, in Toman at today's rate. Plans and prices

Price by plan

Toman per million tokens at today's rate. A plan lowers the price of your usage up to a limit each period.

PlanInputOutput
Free259,616259,616
Pro248,976248,976
Max238,336238,336

Capabilities

  • Text
  • Tools

What it takes and gives

Accepts
  • Text
Creates
  • Text

Call it

Pass meta-llama/llama-3.1-70b-instruct as the model name, or let router/auto choose for you.

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://ai.fluxcdn.cloud/api/v1",
    api_key=os.environ["FLUXCDN_API_KEY"],
)

resp = client.chat.completions.create(
    model="router/auto",
    messages=[{"role": "user", "content": "Hello"}],
)

print(resp.choices[0].message.content)