Skip to content
FluxCDNFluxCDN
esc

Meta: Llama 3.1 8B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

Input
10,248 Toman/M tokens
Output
17,080 Toman/M tokens
Context
131K
Max output
16K
Published
Jul 23, 2024
Maker
Meta

Free plan prices, in Toman at today's rate. Plans and prices

Price by plan

Toman per million tokens at today's rate. A plan lowers the price of your usage up to a limit each period.

PlanInputOutput
Free10,24817,080
Pro9,82816,380
Max9,40815,680

Capabilities

  • Text
  • Tools
  • JSON

What it takes and gives

Accepts
  • Text
Creates
  • Text

Call it

Pass meta-llama/llama-3.1-8b-instruct as the model name, or let router/auto choose for you.

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://ai.fluxcdn.cloud/api/v1",
    api_key=os.environ["FLUXCDN_API_KEY"],
)

resp = client.chat.completions.create(
    model="router/auto",
    messages=[{"role": "user", "content": "Hello"}],
)

print(resp.choices[0].message.content)