Meta: Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.
- Input
- 10,248 Toman/M tokens
- Output
- 17,080 Toman/M tokens
- Context
- 131K
- Max output
- 16K
- Published
- Jul 23, 2024
- Maker
- Meta
Free plan prices, in Toman at today's rate. Plans and prices
Price by plan
Toman per million tokens at today's rate. A plan lowers the price of your usage up to a limit each period.
| Plan | Input | Output |
|---|---|---|
| Free | 10,248 | 17,080 |
| Pro | 9,828 | 16,380 |
| Max | 9,408 | 15,680 |
Capabilities
- Text
- Tools
- JSON
What it takes and gives
Accepts
- Text
Creates
- Text
Call it
Pass meta-llama/llama-3.1-8b-instruct as the model name, or let router/auto choose for you.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://ai.fluxcdn.cloud/api/v1",
api_key=os.environ["FLUXCDN_API_KEY"],
)
resp = client.chat.completions.create(
model="router/auto",
messages=[{"role": "user", "content": "Hello"}],
)
print(resp.choices[0].message.content)
