Meta: Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.
- Input
- 259,616 Toman/M tokens
- Output
- 259,616 Toman/M tokens
- Context
- 131K
- Max output
- 8K
- Published
- Jul 23, 2024
- Maker
- Meta
Free plan prices, in Toman at today's rate. Plans and prices
Price by plan
Toman per million tokens at today's rate. A plan lowers the price of your usage up to a limit each period.
| Plan | Input | Output |
|---|---|---|
| Free | 259,616 | 259,616 |
| Pro | 248,976 | 248,976 |
| Max | 238,336 | 238,336 |
Capabilities
- Text
- Tools
What it takes and gives
Accepts
- Text
Creates
- Text
Call it
Pass meta-llama/llama-3.1-70b-instruct as the model name, or let router/auto choose for you.
import os
from openai import OpenAI
client = OpenAI(
base_url="https://ai.fluxcdn.cloud/api/v1",
api_key=os.environ["FLUXCDN_API_KEY"],
)
resp = client.chat.completions.create(
model="router/auto",
messages=[{"role": "user", "content": "Hello"}],
)
print(resp.choices[0].message.content)
