Model specifications
- Context
- 131,072 tokens
- Maximum output
- 117,964 tokens
- Architecture
- text->text
- Tokenizer
- Llama3
- Knowledge cutoff
- 2023-12-31
- Moderated
- No
Complete pricing
Synchronized OpenRouter rates. Token prices are shown per one million tokens.
- Input
- $0.02 /M tokens
- Output
- $0.04 /M tokens
Quick start
Call this exact model ID through OpenRouter’s OpenAI-compatible API.
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"meta-llama/llama-3.1-8b-instruct","messages":[{"role":"user","content":"Hello!"}]}'Input → Output
Supported API parameters
frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p5 providers
Provider availability, latency, throughput and routing can change continuously. Open the source page for current operational data.
DeepInfra
fp8- Context
- 131K
- Maximum output
- 16K
- Input
- $0.020
- Output
- $0.040
- Cache read
- Not provided
- Cache write
- Not provided
Novita
fp8- Context
- 16K
- Maximum output
- 15K
- Input
- $0.020
- Output
- $0.050
- Cache read
- Not provided
- Cache write
- Not provided
Groq
unknown- Context
- 131K
- Maximum output
- 118K
- Input
- $0.050
- Output
- $0.080
- Cache read
- $0.025
- Cache write
- Not provided
Cloudflare
fp8- Context
- 32K
- Maximum output
- 29K
- Input
- $0.152
- Output
- $0.287
- Cache read
- Not provided
- Cache write
- Not provided
CoreWeave
bf16- Context
- 131K
- Maximum output
- 118K
- Input
- $0.220
- Output
- $0.220
- Cache read
- $0.220
- Cache write
- Not provided