Model specifications
- Context
- 131,072 tokens
- Maximum output
- 117,964 tokens
- Architecture
- text->text
- Tokenizer
- Llama3
- Knowledge cutoff
- 2023-12-31
- Moderated
- No
Complete pricing
Synchronized OpenRouter rates. Token prices are shown per one million tokens.
- Input
- $0.05 per 1M tokens
- Output
- $0.08 per 1M tokens
- Cache read
- $0.025 per 1M tokens
Quick start
Set OPENROUTER_API_KEY locally. Python requires requests; JavaScript runs in Node.js. Keep the key on the server.
curl --fail-with-body https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"meta-llama/llama-3.1-8b-instruct","messages":[{"role":"user","content":"Hello!"}]}'Input → Output
Supported API parameters
frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p5 providers
Checked: September 7, 2026
Provider availability, latency, throughput and routing can change continuously. Open the source page for current operational data.
DeepInfra
fp8- Context
- 131K
- Maximum output
- 16K
- Input
- $0.02
- Output
- $0.04
- Cache read
- Not provided
- Cache write
- Not provided
Novita
fp8- Context
- 16K
- Maximum output
- 15K
- Input
- $0.02
- Output
- $0.05
- Cache read
- Not provided
- Cache write
- Not provided
Groq
Not provided- Context
- 131K
- Maximum output
- 118K
- Input
- $0.05
- Output
- $0.08
- Cache read
- $0.025
- Cache write
- Not provided
Cloudflare
fp8- Context
- 32K
- Maximum output
- 29K
- Input
- $0.152
- Output
- $0.287
- Cache read
- Not provided
- Cache write
- Not provided
CoreWeave
bf16- Context
- 131K
- Maximum output
- 118K
- Input
- $0.22
- Output
- $0.22
- Cache read
- $0.22
- Cache write
- Not provided