Model specifications
- Context
- 131,072 tokens
- Maximum output
- 16,384 tokens
- Architecture
- text->text
- Tokenizer
- Llama3
- Knowledge cutoff
- 2023-12-31
- Moderated
- No
Complete pricing
Synchronized OpenRouter rates. Token prices are shown per one million tokens.
- Input
- $0.4 /M tokens
- Output
- $0.4 /M tokens
Quick start
Call this exact model ID through OpenRouter’s OpenAI-compatible API.
curl https://openrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $OPENROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"meta-llama/llama-3.1-70b-instruct","messages":[{"role":"user","content":"Hello!"}]}'Input → Output
Supported API parameters
frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p3 providers
Provider availability, latency, throughput and routing can change continuously. Open the source page for current operational data.
DeepInfra
fp8- Context
- 131K
- Maximum output
- 16K
- Input
- $0.400
- Output
- $0.400
- Cache read
- Not provided
- Cache write
- Not provided
Amazon Bedrock
unknown- Context
- 131K
- Maximum output
- 8K
- Input
- $0.720
- Output
- $0.720
- Cache read
- Not provided
- Cache write
- Not provided
CoreWeave
bf16- Context
- 131K
- Maximum output
- 118K
- Input
- $0.800
- Output
- $0.800
- Cache read
- $0.800
- Cache write
- Not provided