meta-llama logo
meta-llama

Meta: Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. $0.40 per million input tokens, $0.40 per million output tokens. 131,072 token context window, maximum output of 16,384 tokens. Higher uptime with 3 providers. Includes independent benchmarks from Artificial Analysis.

Overview

Model specifications

Context
131,072 tokens
Maximum output
16,384 tokens
Architecture
text->text
Tokenizer
Llama3
Knowledge cutoff
2023-12-31
Moderated
No
OPENROUTER

Complete pricing

Synchronized OpenRouter rates. Token prices are shown per one million tokens.

Input
$0.4
/M tokens
Output
$0.4
/M tokens
API

Quick start

Call this exact model ID through OpenRouter’s OpenAI-compatible API.

curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta-llama/llama-3.1-70b-instruct","messages":[{"role":"user","content":"Hello!"}]}'
Capabilities

InputOutput

Input
text
Output
text
API

Supported API parameters

frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p
Available providers

3 providers

Live providers on OpenRouter

Provider availability, latency, throughput and routing can change continuously. Open the source page for current operational data.

OpenRouter

DeepInfra

fp8
Context
131K
Maximum output
16K
Input
$0.400
Output
$0.400
Cache read
Not provided
Cache write
Not provided

Amazon Bedrock

unknown
Context
131K
Maximum output
8K
Input
$0.720
Output
$0.720
Cache read
Not provided
Cache write
Not provided

CoreWeave

bf16
Context
131K
Maximum output
118K
Input
$0.800
Output
$0.800
Cache read
$0.800
Cache write
Not provided
meta-llama

models

All models