meta-llama logo
meta-llama

Meta: Llama 3.1 8B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. $0.02 per million input tokens, $0.04 per million output tokens. 131,072 token context window, maximum output of 16,384 tokens. Higher uptime with 5 providers. Includes independent benchmarks from Artificial Analysis.

Overview

Model specifications

Context
131,072 tokens
Maximum output
117,964 tokens
Architecture
text->text
Tokenizer
Llama3
Knowledge cutoff
2023-12-31
Moderated
No
OPENROUTER

Complete pricing

Synchronized OpenRouter rates. Token prices are shown per one million tokens.

Input
$0.02
/M tokens
Output
$0.04
/M tokens
API

Quick start

Call this exact model ID through OpenRouter’s OpenAI-compatible API.

curl https://openrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $OPENROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"meta-llama/llama-3.1-8b-instruct","messages":[{"role":"user","content":"Hello!"}]}'
Capabilities

InputOutput

Input
text
Output
text
API

Supported API parameters

frequency_penaltylogit_biaslogprobsmax_tokensmin_ppresence_penaltyrepetition_penaltyresponse_formatseedstopstructured_outputstemperaturetool_choicetoolstop_ktop_logprobstop_p
Available providers

5 providers

Live providers on OpenRouter

Provider availability, latency, throughput and routing can change continuously. Open the source page for current operational data.

OpenRouter

DeepInfra

fp8
Context
131K
Maximum output
16K
Input
$0.020
Output
$0.040
Cache read
Not provided
Cache write
Not provided

Novita

fp8
Context
16K
Maximum output
15K
Input
$0.020
Output
$0.050
Cache read
Not provided
Cache write
Not provided

Groq

unknown
Context
131K
Maximum output
118K
Input
$0.050
Output
$0.080
Cache read
$0.025
Cache write
Not provided

Cloudflare

fp8
Context
32K
Maximum output
29K
Input
$0.152
Output
$0.287
Cache read
Not provided
Cache write
Not provided

CoreWeave

bf16
Context
131K
Maximum output
118K
Input
$0.220
Output
$0.220
Cache read
$0.220
Cache write
Not provided
meta-llama

models

All models