MetaText generationReleased July 23, 2024

Llama 3.1 8B Instruct

Name: Llama 3.1 8B Instruct
Brand: Meta
SKU: llama-3.1-8b-instruct
Availability: InStock

Llama 3.1 8B Instruct costs $0.02 per 1M input tokens and $0.05 per 1M output tokens on LLM API, with a 128K-token context window.

Pricing

Lowest price among 2 providers, after discounts.

Llama 3.1 8B Instruct prices on LLM API
Input	$0.02	per 1M tokens
Output	$0.05	per 1M tokens

Providers

Prices after each provider’s discount; the lowest in bold.

Sort

Providers of Llama 3.1 8B Instruct on LLM API

AWS Bedrock	$0.22	$0.22	128K	4K
Novita AI	$0.02	$0.05	128K	4K

Features

“Some providers”: not every provider of this model supports it.

ToolsYes
Parallel tool callsNo
Image inputNo
ReasoningNo
Prompt cachingNo
Structured outputsSome providers
JSON modeYes
StreamingYes
Web searchNo

Call Llama 3.1 8B Instruct

POST /v1/chat/completionsSet LLMAPI_KEY to your LLM API key.Chat Completions docs

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://api.llmapi.ai/v1",
    api_key=os.environ["LLMAPI_KEY"],
)

response = client.chat.completions.create(
    model="llama-3.1-8b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.llmapi.ai/v1",
  apiKey: process.env.LLMAPI_KEY,
});

const response = await client.chat.completions.create({
  model: "llama-3.1-8b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(response.choices[0].message.content);

curl https://api.llmapi.ai/v1/chat/completions \
  -H "Authorization: Bearer $LLMAPI_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-8b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

More from Meta

All Meta text models

Prices synced November 9, 2026.