MetaText generationReleased July 23, 2024

Llama 3.1 70B Instruct

Name: Llama 3.1 70B Instruct
Brand: Meta
SKU: llama-3.1-70b-instruct
Availability: InStock

Llama 3.1 70B Instruct costs $0.72 per 1M input tokens and $0.72 per 1M output tokens on LLM API, with a 128K-token context window.

Pricing

Served by AWS Bedrock, the only provider.

Llama 3.1 70B Instruct prices on LLM API
Input	$0.72	per 1M tokens
Output	$0.72	per 1M tokens

Features

ToolsYes
Parallel tool callsNo
Image inputNo
ReasoningNo
Prompt cachingNo
Structured outputsYes
JSON modeYes
StreamingYes
Web searchNo

Call Llama 3.1 70B Instruct

POST /v1/chat/completionsSet LLMAPI_KEY to your LLM API key.Chat Completions docs

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://api.llmapi.ai/v1",
    api_key=os.environ["LLMAPI_KEY"],
)

response = client.chat.completions.create(
    model="llama-3.1-70b-instruct",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.llmapi.ai/v1",
  apiKey: process.env.LLMAPI_KEY,
});

const response = await client.chat.completions.create({
  model: "llama-3.1-70b-instruct",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(response.choices[0].message.content);

curl https://api.llmapi.ai/v1/chat/completions \
  -H "Authorization: Bearer $LLMAPI_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-70b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

More from Meta

All Meta text models

Prices synced November 9, 2026.