Llama 3.1 8B Instruct

Name: Meta: Llama 3.1 8B Instruct
Brand: meta-llama
SKU: meta-llama/llama-3.1-8b-instruct
Price: 0.022 USD
Availability: InStock

meta-llama/llama-3.1-8b-instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors.

$0.022 in · $0.044 out per 1M tokens131k contextJul 23, 2024

less than 1/100 of a cent a message

A typical message: about 500 tokens you send and 500 it writes.

Chat with Llama 3.1 8B Instruct

Call it from code Lock this price

Spec sheet

Published facts from the catalog, billed prices and what we measured here. Anything not measured says so.

Price, billed here

Input, per 1M tokens: $0.022provider $0.02
Output, per 1M tokens: $0.044provider $0.04
Margin: +10%

Context and formats

Context window: 131,072 tokens
Longest answer: 16,384 tokens
Reads: text
Makes: text
First listed: 2024-07-23

Measured here, last 7 days

First token, median: not measured
Answered without error: not measured

Tools and JSON

Tool calling: declaredthe provider's claim, not yet measured here
JSON output: declaredthe provider's claim, not yet measured here

Price and latency history as JSON: GET /api/planet/history?id=meta-llama/llama-3.1-8b-instruct.

About

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

In Meta's words.

Try it here

Cmd+Enter sends

The answer appears here.

Measured here

We could not load the measurements. Try again.

Call it

Use one OpenAI compatible endpoint, this model's id and an am_live_ key from the dashboard. You can also try it in chat first with no key.

curl https://useantimatter.com/v1/chat/completions \
  -H "Authorization: Bearer $ANTIMATTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "meta-llama/llama-3.1-8b-instruct", "messages": [{"role": "user", "content": "Hello"}]}'

Everything else is in the docs.

Embed this

A badge showing this model's live price per million tokens, as billed here, for a README or a site. It links back to this page.

Llama 3.1 8B Instruct price on Antimatter

<a href="https://useantimatter.com/planet/meta-llama/llama-3.1-8b-instruct"><img src="https://useantimatter.com/api/badge/price?id=meta-llama%2Fllama-3.1-8b-instruct" alt="Llama 3.1 8B Instruct price on Antimatter" height="28"></a>

Similar models from other labs

Closest in price and memory, from other labs.

Go back to the map, or take this model into a chat.