LLMs You Can Run on a Mac

Open-weight models with a published MLX or GGUF build that fits in 64GB of unified memory or less. Each model page shows the exact size per quantisation and the command to run it.

19 available on LLM API · 54 listed

Model

Released

Input / 1M

Output / 1M

Context

Qwen 3.5 9B

Mar 2, 2026

$0.1

$0.15

262.1K

Try it

Jina Embeddings v5 Text Small

Feb 19, 2026

$0.02

—

32.8K

Try it

Qwen3 VL 8B Instruct

Oct 15, 2025

$0.08

$0.5

131.1K

Try it

Qwen3 VL 30B A3B Instruct

Oct 4, 2025

$0.2

$0.7

131.1K

Try it

Qwen3 Next 80B A3B Instruct

Sep 10, 2025

$0.5

$2

131.1K

Try it

Qwen3 Next 80B A3B Thinking

Sep 10, 2025

$0.5

$6

131.1K

Try it

Qwen3 Coder Next

Aug 1, 2025

$0.108

$0.675

262.1K

Try it

Qwen3 30B A3B Instruct 2507

Jul 1, 2025

$0.1

$0.3

262K

Try it

Qwen3 30B A3B Thinking 2507

Jul 1, 2025

$0.1

$0.3

262K

Try it

Qwen3 Coder 30B A3B Instruct

Jul 1, 2025

$0.07

$0.27

262K

Try it

Jina Embeddings v4

Jun 25, 2025

$0.02

—

32.8K

Try it

Gemini 2.5 Pro

Mar 25, 2025

$1.25

$10

1M

Try it

Qwen Image

Mar 1, 2025

$0.035

$0.035

Try it

Qwen2.5 VL 32B Instruct

Jan 1, 2025

$1.4

$4.2

131.1K

Try it

Llama 3.3 70B Instruct

Dec 6, 2024

$0.13

$0.4

131.1K

Try it

Llama 3.1 70B Instruct

Jul 23, 2024

$0.72

$0.72

128K

Try it

Llama 3.1 8B Instruct

Jul 23, 2024

$0.22

$0.22

128K

Try it

GPT-3.5 Turbo

Nov 30, 2022

$0.5

$1.5

16.4K

Try it

Gemma 4 31B

Apr 2, 2026

$0.14

$0.4

262K

View model

Qwen2.5-VL-72B-Instruct

—

$0.25

$0.75

128K

Try it

Parakeet TDT 0.6B v3

—

Free

Free

4K

View model

FLUX.2 Klein 4B

—

Free

Free

1440px

View model

Olmo 3 32B Think

—

Free

Free

65,536

View model

Reka Edge

—

$0.1

$0.1

16K tokens

View model

LFM2-24B-A2B

—

Free

Free

~32K

View model

all-MiniLM-L6-v2

—

Free

Free

256

View model

Granite 4.0 Micro

—

$0.017

$0.112

131K tokens

View model

Qwen3.5-27B

—

$0.195

$1.56

262K tokens

View model

Qwen3.5-35B-A3B

—

$0.163

$1.3

262K tokens

View model

bge-m3

—

Free

Free

8K

View model

Whisper Large V3

—

Free

Free

View model

Qwen3 Embedding 8B

—

Free

Free

~8K

View model

Rnj 1 Instruct

—

$0.15

$0.15

32K

View model

Qwen3 Embedding 4B

—

Free

Free

~8K

View model

CSM 1B

—

Free

Free

~8K

View model

all-mpnet-base-v2

—

Free

Free

512

View model

Qwen3.6 27B

—

$0.3

$2

262K tokens

View model

Trinity Mini

—

$0.045

$0.150

131K

View model

Qwen3.6 35B A3B

—

$0.1

$0.9

262K tokens

View model

Voxtral Small 24B 2507

—

$0.1

$0.3

33K tokens

View model

E5-Base-v2

—

Free

Free

512

View model

Qwen3 VL 30B A3B Thinking

—

$0.2

$2.4

262K tokens

View model

Qwen3 VL 8B Thinking

—

$0.18

$2.1

131K tokens

View model

ERNIE 4.5 21B A3B Thinking

—

~$0.80

~$2.40

~32K

View model

Granite 4.1 8B

—

Free

Free

~128K

View model

bge-large-en-v1.5

—

Free

Free

512

View model

Qwen3 VL 32B Instruct

—

$0.104

$0.416

131K tokens

View model

bge-base-en-v1.5

—

Free

$0.00

512

View model

INTELLECT-3

—

~$0.80

~$2.40

~32K

View model

Cydonia 24B V4.1

—

$0.3

$0.5

131K tokens

View model

Kokoro 82M

—

Free

Free

~60s

View model

Whisper Large V3 Turbo

—

$0.006

$0.006

View model

Multilingual-E5-Large

—

Free

$0.00

~4K

View model

Phi 4 Mini Instruct

—

Free

Free

~128K

View model