Alibaba

Qwen 3 32B

Name: Qwen 3 32B
Author: Alibaba

Frontier

HuggingFace

Ollama

5.2MDownloads669LikesApr 2025Released131K tokensContextApache 2.0License4 EntryQuality

Get started

— copy & paste to run locally

Ollama

ollama run qwen-3-32b

HuggingFace

huggingface-cli download qwen-3-32b

Quick specs

Parameters32B

Architecturedense

Context131K tokens

Modalitytext

Min RAM12.5 GB

Rec. RAM19.5 GB (Q4_K_M)

LicenseApache 2.0

FamilyQwen

✓ Chat✓ Reasoning

About this model

Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models. Built upon extensive training, Qwen3 delivers groundbreaking advancements in reasoning, instruction-following, agent capabilities, and multilingual support, with the following key features:

•Uniquely support of seamless switching between thinking mode: (for complex logical reasoning, math, and coding) and non-thinking mode (for...
•Significantly enhancement in its reasoning capabilities: , surpassing previous QwQ (in thinking mode) and Qwen2.5 instruct models (in non-thinking...
•Superior human preference alignment: , excelling in creative writing, role-playing, multi-turn dialogues, and instruction following, to deliver a...
•Expertise in agent capabilities: , enabling precise integration with external tools in both thinking and unthinking modes and achieving leading...
•Support of 100+ languages and dialects: with strong capabilities for multilingual instruction following and translation

Related models

Quick picks

Best budgetC

Mac mini M4 64GB~$1,099 — 4 tok/s

Best overallB

NVIDIA A100 40GB~$10,000 — 67 tok/s

Best hardware

Top picks for Qwen 3 32B

NVIDIA A100 40GBB

40 GB

RTX PRO 5000 Blackwell 48GBC

Mac Studio M2 Ultra 64GBC

64 GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	12.5 GB	Low	—
Q3_K_S	3	15.7 GB	Low	—
NVFP4	4	17.9 GB	Medium	—
Q4_K_M	4	19.5 GB	Medium	—
Q5_K_M	5	23.0 GB	High	—
Q6_K	6	26.2 GB	High	—
Q8_0	8	34.2 GB	Very High	—
F16	16	65.6 GB	Maximum	—

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: NVIDIA A10 24GB

Weights19.5 GB

KV Cache5.0 GB

Runtime0.9 GB

Headroom2.4 GB

Quant

Bits

VRAM

Quality

Fit

Q2_K

12.5 GB

Low

—

Q3_K_S

15.7 GB

Low

—

NVFP4

17.9 GB

Medium

—

Q4_K_M

19.5 GB

Medium

—

Q5_K_M

23.0 GB

High

—

Q6_K

26.2 GB

High

—

Q8_0

34.2 GB

Very High

—

F16

65.6 GB

Maximum

—