Question 1

Can RTX PRO 6000 Blackwell Server Edition 96GB run DeepSeek R1 0528 Qwen3 8B?

Accepted Answer

Yes, RTX PRO 6000 Blackwell Server Edition 96GB can run DeepSeek R1 0528 Qwen3 8B with a C grade (Runs well). Expected decode speed: 235.6 tok/s.

Question 2

How much VRAM does DeepSeek R1 0528 Qwen3 8B need?

Accepted Answer

DeepSeek R1 0528 Qwen3 8B (8B parameters) requires approximately 16.9 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for DeepSeek R1 0528 Qwen3 8B?

Accepted Answer

The recommended quantization for DeepSeek R1 0528 Qwen3 8B is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	C	Runs well	274.9 tok/s	1024 ms	169K
Chat	C	Runs well	274.9 tok/s	384 ms	47K
Coding	C	Runs well	235.6 tok/s	822 ms	91K
RAG	C	Runs well	274.9 tok/s	1280 ms	169K
Reasoning	C	Runs well	274.9 tok/s	832 ms	91K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	3.1 GB	Low	D30
Q3_K_S	3	3.9 GB	Low	D30
NVFP4	4

Can RTX PRO 6000 Blackwell Server Edition 96GB run DeepSeek R1 0528 Qwen3 8B?

Memory breakdown