Question 1

Can RTX PRO 4500 Blackwell 32GB run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Accepted Answer

Yes, RTX PRO 4500 Blackwell 32GB can run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 with a C grade (Runs well). Expected decode speed: 44.1 tok/s.

Question 2

How much VRAM does Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 need?

Accepted Answer

Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 (24B parameters) requires approximately 22.8 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Accepted Answer

The recommended quantization for Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	C	Tight fit	51.4 tok/s	5478 ms	39K
Chat	C	Runs well	44.1 tok/s	2396 ms	12K
Coding	C	Runs well	44.1 tok/s	4393 ms	22K
RAG	C	Tight fit	44.1 tok/s	7988 ms	39K
Reasoning	C	Runs well	51.4 tok/s	4451 ms	22K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	9.4 GB	Low	D35
Q3_K_S	3	11.8 GB	Low	D37
NVFP4	4

Can RTX PRO 4500 Blackwell 32GB run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Memory breakdown

Performance by workload

Quantization options

Get started