Question 1

Can RTX 5090 32GB run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Accepted Answer

Yes, RTX 5090 32GB can run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 with a B grade (Runs well). Expected decode speed: 82.0 tok/s.

Question 2

How much VRAM does Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 need?

Accepted Answer

Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 (24B parameters) requires approximately 22.8 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Accepted Answer

The recommended quantization for Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1 is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	C	Tight fit	82.0 tok/s	3434 ms	39K
Chat	B	Runs well	82.0 tok/s	1288 ms	12K
Coding	B	Runs well	82.0 tok/s	2361 ms	22K
RAG	C	Tight fit	82.0 tok/s	4292 ms	39K
Reasoning	B	Runs well	82.0 tok/s	2790 ms	22K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	9.4 GB	Low	D35
Q3_K_S	3	11.8 GB	Low	D37
NVFP4	4

Can RTX 5090 32GB run Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1?

Memory breakdown

Performance by workload

Quantization options

Get started