Question 1

Can RX 7900 XT 20GB run GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV?

Accepted Answer

Yes, RX 7900 XT 20GB can run GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV with a B grade (Runs well). Expected decode speed: 67.4 tok/s.

Question 2

How much VRAM does GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV need?

Accepted Answer

GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV (14B parameters) requires approximately 13.9 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV?

Accepted Answer

The recommended quantization for GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	C	Runs well	56.2 tok/s	5010 ms	40K
Chat	C	Runs well	56.2 tok/s	1879 ms	12K
Coding	B	Runs well	67.4 tok/s	2870 ms	23K
RAG	C	Runs well	56.2 tok/s	6263 ms	40K
Reasoning	C	Runs well	56.2 tok/s	4071 ms	23K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	5.5 GB	Low	D35
Q3_K_S	3	6.9 GB	Low	D36
NVFP4	4

Can RX 7900 XT 20GB run GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV?

Memory breakdown