Question 1

Can RTX 4090 24GB run GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Accepted Answer

Yes, RTX 4090 24GB can run GGUF SOLARized GraniStral 14B 1902 YeAM HCT with a C grade (Runs well). Expected decode speed: 85.0 tok/s.

Question 2

How much VRAM does GGUF SOLARized GraniStral 14B 1902 YeAM HCT need?

Accepted Answer

GGUF SOLARized GraniStral 14B 1902 YeAM HCT (14B parameters) requires approximately 14.3 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Accepted Answer

The recommended quantization for GGUF SOLARized GraniStral 14B 1902 YeAM HCT is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	B	Runs well	85.0 tok/s	3314 ms	47K
Chat	C	Runs well	85.0 tok/s	1243 ms	15K
Coding	C	Runs well	85.0 tok/s	2278 ms	27K
RAG	B	Runs well	85.0 tok/s	4142 ms	47K
Reasoning	C	Runs well	85.0 tok/s	2692 ms	27K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	5.5 GB	Low	D34
Q3_K_S	3	6.9 GB	Low	D35
NVFP4	4

Can RTX 4090 24GB run GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Memory breakdown