Question 1

Can NVIDIA A30 24GB run GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Accepted Answer

Yes, NVIDIA A30 24GB can run GGUF SOLARized GraniStral 14B 1902 YeAM HCT with a C grade (Runs well). Expected decode speed: 78.7 tok/s.

Question 2

How much VRAM does GGUF SOLARized GraniStral 14B 1902 YeAM HCT need?

Accepted Answer

GGUF SOLARized GraniStral 14B 1902 YeAM HCT (14B parameters) requires approximately 14.3 GB of memory with Q4_K_M quantization.

Question 3

What is the best quantization for GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Accepted Answer

The recommended quantization for GGUF SOLARized GraniStral 14B 1902 YeAM HCT is Q4_K_M, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	B	Runs well	85.2 tok/s	3305 ms	47K
Chat	C	Runs well	85.2 tok/s	1239 ms	15K
Coding	C	Runs well	78.7 tok/s	2461 ms	27K
RAG	B	Runs well	85.2 tok/s	4131 ms	47K
Reasoning	C	Runs well	85.2 tok/s	2685 ms	27K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	5.5 GB	Low	D34
Q3_K_S	3	6.9 GB	Low	D35
NVFP4	4

Can NVIDIA A30 24GB run GGUF SOLARized GraniStral 14B 1902 YeAM HCT?

Memory breakdown