Question 1

Can GTX 1650 4GB run BGE M3?

Accepted Answer

Yes, GTX 1650 4GB can run BGE M3 with a B grade (Runs well). Expected decode speed: 92.2 tok/s.

Question 2

How much VRAM does BGE M3 need?

Accepted Answer

BGE M3 (0.5680000185966492B parameters) requires approximately 2.7 GB of memory with F16 quantization.

Question 3

What is the best quantization for BGE M3?

Accepted Answer

The recommended quantization for BGE M3 is F16, which balances quality and memory efficiency.

Workload	Grade	Fit	Decode	TTFT	Context
Agentic Coding	B	Runs well	64.0 tok/s	4400 ms	8K
Chat	B	Runs well	64.0 tok/s	1650 ms	8K
Coding	B	Runs well	92.2 tok/s	2101 ms	8K
RAG	B	Runs well	64.0 tok/s	5500 ms	8K
Reasoning	B	Runs well	64.0 tok/s	3575 ms	8K

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	0.2 GB	Low	D30
Q3_K_S	3	0.3 GB	Low	D31
NVFP4	4

Can GTX 1650 4GB run BGE M3?

Memory breakdown