Will It Run AI
CalculatorModelsHardwareCompare
Product
  • Calculator
  • Compare
  • Tier List
Browse
  • Models
  • Hardware
  • Docs
About
  • Why It Works
  • What's New
  • Legal Notice
  • Privacy Policy

All estimates are approximations based on mathematical models and public specifications. Actual performance may vary. Do not make purchasing decisions based solely on these estimates.

Data sourced from Hugging Face, Ollama, and official model documentation. Model names and logos are trademarks of their respective owners.

© 2026 Will It Run AI — Fase Consulting Ibiza, S.L. (NIF: B57969656)

Home/Models/Granite Code 20B

IBMIBM

Granite Code 20B

Current
huggingfaceHuggingFaceollamaOllama
1.3KDownloads42LikesMay 2024Released8K tokensContextApache 2.0License4 EntryQuality

Get started

— copy & paste to run locally
Ollama
ollama run granite-code-20b
HuggingFace
huggingface-cli download granite-code-20b

Quick specs

Parameters20B
Architecturedense
Context8K tokens
Modalitytext
Min RAM7.8 GB
Rec. RAM12.2 GB (Q4_K_M)
LicenseApache 2.0
FamilyGranite

About this model

Granite-20B-Code-Instruct-8K is a 20B parameter model fine tuned from *Granite-20B-Code-Base-8K* on a combination of permissively licensed instruction data to enhance instruction following capabilities including logical reasoning and problem-solving skills.

  • •Developers:: IBM Research
  • •GitHub Repository:: ibm-granite/granite-code-models
  • •Paper:: Granite Code Models: A Family of Open Foundation Models for Code Intelligence
  • •Release Date: May 6th, 2024
  • •License:: Apache 2.0

Related models

Your hardware

Detecting...

Quick picks

Apple
Best budgetC
MacBook Pro M4 32GB~$799 — 7 tok/s
NVIDIA
Best overallB
RTX 4090 24GB~$1,599 — 63 tok/s

Best hardware

Top picks for Granite Code 20B

NVIDIA
RTX 4090 24GBB
24 GB
NVIDIA
RTX 5090 Laptop 24GBB
24 GB
NVIDIA
NVIDIA A30 24GBB
24 GB
NVIDIA
RTX 3090 Ti 24GBB
24 GB
AMD
RX 7900 XTX 24GBB
24 GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
7.8 GB
Low—
Q3_K_S
3
9.8 GB
Low—
NVFP4
4
11.2 GB
Medium—
Q4_K_M
4
12.2 GB
Medium—
Q5_K_M
5
14.4 GB
High—
Q6_K
6
16.4 GB
High—
Q8_0
8
21.4 GB
Very High—
F16
16
41.0 GB
Maximum—

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: NVIDIA A10 24GB

Weights12.2 GB
KV Cache3.1 GB
Runtime0.9 GB
Headroom2.4 GB