Will It Run AI
CalculatorModelsHardwareCompare
Product
  • Calculator
  • Compare
  • Tier List
Browse
  • Models
  • Hardware
  • Docs
About
  • Why It Works
  • What's New
  • Legal Notice
  • Privacy Policy

All estimates are approximations based on mathematical models and public specifications. Actual performance may vary. Do not make purchasing decisions based solely on these estimates.

Data sourced from Hugging Face, Ollama, and official model documentation. Model names and logos are trademarks of their respective owners.

© 2026 Will It Run AI — Fase Consulting Ibiza, S.L. (NIF: B57969656)

Home/Models/LLaVA 1.6 13B

LLaVALLaVA

LLaVA 1.6 13B

Current
huggingfaceHuggingFace
11.1KDownloads245LikesJan 2024Released4K tokensContextApache 2.0License4 EntryQuality

Get started

— copy & paste to run locally
Ollama
ollama run llava-1.6-13b
HuggingFace
huggingface-cli download llava-1.6-13b

Quick specs

Parameters13B
Architecturedense
Context4K tokens
Modalitytext+vision
Min RAM5.1 GB
Rec. RAM7.9 GB (Q4_K_M)
LicenseApache 2.0
FamilyLLaVA
✓ Chat

About this model

Model type: LLaVA is an open-source chatbot trained by fine-tuning LLM on multimodal instruction-following data. It is an auto-regressive language model, based on the transformer architecture. Base LLM: mistralai/Mistral-7B-Instruct-v0.2

  • •558K filtered image-text pairs from LAION/CC/SBU, captioned by BLIP
  • •158K GPT-generated multimodal instruction-following data
  • •500K academic-task-oriented VQA data mixture
  • •50K GPT-4V data mixture
  • •40K ShareGPT data

Related models

Your hardware

Detecting...

Quick picks

AMD
Best budgetC
RX 7600 XT 16GB~$329 — 21 tok/s
NVIDIA
Best overallB
RTX 5080 16GB~$999 — 79 tok/s

Best hardware

Top picks for LLaVA 1.6 13B

NVIDIA
RTX 5080 Laptop 16GBB
16 GB
NVIDIA
RTX 5080 16GBB
16 GB
NVIDIA
RTX 4080 Super 16GBB
16 GB
NVIDIA
RTX 5070 Ti 16GBB
16 GB
NVIDIA
RTX 4070 Ti Super 16GBB
16 GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
5.1 GB
Low—
Q3_K_S
3
6.4 GB
Low—
NVFP4
4
7.3 GB
Medium—
Q4_K_M
4
7.9 GB
Medium—
Q5_K_M
5
9.4 GB
High—
Q6_K
6
10.7 GB
High—
Q8_0
8
13.9 GB
Very High—
F16
16
26.7 GB
Maximum—

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: NVIDIA A10 24GB

Weights7.9 GB
KV Cache2.0 GB
Runtime0.9 GB
Headroom2.4 GB