Will It Run AI
CalculatorModelsHardwareCompare
Product
  • Calculator
  • Compare
  • Tier List
Browse
  • Models
  • Hardware
  • Docs
About
  • Why It Works
  • What's New
  • Legal Notice
  • Privacy Policy

All estimates are approximations based on mathematical models and public specifications. Actual performance may vary. Do not make purchasing decisions based solely on these estimates.

Data sourced from Hugging Face, Ollama, and official model documentation. Model names and logos are trademarks of their respective owners.

© 2026 Will It Run AI — Fase Consulting Ibiza, S.L. (NIF: B57969656)

Home/Models/Mistral Small 24B

MistralMistral

Mistral Small 24B

Legacy
huggingfaceHuggingFaceollamaOllama
120.3KDownloads948LikesJan 2025Released33K tokensContextMistral ResearchLicense4 EntryQuality

Get started

— copy & paste to run locally
Ollama
ollama run mistral-small-24b
HuggingFace
huggingface-cli download mistral-small-24b

Quick specs

Parameters24B
Architecturedense
Context33K tokens
Modalitytext
Min RAM9.4 GB
Rec. RAM14.6 GB (Q4_K_M)
LicenseMistral Research
FamilyMistral Small
✓ Code✓ Chat

About this model

Mistral Small 3 ( 2501 ) sets a new benchmark in the "small" Large Language Models category below 70B, boasting 24B parameters and achieving state-of-the-art capabilities comparable to larger models! This model is an instruction-fine-tuned version of the base model: Mistral-Small-24B-Base-2501.

  • •Multilingual:: Supports dozens of languages, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch,...
  • •Agent-Centric:: Offers best-in-class agentic capabilities with native function calling and JSON outputting
  • •Advanced Reasoning:: State-of-the-art conversational and reasoning capabilities
  • •Apache 2.0 License:: Open license allowing usage and modification for both commercial and non-commercial purposes
  • •Context Window:: A 32k context window

Related models

Your hardware

Detecting...

Quick picks

AMD
Best budgetC
RX 7900 XTX 24GB~$999 — 47 tok/s
NVIDIA
Best overallB
RTX 5090 32GB~$1,999 — 82 tok/s

Best hardware

Top picks for Mistral Small 24B

NVIDIA
RTX 5090 32GBB
32 GB
AMD
AMD Instinct MI100 32GBB
32 GB
NVIDIA
RTX PRO 4500 Blackwell 32GBC
32 GB
NVIDIA
NVIDIA A100 40GBC
40 GB
NVIDIA
NVIDIA V100 32GBC
32 GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
9.4 GB
Low—
Q3_K_S
3
11.8 GB
Low—
NVFP4
4
13.4 GB
Medium—
Q4_K_M
4
14.6 GB
Medium—
Q5_K_M
5
17.3 GB
High—
Q6_K
6
19.7 GB
High—
Q8_0
8
25.7 GB
Very High—
F16
16
49.2 GB
Maximum—

Quality benchmarks

Mistral Small 24B benchmark scores

Benchmark verified

Coding

SWE-bench Verified—
HumanEval+84.8%
Aider Polyglot—
LiveCodeBench—

Reasoning

MMLU-Pro66.3%
GPQA Diamond—
MATH-50070.6%
ARC Challenge—

General

Chatbot Arena—
IFEval82.9%

Source: official · 2025-01-28

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: NVIDIA A10 24GB

Weights14.6 GB
KV Cache3.8 GB
Runtime0.9 GB
Headroom2.4 GB