Will It Run AI
CalculatorModelsHardwareCompare
Product
  • Calculator
  • Compare
  • Tier List
Browse
  • Models
  • Hardware
  • Docs
About
  • Why It Works
  • What's New
  • Legal Notice
  • Privacy Policy

All estimates are approximations based on mathematical models and public specifications. Actual performance may vary. Do not make purchasing decisions based solely on these estimates.

Data sourced from Hugging Face, Ollama, and official model documentation. Model names and logos are trademarks of their respective owners.

© 2026 Will It Run AI — Fase Consulting Ibiza, S.L. (NIF: B57969656)

Home/Hardware/GPUs/H100 NVL 188GB
NVIDIA

NVIDIA

H100 NVL 188GB

Data CenterHopperNVLINKCUDA
188GB
VRAM
7.8kGB/s
Bandwidth
2kTFLOPS
FP16 Compute
4kTOPS
INT8 Inference
VRAM188 GBBandwidth7.8k GB/sCompute2k TFInference4k TOPS
H100 NVL 188GBCategory AvgAMD Instinct MI325X 256GB

Specifications

Compute
FP161979 TFLOPS
INT83958 TOPS
ArchitectureHopper
Memory
VRAM188 GB
Bandwidth7800 GB/s
General
FamilyData Center
SegmentData Center
InterconnectNVLINK
Compute PlatformCUDA

Architecture

Hopper

Hopper is NVIDIA's datacenter-focused architecture succeeding Ampere. Built on TSMC 4N, it introduces the Transformer Engine with automatic FP8/FP16 mixed-precision training, HBM3/HBM3e memory, and NVLink 4.0 for multi-GPU scaling. The H100 flagship delivers up to 3x the AI training performance of A100.

AI Relevance

The Transformer Engine automatically manages FP8 precision for optimal training speed without accuracy loss. With up to 141 GB HBM3e (H200), Hopper GPUs can hold the largest open-weight models entirely in GPU memory, making them the workhorse of AI datacenters.

Process: TSMC 4NPlatform: CUDATensor Cores: Gen 4Precisions: FP64, FP32, TF32, FP16, BF16, FP8, INT8

Recommendations by Workload

Agentic Coding

B

Devstral 2 123B Instruct

This model is still usable for agentic-coding, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.

Decode 84.2 tok/s · 45K ctx · llama.cpp
133.2 GB / 188.0 GB VRAM

Chat

C

Mistral Small 4 119B

This model is a direct match for chat. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.

Decode 253.2 tok/s · 16K ctx · llama.cpp
93.1 GB / 188.0 GB VRAM

Coding

C

Devstral 2 123B Instruct

This model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.

Decode 84.2 tok/s · 26K ctx · llama.cpp
113.9 GB / 188.0 GB VRAM

RAG

B

Command A 111B

This model is a direct match for rag. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 93.3 tok/s · 49K ctx · llama.cpp
122.1 GB / 188.0 GB VRAM

Reasoning

C

Devstral 2 123B Instruct

This model is a direct match for reasoning. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.

Decode 84.2 tok/s · 26K ctx · llama.cpp
113.9 GB / 188.0 GB VRAM

Full Model Compatibility

MistralDevstral 2 123B Instruct
C55
123B113.9 GB84 tok/s26K ctx
dense
MistralMixtral 8x22B
C55
141B111.8 GB141 tok/s27K ctx
moe
AlibabaQwen 3 235B A22B
C54
235B166.5 GB118 tok/s18K ctx
moe
CohereCommand A 111B
C54
111B104.8 GB93 tok/s29K ctx
dense
UnslothQwen3.5 122B A10B
C53
122B98.5 GB98 tok/s31K ctx
dense
MistralMistral Small 4 119B
C53
119B93.3 GB253 tok/s32K ctx
moe
AlibabaQwen 2.5 72B
C51
72B74.9 GB144 tok/s40K ctx
dense
AlibabaQwen 2.5 VL 72B
C51
72B74.9 GB144 tok/s33K ctx
dense
MetaLlama 3.3 70B
C51
70B73.3 GB148 tok/s41K ctx
dense
AlibabaQwen3-Coder-Next
C50
80B69.3 GB392 tok/s43K ctx
moe
UnslothQwen3.5 35B A3B
C48
35B46.5 GB296 tok/s65K ctx
dense
Lmstudio-communityLQwen3.5 35B A3B
C47
35B46.5 GB296 tok/s65K ctx
dense
AlibabaQwen 2.5 Coder 32B
C47
32B44.2 GB324 tok/s68K ctx
dense
UnslothQwen3.5 27B
C47
27B40.4 GB384 tok/s74K ctx
dense
Unslothgemma 3 27b it
C47
27B40.4 GB384 tok/s74K ctx
dense
AlibabaQwen3-Coder 30B A3B Instruct
C47
30.5B39.1 GB879 tok/s77K ctx
moe
AlibabaQwen3-VL 30B A3B Instruct
C47
30B38.8 GB909 tok/s78K ctx
moe
MistralDevstral Small 2 24B Instruct
C47
24B38.1 GB432 tok/s79K ctx
dense
MistralDevstral Small 1.1
C46
24B38.1 GB432 tok/s79K ctx
dense
MistralCodestral 2 25.08
C46
22B36.6 GB471 tok/s82K ctx
dense
UnslothQwen3.5 9B
C45
9B26.6 GB1151 tok/s113K ctx
dense
HauhauCSHQwen3.5 9B Uncensored HauhauCS Aggressive
C45
9B26.6 GB1151 tok/s113K ctx
dense
BartowskiBMeta Llama 3.1 8B Instruct
C45
8B25.8 GB1295 tok/s116K ctx
dense
Lmstudio-communityLQwen3.5 9B
C45
9B26.6 GB1151 tok/s113K ctx
dense
XtunerXllava llama 3 8b v1 1
C45
8B25.8 GB1295 tok/s116K ctx
dense
UnslothDeepSeek R1 0528 Qwen3 8B
C45
8B25.8 GB1295 tok/s116K ctx
dense
TheBlokeTLlama 2 7B Chat
C45
7B25.1 GB1480 tok/s120K ctx
dense
MaziyarPanahiMMeta Llama 3 8B Instruct
C45
8B25.8 GB1295 tok/s116K ctx
dense
TheBlokeTMistral 7B Instruct v0.2
C45
7B25.1 GB1480 tok/s120K ctx
dense
MaziyarPanahiMMistral 7B Instruct v0.3
C45
7B25.1 GB1480 tok/s120K ctx
dense
UnslothQwen3.5 4B
C45
4B22.9 GB2589 tok/s131K ctx
dense
BartowskiBLlama 3.2 3B Instruct
C45
3B22.7 GB2984 tok/s133K ctx
dense
BartowskiBgemma 2 2b it
C45
2B22.1 GB4045 tok/s136K ctx
dense
Googlegemma 2b
C45
2B21.7 GB5179 tok/s138K ctx
dense
Lmstudio-communityLgemma 3 4b it
C45
4B22.9 GB2589 tok/s131K ctx
dense
QwenQwen2.5 3B Instruct
C45
3B22.3 GB3453 tok/s135K ctx
dense
Hugging-quantsHLlama 3.2 1B Instruct Q8 0
C45
1B21.3 GB6634 tok/s141K ctx
dense
QwenQwen2.5 1.5B Instruct
C45
1.5B21.4 GB6318 tok/s140K ctx
dense
TheDrummerTGemmasutra Mini 2B v1
C45
2B21.7 GB5179 tok/s138K ctx
dense
TheBlokeTTinyLlama 1.1B Chat v1.0
C45
1.1B21.2 GB6318 tok/s142K ctx
dense
Ggml-orgGSmolVLM 500M Instruct
C45
0.5B20.9 GB6634 tok/s144K ctx
dense
Ggml-orgGembeddinggemma 300M
C44
0.3B20.7 GB6634 tok/s145K ctx
dense
DeepSeekDeepSeek R1 671B
F0
671B434.8 GB45 tok/s7K ctx
moe
Z.aiGLM-5
F0
744B479.8 GB41 tok/s6K ctx
moe
Moonshot AIKimi K2.5
F0
1000B634.7 GB32 tok/s5K ctx
moe
MistralMistral Large 3
F0
675B437.9 GB44 tok/s7K ctx
+1moe
AlibabaQwen3-Coder 480B A35B Instruct
F0
480B318.0 GB60 tok/s9K ctx
moe
DeepSeekDeepSeek V3 671B
F0
671B434.8 GB45 tok/s7K ctx
moe
UnslothQwen3.5 397B A17B
F0
397B323.9 GB26 tok/s9K ctx
dense
MetaLlama 4 Maverick 17B 128E
F0
400B266.4 GB78 tok/s11K ctx
moe

Just out of reach

Models you could run with an upgrade

High-quality models that need a bit more memory

DeepSeekDeepSeek R1 671B
671BTier 5Needs ~440.6 GB
Z.aiGLM-5
744BTier 5Needs ~486.0 GB
Moonshot AIKimi K2.5
1000BTier 5Needs ~639.7 GB
MistralMistral Large 3
675BTier 5Needs ~444.3 GB
AlibabaQwen3-Coder 480B A35B Instruct
480BTier 5Needs ~323.4 GB

Upgrade paths

Upgrade from H100 NVL 188GB

See what you unlock with more powerful hardware

Upgrade options

Upgrade options

AMDAMD Instinct MI325X 256GBNext step up
256 GB VRAM (+68)
A
Unlocks Llama 4 Maverick 17B 128E, K EXAONE 236B A23B, Baichuan M3 235B+1 more

 

AMDAMD Instinct MI350X 288GBBest value
288 GB VRAM (+100)8000 GB/s (+200)
A
Unlocks Qwen3-Coder 480B A35B Instruct, Llama 4 Maverick 17B 128E, K EXAONE 236B A23B+2 more

~$8,000 MSRP

Compare this GPU