Will It Run AI
CalculatorModelsHardwareCompare
Product
  • Calculator
  • Compare
  • Tier List
Browse
  • Models
  • Hardware
  • Docs
About
  • Why It Works
  • What's New
  • Legal Notice
  • Privacy Policy

All estimates are approximations based on mathematical models and public specifications. Actual performance may vary. Do not make purchasing decisions based solely on these estimates.

Data sourced from Hugging Face, Ollama, and official model documentation. Model names and logos are trademarks of their respective owners.

© 2026 Will It Run AI — Fase Consulting Ibiza, S.L. (NIF: B57969656)

Home/Hardware/GPUs/RTX PRO 6000 Blackwell Server Edition 96GB
NVIDIA

NVIDIA

RTX PRO 6000 Blackwell Server Edition 96GB

RTX PRO BlackwellDatacenterBlackwellPCIe 5CUDA
96GB
VRAM
1.6kGB/s
Bandwidth
120TFLOPS
FP16 Compute
4kTOPS
INT8 Inference
VRAM96 GBBandwidth1.6k GB/sCompute120 TFInference4k TOPS
RTX PRO 6000 Blackwell Server Edition 96GBCategory AvgGaudi 3 128GB

Specifications

Compute
FP16120 TFLOPS
INT84000 TOPS
ArchitectureBlackwell
Memory
VRAM96 GB
Bandwidth1597 GB/s
General
FamilyRTX PRO Blackwell
SegmentDatacenter
InterconnectPCIe 5
Compute PlatformCUDA

Architecture

Blackwell

Blackwell is NVIDIA's fifth-generation RTX architecture, built on TSMC's 4NP process. It introduces 5th-generation Tensor Cores with native FP4 precision support, enabling double the inference throughput per watt compared to Ada Lovelace's FP8 operations. Key innovations include the Neural Rendering Pipeline for AI-driven shading and the debut of GDDR7 memory in consumer GPUs.

AI Relevance

FP4 Tensor Cores deliver the highest tokens-per-watt efficiency in any consumer architecture. Native FP4 quantization means models can run at lower precision with minimal quality loss, effectively doubling the effective VRAM for model weights.

Process: TSMC 4NPPlatform: CUDATensor Cores: Gen 5Precisions: FP32, FP16, BF16, FP8, FP4, INT8, INT4

Recommendations by Workload

Agentic Coding

B

Qwen3-Coder-Next

This model is still usable for agentic-coding, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 83.3 tok/s · 51K ctx · llama.cpp
60.2 GB / 96.0 GB VRAM

Chat

B

Qwen3-Coder-Next

This model is still usable for chat, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 83.3 tok/s · 13K ctx · llama.cpp
60.1 GB / 96.0 GB VRAM

Coding

B

Qwen3-Coder-Next

This model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 83.3 tok/s · 26K ctx · llama.cpp
60.1 GB / 96.0 GB VRAM

RAG

B

Qwen3-Coder-Next

This model is still usable for rag, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 83.3 tok/s · 51K ctx · llama.cpp
60.2 GB / 96.0 GB VRAM

Reasoning

B

Qwen3-Coder-Next

This model is a direct match for reasoning. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.

Decode 83.3 tok/s · 26K ctx · llama.cpp
60.1 GB / 96.0 GB VRAM

Full Model Compatibility

AlibabaQwen3-Coder-Next
B55
80B60.1 GB83 tok/s26K ctx
moe
AlibabaQwen 2.5 72B
C53
72B65.7 GB31 tok/s23K ctx
dense
AlibabaQwen 2.5 VL 72B
C53
72B65.7 GB31 tok/s23K ctx
dense
MetaLlama 3.3 70B
C53
70B64.1 GB31 tok/s24K ctx
dense
MistralMistral Small 4 119B
C53
119B84.1 GB54 tok/s18K ctx
moe
UnslothQwen3.5 122B A10B
C49
122B89.3 GB21 tok/s17K ctx
dense
UnslothQwen3.5 35B A3B
C49
35B37.3 GB63 tok/s41K ctx
dense
Lmstudio-communityLQwen3.5 35B A3B
C49
35B37.3 GB63 tok/s41K ctx
dense
CohereCommand A 111B
C49
111B95.6 GB20 tok/s16K ctx
dense
AlibabaQwen 2.5 Coder 32B
C49
32B35.0 GB69 tok/s44K ctx
dense
AlibabaQwen3-Coder 30B A3B Instruct
C49
30.5B29.9 GB187 tok/s51K ctx
moe
UnslothQwen3.5 27B
C49
27B31.2 GB81 tok/s49K ctx
dense
AlibabaQwen3-VL 30B A3B Instruct
C49
30B29.6 GB193 tok/s52K ctx
moe
Unslothgemma 3 27b it
C49
27B31.2 GB81 tok/s49K ctx
dense
MistralDevstral Small 2 24B Instruct
C49
24B28.9 GB92 tok/s53K ctx
dense
MistralDevstral Small 1.1
C49
24B28.9 GB92 tok/s53K ctx
dense
MistralCodestral 2 25.08
C48
22B27.4 GB100 tok/s56K ctx
dense
UnslothQwen3.5 9B
C46
9B17.4 GB244 tok/s88K ctx
dense
HauhauCSHQwen3.5 9B Uncensored HauhauCS Aggressive
C46
9B17.4 GB244 tok/s88K ctx
dense
Lmstudio-communityLQwen3.5 9B
C46
9B17.4 GB244 tok/s88K ctx
dense
BartowskiBMeta Llama 3.1 8B Instruct
C46
8B16.6 GB275 tok/s92K ctx
dense
XtunerXllava llama 3 8b v1 1
C46
8B16.6 GB275 tok/s92K ctx
dense
UnslothDeepSeek R1 0528 Qwen3 8B
C46
8B16.6 GB275 tok/s92K ctx
dense
MaziyarPanahiMMeta Llama 3 8B Instruct
C46
8B16.6 GB275 tok/s92K ctx
dense
TheBlokeTLlama 2 7B Chat
C46
7B15.9 GB314 tok/s97K ctx
dense
TheBlokeTMistral 7B Instruct v0.2
C46
7B15.9 GB314 tok/s97K ctx
dense
MaziyarPanahiMMistral 7B Instruct v0.3
C46
7B15.9 GB314 tok/s97K ctx
dense
UnslothQwen3.5 4B
C45
4B13.7 GB550 tok/s112K ctx
dense
BartowskiBLlama 3.2 3B Instruct
C45
3B13.5 GB634 tok/s114K ctx
dense
Lmstudio-communityLgemma 3 4b it
C45
4B13.7 GB550 tok/s112K ctx
dense
BartowskiBgemma 2 2b it
C45
2B12.9 GB859 tok/s119K ctx
dense
QwenQwen2.5 3B Instruct
C45
3B13.1 GB733 tok/s117K ctx
dense
Googlegemma 2b
C45
2B12.5 GB1100 tok/s123K ctx
dense
TheDrummerTGemmasutra Mini 2B v1
C45
2B12.5 GB1100 tok/s123K ctx
dense
QwenQwen2.5 1.5B Instruct
C45
1.5B12.2 GB1342 tok/s126K ctx
dense
Hugging-quantsHLlama 3.2 1B Instruct Q8 0
C45
1B12.1 GB1409 tok/s127K ctx
dense
TheBlokeTTinyLlama 1.1B Chat v1.0
C45
1.1B12.0 GB1342 tok/s128K ctx
dense
Ggml-orgGSmolVLM 500M Instruct
C45
0.5B11.7 GB1409 tok/s131K ctx
dense
Ggml-orgGembeddinggemma 300M
C45
0.3B11.5 GB1409 tok/s133K ctx
dense
MistralMixtral 8x22B
C40
141B102.6 GB28 tok/s15K ctx
moe
MistralDevstral 2 123B Instruct
D39
123B104.7 GB17 tok/s15K ctx
dense
DeepSeekDeepSeek R1 671B
F0
671B425.6 GB10 tok/s4K ctx
moe
Z.aiGLM-5
F0
744B470.6 GB9 tok/s4K ctx
moe
Moonshot AIKimi K2.5
F0
1000B625.5 GB7 tok/s4K ctx
moe
MistralMistral Large 3
F0
675B428.7 GB9 tok/s4K ctx
+1moe
AlibabaQwen3-Coder 480B A35B Instruct
F0
480B308.8 GB13 tok/s5K ctx
moe
DeepSeekDeepSeek V3 671B
F0
671B425.6 GB10 tok/s4K ctx
moe
AlibabaQwen 3 235B A22B
F0
235B157.3 GB25 tok/s10K ctx
moe
UnslothQwen3.5 397B A17B
F0
397B314.7 GB6 tok/s5K ctx
dense
MetaLlama 4 Maverick 17B 128E
F0
400B257.2 GB17 tok/s6K ctx
moe

Just out of reach

Models you could run with an upgrade

High-quality models that need a bit more memory

DeepSeekDeepSeek R1 671B
671BTier 5Needs ~431.4 GB
MistralDevstral 2 123B Instruct
123BTier 5Needs ~124.0 GB
Runs on Mac Studio M3 Ultra 256GB
Z.aiGLM-5
744BTier 5Needs ~476.8 GB
Moonshot AIKimi K2.5
1000BTier 5Needs ~630.5 GB
MistralMistral Large 3
675BTier 5Needs ~435.1 GB

Upgrade paths

Upgrade from RTX PRO 6000 Blackwell Server Edition 96GB

See what you unlock with more powerful hardware

Upgrade options

Upgrade options

IntelGaudi 3 128GBNext step up
128 GB VRAM (+32)3700 GB/s (+2103)
A
Unlocks Devstral 2 123B Instruct, Pixtral Large 124B+92% faster avg

 

NVIDIANVIDIA H200 PCIe 141GBNVIDIA upgrade
141 GB VRAM (+45)4800 GB/s (+3203)
A
Unlocks Devstral 2 123B Instruct, Qwen 3 235B A22B, Pixtral Large 124B+2 more · +196% faster avg

~$30,000 MSRP

AMDAMD Instinct MI325X 256GBBiggest leap
256 GB VRAM (+160)6000 GB/s (+4403)
A
Unlocks Devstral 2 123B Instruct, Qwen 3 235B A22B, Llama 4 Maverick 17B 128E+6 more · +218% faster avg

 

AMDAMD Instinct MI350X 288GBBest value
288 GB VRAM (+192)8000 GB/s (+6403)
A
Unlocks Devstral 2 123B Instruct, Qwen3-Coder 480B A35B Instruct, Qwen 3 235B A22B+7 more · +322% faster avg

~$8,000 MSRP

Compare this GPU