AMD
Architecture
CDNA 3 powers the Instinct MI300X (GPU-only, 192 GB HBM3) and MI300A (APU with integrated CPU). It features advanced packaging with up to 12 chiplets and native FP8 support for AI inference.
AI Relevance
The MI300X with 192 GB HBM3 can hold even the largest open-weight models (70B+ at full precision) entirely in GPU memory. FP8 support and mature ROCm stack make it a serious competitor to NVIDIA H100 for AI inference.
Agentic Coding
BThis model is still usable for agentic-coding, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Chat
BThis model is a direct match for chat. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Coding
CThis model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.
RAG
BThis model is still usable for rag, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Reasoning
BThis model is a direct match for reasoning. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Mistral Small 4 119B
Qwen3.5 122B A10B
Command A 111BMixtral 8x22B
Qwen 2.5 72BQwen 2.5 VL 72B
Llama 3.3 70BQwen3-Coder-NextDevstral 2 123B InstructQwen3.5 35B A3BQwen 2.5 Coder 32BQwen3.5 27Bgemma 3 27b itQwen3-Coder 30B A3B InstructQwen3-VL 30B A3B InstructDevstral Small 2 24B InstructDevstral Small 1.1Codestral 2 25.08Qwen3.5 9BDeepSeek R1 0528 Qwen3 8BQwen3.5 4BQwen2.5 3B Instruct
gemma 2bQwen2.5 1.5B Instruct
DeepSeek R1 671B
GLM-5
Kimi K2.5Mistral Large 3Qwen3-Coder 480B A35B InstructDeepSeek V3 671BQwen 3 235B A22BQwen3.5 397B A17BLlama 4 Maverick 17B 128EJust out of reach
High-quality models that need a bit more memory
Upgrade paths
See what you unlock with more powerful hardware
Upgrade options
NVIDIA H200 141GBNext step up~$30,000 MSRP
B100 192GBBiggest leap
~$8,000 MSRP
