Intel
Architecture
Gaudi is Intel's purpose-built AI training and inference accelerator (acquired from Habana Labs). Gaudi 3 features 128 GB HBM2e and a dedicated Matrix Math Engine designed specifically for transformer workloads.
AI Relevance
Purpose-built for AI with integrated networking (24x 200GbE) for multi-node scaling. Gaudi 3 targets direct competition with NVIDIA H100 for transformer training and inference, with competitive TCO claims.
Agentic Coding
BThis model is still usable for agentic-coding, but it is not the most specialized pick. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Chat
BThis model is a direct match for chat. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Coding
CThis model is a direct match for coding. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.
RAG
CThis model is a direct match for rag. It sits in the middle of the current model mix. It fits natively with comfortable headroom. Known channels: huggingface, ollama, lm-studio.
Reasoning
BThis model is a direct match for reasoning. It belongs to a current frontier family for local AI. It fits natively with comfortable headroom. Known channels: huggingface, lm-studio.
Mistral Small 4 119B
Qwen3.5 122B A10B
Command A 111B
Qwen3-Coder-NextMixtral 8x22BQwen 2.5 72BQwen 2.5 VL 72B
Llama 3.3 70BDevstral 2 123B InstructQwen3.5 35B A3BQwen 2.5 Coder 32BQwen3.5 27Bgemma 3 27b itQwen3-Coder 30B A3B InstructQwen3-VL 30B A3B InstructDevstral Small 2 24B InstructDevstral Small 1.1Codestral 2 25.08Qwen3.5 9BDeepSeek R1 0528 Qwen3 8BQwen3.5 4BQwen2.5 3B Instruct
gemma 2bQwen2.5 1.5B Instruct
DeepSeek R1 671B
GLM-5
Kimi K2.5Mistral Large 3Qwen3-Coder 480B A35B InstructDeepSeek V3 671BQwen 3 235B A22BQwen3.5 397B A17BLlama 4 Maverick 17B 128EJust out of reach
High-quality models that need a bit more memory
Upgrade paths
See what you unlock with more powerful hardware
Upgrade options
NVIDIA H200 141GBNext step up~$30,000 MSRP
~$8,000 MSRP
