Hardware profile
Mac mini M2 · 24 GB
24 GB unified memory · 100 GB/s · verified 2026-11-01
Platform macOS
Available for models 24 GB
Backends Ollama, llama.cpp, MLX
Memory bandwidth 100 GB/s
Last verified
The extra unified memory helps with larger quantized models, but M2 memory bandwidth remains the speed ceiling for token generation.
Model fit
| Model | Recommended quantization | Estimated requirement | Result |
|---|---|---|---|
| gpt-oss-20b | MXFP4 | 13.8 GB at 8K | Comfortable fit |
| Qwen3.6 35B-A3B | MXFP4 | 24.3 GB at 8K | Won't fit |
| Qwen3.8 27B | Q4_K_M | 19.4 GB at 8K | Comfortable fit |
| Gemma 4 12B Unified | Q4_0 | 9.1 GB at 8K | Comfortable fit |
| Gemma 4 E4B | Q4_K_M | 7.7 GB at 8K | Comfortable fit |
| Gemma 4 31B | Q4_K_M | 22.2 GB at 8K | Tight fit |
| gpt-oss-120b | MXFP4 | 65.2 GB at 8K | Won't fit |
| DeepSeek V4.1 Flash | UD-IQ1_M | 233.8 GB at 8K | Won't fit |
| Llama 3.2 3B | Q4_K_M | 4.4 GB at 8K | Comfortable fit |
| Qwen3 8B | Q4_K_M | 7.9 GB at 8K | Comfortable fit |
| Gemma 3 4B | Q4_K_M | 6.0 GB at 8K | Comfortable fit |
| Phi-4 Mini | Q4_K_M | 5.1 GB at 8K | Comfortable fit |
| Mistral 7B | Q4_K_M | 7.0 GB at 8K | Comfortable fit |
| DeepSeek R1 8B | Q4_K_M | 7.5 GB at 8K | Comfortable fit |
Source
Specific model checks
No curated can-i-run page is published for this hardware profile yet.