Hardware profile
NVIDIA GeForce RTX 5080 · 16 GB
16 GB VRAM · 960 GB/s · verified 2026-11-01
Platform Windows
Available for models 16 GB
Backends Ollama, llama.cpp, CUDA
Memory bandwidth 960 GB/s
Last verified
A high-bandwidth 16 GB card. It can improve generation speed for models that already fit, but it does not change the 16 GB capacity ceiling.
Model fit
| Model | Recommended quantization | Estimated requirement | Result |
|---|---|---|---|
| gpt-oss-20b | MXFP4 | 13.8 GB at 8K | Tight fit |
| Qwen3.6 35B-A3B | MXFP4 | 24.3 GB at 8K | Won't fit |
| Qwen3.8 27B | Q4_K_M | 19.4 GB at 8K | Won't fit |
| Gemma 4 12B Unified | Q4_0 | 9.1 GB at 8K | Comfortable fit |
| Gemma 4 E4B | Q4_K_M | 7.7 GB at 8K | Comfortable fit |
| Gemma 4 31B | Q4_K_M | 22.2 GB at 8K | Won't fit |
| gpt-oss-120b | MXFP4 | 65.2 GB at 8K | Won't fit |
| DeepSeek V4.1 Flash | UD-IQ1_M | 233.8 GB at 8K | Won't fit |
| Llama 3.2 3B | Q4_K_M | 4.4 GB at 8K | Comfortable fit |
| Qwen3 8B | Q4_K_M | 7.9 GB at 8K | Comfortable fit |
| Gemma 3 4B | Q4_K_M | 6.0 GB at 8K | Comfortable fit |
| Phi-4 Mini | Q4_K_M | 5.1 GB at 8K | Comfortable fit |
| Mistral 7B | Q4_K_M | 7.0 GB at 8K | Comfortable fit |
| DeepSeek R1 8B | Q4_K_M | 7.5 GB at 8K | Comfortable fit |
Source
https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5080/
Specific model checks
No curated can-i-run page is published for this hardware profile yet.