Hardware profile
NVIDIA GeForce RTX 3060 · 12 GB
12 GB VRAM · 360 GB/s · verified 2026-11-01
Platform Windows
Available for models 12 GB
Backends Ollama, llama.cpp, CUDA
Memory bandwidth 360 GB/s
Last verified
The 12 GB card is a capacity-first option. System RAM is not included in this profile; keep the host memory requirement in mind when using CPU offload.
Model fit
| Model | Recommended quantization | Estimated requirement | Result |
|---|---|---|---|
| gpt-oss-20b | MXFP4 | 13.8 GB at 8K | Won't fit |
| Qwen3.6 35B-A3B | MXFP4 | 24.3 GB at 8K | Won't fit |
| Qwen3.8 27B | Q4_K_M | 19.4 GB at 8K | Won't fit |
| Gemma 4 12B Unified | Q4_0 | 9.1 GB at 8K | Comfortable fit |
| Gemma 4 E4B | Q4_K_M | 7.7 GB at 8K | Comfortable fit |
| Gemma 4 31B | Q4_K_M | 22.2 GB at 8K | Won't fit |
| gpt-oss-120b | MXFP4 | 65.2 GB at 8K | Won't fit |
| DeepSeek V4.1 Flash | UD-IQ1_M | 233.8 GB at 8K | Won't fit |
| Llama 3.2 3B | Q4_K_M | 4.4 GB at 8K | Comfortable fit |
| Qwen3 8B | Q4_K_M | 7.9 GB at 8K | Comfortable fit |
| Gemma 3 4B | Q4_K_M | 6.0 GB at 8K | Comfortable fit |
| Phi-4 Mini | Q4_K_M | 5.1 GB at 8K | Comfortable fit |
| Mistral 7B | Q4_K_M | 7.0 GB at 8K | Comfortable fit |
| DeepSeek R1 8B | Q4_K_M | 7.5 GB at 8K | Comfortable fit |
Source
https://www.nvidia.com/en-us/geforce/graphics-cards/30-series/rtx-3060-3060ti/