Which LLMs can your computer run?
Choose your hardware. Compare which models fit in memory, which need CPU offload and their estimated speed.
What does each model feel like on this machine?
Each point is one model on My Current PC (i7-11700K · 64GB · RTX 3080 Ti). Whiskers show the estimated speed range.
11,4 GiB usable accelerator memory · 64 GiB system RAM (assumed host; use Build a system to customize)
Include results that use the CPU and system RAM.
23 models fit entirely in accelerator memory and meet your 30 tok/s target across the estimated range.
Every model in the catalog
58 plotted · 20 without a comparable estimate
| Model | Memory needed | Estimated speed | Fit on this system |
|---|---|---|---|
| 8,9 GiB | Unavailable · not comparable | Context exceeds native limitRequested context exceeds Llama 2 7B's native context (4,096 tokens); this estimate is excluded from comparison. | |
| 3,8 GiB | 120–220 tok/s | Fits · target met | |
| 6,7 GiB | 67–120 tok/s | Fits · target met | |
| 45,3 GiB | 0.57–1 tok/s | Runs with RAM offload | |
| 244,8 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 67 GiB | 4.6–8.2 tok/s | Runs with RAM offload | |
| 238,8 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 22,4 GiB | 1.7–3 tok/s | Runs with RAM offload | |
| 46,6 GiB | 0.55–0.97 tok/s | Runs with RAM offload | |
| 7 GiB | 65–110 tok/s | Fits · target met | |
| 11 GiB | 39–70 tok/s | Fits · target met | |
| 22,4 GiB | 1.7–3 tok/s | Runs with RAM offload | |
| 19,8 GiB | 25–45 tok/s | Runs with RAM offload | |
| 141,3 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 19,8 GiB | 25–45 tok/s | Runs with RAM offload | |
| 286,5 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 49,2 GiB | 21–36 tok/s | Runs with RAM offload | |
| 45,3 GiB | 0.57–1 tok/s | Runs with RAM offload | |
| 22,4 GiB | 1.7–3 tok/s | Runs with RAM offload | |
| 397,7 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 14,7 GiB | 31–56 tok/s | Runs with RAM offloadRequested Q4_K_M; estimate uses MXFP4 (native). This is not an exact quantization match. | |
| 65,2 GiB | 9.9–17 tok/s | Runs with RAM offloadRequested Q4_K_M; estimate uses MXFP4 (native). This is not an exact quantization match. | |
| 4,1 GiB | 120–210 tok/s | Fits · target met | |
| 9,3 GiB | 46–81 tok/s | Fits · target met | |
| 18,5 GiB | 2.5–4.5 tok/s | Runs with RAM offload | |
| 16,4 GiB | 3.6–6.3 tok/s | Runs with RAM offload | |
| 16,4 GiB | 3.6–6.3 tok/s | Runs with RAM offload | |
| 29,4 GiB | 3.9–6.9 tok/s | Runs with RAM offload | |
| 65,1 GiB | 5–8.8 tok/s | Runs with RAM offload | |
| 213,6 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 592 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 11,2 GiB | 38–67 tok/s | Fits · target met | |
| 138,9 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 18,3 GiB | 2.7–4.8 tok/s | Runs with RAM offload | |
| 22,6 GiB | 36–63 tok/s | Runs with RAM offload | |
| 398,8 GiB | Unavailable · not comparable | Does not fitRequested Q4_K_M; estimate uses FP8. This is not an exact quantization match. Performance data is unavailable; this model is excluded from comparison. | |
| 125,9 GiB | Unavailable · not comparable | Does not fitRequested Q4_K_M; estimate uses FP8. This is not an exact quantization match. Performance data is unavailable; this model is excluded from comparison. | |
| 32 GiB | 0.95–1.7 tok/s | Runs with RAM offloadRequested Q4_K_M; estimate uses FP8. This is not an exact quantization match. | |
| 38 GiB | 18–32 tok/s | Runs with RAM offloadRequested Q4_K_M; estimate uses FP8. This is not an exact quantization match. | |
| 20,4 GiB | 2.3–4 tok/s | Runs with RAM offloadRequested Q4_K_M; estimate uses FP16 / BF16. This is not an exact quantization match. | |
| 10,6 GiB | 37–66 tok/s | Fits · alternate quantRequested Q4_K_M; estimate uses FP16 / BF16. This is not an exact quantization match. | |
| 4,2 GiB | 110–190 tok/s | Fits · target met | |
| 5,7 GiB | 76–130 tok/s | Fits · alternate quantRequested Q4_K_M; estimate uses FP16 / BF16. This is not an exact quantization match. | |
| 3,1 GiB | 170–310 tok/s | Fits · alternate quantRequested Q4_K_M; estimate uses FP16 / BF16. This is not an exact quantization match. | |
| 20,8 GiB | 1.9–3.4 tok/s | Runs with RAM offload | |
| 16,4 GiB | 37–65 tok/s | Runs with RAM offload | |
| 19,8 GiB | 26–47 tok/s | Runs with RAM offload | |
| 168,7 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 2,9 GiB | 190–340 tok/s | Fits · target met | |
| 4,3 GiB | 210–380 tok/s | Fits · target met | |
| 6,2 GiB | 110–200 tok/s | Fits · target met | |
| 8,6 GiB | 54–96 tok/s | Fits · target met | |
| 48,6 GiB | 23–40 tok/s | Runs with RAM offload | |
| 25 GiB | 25–45 tok/s | Runs with RAM offload | |
| 178,7 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 185,6 GiB | Unavailable · not comparable | No comparable speed dataRequested Q4_K_M; estimate uses Q8 (Q8_0). This is not an exact quantization match. Performance data is unavailable; this model is excluded from comparison. | |
| 164,9 GiB | Unavailable · not comparable | Does not fitRequested Q4_K_M; estimate uses MXFP4 (native). This is not an exact quantization match. Performance data is unavailable; this model is excluded from comparison. | |
| 543,4 GiB | Unavailable · not comparable | Does not fitRequested Q4_K_M; estimate uses MXFP4 (native). This is not an exact quantization match. Performance data is unavailable; this model is excluded from comparison. | |
| 7,2 GiB | 64–110 tok/s | Fits · target met | |
| 2,1 GiB | 410–730 tok/s | Fits · target met | |
| 22,1 GiB | 40–70 tok/s | Runs with RAM offload | |
| 15,3 GiB | 51–91 tok/s | Runs with RAM offload | |
| 7,4 GiB | 110–200 tok/s | Fits · target met | |
| 5,6 GiB | 88–160 tok/s | Fits · alternate quantRequested Q4_K_M; estimate uses Q8 (Q8_0). This is not an exact quantization match. | |
| 23,1 GiB | 1.8–3.2 tok/s | Runs with RAM offload | |
| 2,8 GiB | 180–310 tok/s | Fits · target met | |
| 2,2 GiB | 260–450 tok/s | Fits · target met | |
| 2,9 GiB | 200–350 tok/s | Fits · alternate quantRequested Q4_K_M; estimate uses Q8 (Q8_0). This is not an exact quantization match. | |
| 0 GiB | Unavailable · not comparable | No comparable speed dataPerformance data is unavailable; this model is excluded from comparison. | |
| 4,2 GiB | 110–190 tok/s | Fits · target met | |
| 39,6 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 1,6 GiB | 630–1,100 tok/s | Fits · target met | |
| 7,4 GiB | 64–110 tok/s | Fits · target met | |
| 18 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 22,1 GiB | Unavailable · not comparable | Does not fitPerformance data is unavailable; this model is excluded from comparison. | |
| 1,9 GiB | 400–710 tok/s | Fits · target met | |
| 9 GiB | 50–88 tok/s | Fits · target met | |
| 6,1 GiB | 230–410 tok/s | Fits · target met |
These are simulated ranges, not benchmark guarantees. Both chart axes are logarithmic. The accelerator memory line is a capacity reference; runtime needs and memory placement still determine fit. Unsupported contexts and missing estimates stay out of the plot. A larger model does not necessarily mean a better answer.
Check which local AI models fit your computer
Choose a computer, then compare catalog models under one fixed workload. Required memory changes with model weights, quantization and context length; decode speed also depends on the hardware and its memory bandwidth. Results distinguish full fit, RAM offload, alternate-quant fallback and cases that cannot be compared fairly.
Questions people ask
How can I tell whether a model fits my computer?
Start with the selected model and context, then check the required-memory estimate against the computer's usable accelerator memory. The estimate accounts for model weights, context cache and runtime overhead. A result may require RAM offload or a supported alternate quantization, and context beyond a model's stated native limit is flagged. See how the memory and speed calculations work; real software use can still vary, so leave practical headroom.
Does a larger model always give better answers?
No. Parameter count alone does not measure answer quality. Training data, architecture, tuning, prompt, quantization and the task all matter, and the hardware simulator does not score model quality. Model size is useful here as one clue about memory needs; compare reported model benchmark scores or try the models on your own tasks when answer quality is the deciding factor.
Why do context length and quantization change speed?
Quantization stores model weights with fewer bits, which can reduce memory use and the bytes read during generation, with possible quality trade-offs. Longer context increases the key-value cache and can consume more memory and generation bandwidth. The calculator holds your selected settings steady while comparing catalog models; unsupported contexts or quantizations are called out rather than shown as ordinary speed results.
What are the hardware memory requirements for Qwen3 32B?
For Qwen/Qwen3-32B converted to GGUF Q4_K_M, llm4fun estimates 18.4 GiB for weights at 4.83 bits per weight. With one user and an 8,192-token context, the F16 KV cache adds 2.0 GiB, bringing the total to about 22.4 GiB including single-GPU llama.cpp CUDA runtime buffers with flash attention and 5% headroom. At 32,768 tokens, the same calculation rises to 28.7 GiB. For example, the RTX 3090 has 24 GB of VRAM, of which this calculator budgets 23.4 GiB as usable: the 8,192-token example fits, while the 32,768-token example exceeds that budget. Exact quantized files and software allocations vary, and fitting in memory does not guarantee a particular speed. Sources: Qwen3-32B official configuration; Qwen3-32B model card; NVIDIA RTX 3090 specifications.