Best local AI models for NVIDIA GTX 765M
2 GB GDDR5. At a 4k context, 56 of the 233 models in our catalog with verified parameter counts fit fully, up to Allegro at 2.8B parameters.
Check your own machine against every model →The largest models that fit fully
The 30 largest of the 56 models that fit; every smaller model in the catalog fits too. Best quant means the highest quality compression whose weights and 4k context both sit inside the memory.
| Model | Parameters | Best quant that fits | Memory used at 4k |
|---|---|---|---|
| Allegro | 2.8B | Q4_K_M | 2 GB |
| Open-Sora Plan | 2.7B | Q4_K_M | 2 GB |
| LFM2 1.2B / 2.6B | 2.6B | Q4_K_M | 1.9 GB |
| Playground v2.5 | 2.6B | Q4_K_M | 1.9 GB |
| Stable Diffusion 3.5 Medium | 2.5B | Q4_K_M | 1.8 GB |
| Canary 1B / Qwen-2.5B | 2.5B | Q4_K_M | 1.8 GB |
| SeamlessM4T v2 | 2.3B | Q5_K_M | 2 GB |
| Parler-TTS | 2.2B | Q5_K_M | 1.9 GB |
| Kimi K3 DSpark | 2.2B | Q5_K_M | 2 GB |
| SmolVLM 256M / 500M / 2B | 2B | Q6_K | 2 GB |
| Stable Diffusion 3 Medium | 2B | Q6_K | 2 GB |
| Pyramid Flow | 2B | Q6_K | 2 GB |
| Wav2Vec2 / XLS-R | 2B | Q6_K | 2 GB |
| Moondream 2 | 1.9B | Q6_K | 1.9 GB |
| Qwen3 1.7B | 1.7B | Q6_K | 1.7 GB |
| SmolLM2 135M / 360M / 1.7B | 1.7B | Q6_K | 1.7 GB |
| StableLM 2 1.6B | 1.6B | Q8_0 | 2 GB |
| Sana 0.6B / 1.6B | 1.6B | Q8_0 | 2 GB |
| Zonos 0.1 | 1.6B | Q8_0 | 2 GB |
| Dia 1.6B | 1.6B | Q8_0 | 2 GB |
| Whisper Large v3 | 1.55B | Q8_0 | 2 GB |
| ControlNet / T2I-Adapter / IP-Adapter | 1.5B | Q8_0 | 1.9 GB |
| Hunyuan-DiT | 1.5B | Q8_0 | 1.9 GB |
| Stable Video Diffusion | 1.5B | Q8_0 | 1.9 GB |
| Whisper Large v2 / turbo | 1.5B | Q8_0 | 1.9 GB |
| AudioGen | 1.5B | Q8_0 | 1.9 GB |
| AudioLDM 2 | 1.5B | Q8_0 | 1.9 GB |
| Tango 2 | 1.4B | Q8_0 | 1.8 GB |
| TinyLlama 1.1B | 1.1B | Q8_0 | 1.4 GB |
| SantaCoder 1.1B | 1.1B | Q8_0 | 1.4 GB |
Close, but only with CPU offload
These need more than the card holds at their smallest practical quant, so part of the model runs from system memory (figures assume 32 GB of it). They work, several times slower.
| Model | Parameters | Memory at Q4_K_M | System RAM at 4k |
|---|---|---|---|
| SmolLM3 3B | 3B | 2.2 GB needed | 4.2 GB |
| Replit Code v1.5 3B | 3B | 2.2 GB needed | 4.2 GB |
| Kandinsky 3.1 | 3B | 2.2 GB needed | 4.2 GB |
| Voxtral Mini / Small | 3B | 2.2 GB needed | 4.2 GB |
| Orpheus TTS | 3B | 2.2 GB needed | 4.2 GB |
| Higgs Audio v2 | 3B | 2.2 GB needed | 4.2 GB |
| MusicGen small/medium/large | 3.3B | 2.4 GB needed | 4.4 GB |
| Stable Diffusion XL | 3.417B | 4.1 GB needed | 6.1 GB |
| SDXL Turbo | 3.5B | 2.6 GB needed | 4.6 GB |
| SDXL Lightning | 3.5B | 2.6 GB needed | 4.6 GB |
How to read this
The NVIDIA GTX 765M is a mobile graphics card equipped with 2 GB of GDDR5 memory. This hardware memory size determines the maximum size of the artificial intelligence models you can run locally. Because the onboard memory is limited to 2 GB, you must select small models or use quantized versions to avoid running out of video memory.
The quantization column shows the compression format used to shrink these models. Quantization reduces the precision of model weights to save space. For example, the Allegro 2.8B model fits in 2 GB of video memory when using the Q4_K_M quantization. Other models like SmolVLM 2B or Moondream 2 can run at a higher Q6_K quantization while staying within the 1.9 GB to 2 GB limit.
When a model exceeds the 2 GB video memory limit, you must use CPU offloading. This process splits the model between your graphics card and your system RAM. We assume your computer has 32 GB of system RAM for these setups. Offloading allows you to run larger models like the 3.5B SDXL Turbo or SDXL Lightning, but it reduces processing speed because system RAM is slower than GDDR5 video memory.
If you use CPU offloading, a model like MusicGen needs 2.4 GB of video memory at Q4_K_M and 4.4 GB of system RAM. Similarly, Stable Diffusion XL requires 4.1 GB of video memory at FP8 and 6.1 GB of system RAM. This technique makes it possible to run models that would otherwise fail to load on a 2 GB card.
You must also consider the memory cost of context length. Running text models with a 4k context window requires extra video memory to store the active conversation history. This extra memory usage is not included in the base model file sizes, so you may need to choose smaller models like TinyLlama 1.1B or Qwen3 1.7B to keep the context window fully inside the 2 GB video memory limit.