跳到主要内容Skip to main content

显存不够就跑不了Not Enough VRAM Means It Will Not Run

微型指南 · 约 5 分钟Guide · about 5 min · 引用核验 2026-11-03(仅引用链接与日期) · refs checked 2026-11-03 (reference links and dates only)

能不能跑与跑多快,是两个问题。Whether it runs and how fast it runs are two questions.

显存装不下,就只能换显卡。If it does not fit in VRAM, the only option is a better graphics card.

部分运行器支持把一部分工作放到系统内存或 CPU,但还受总内存、架构支持和速度要求限制。先分别计算权重、缓存与运行时占用,再评估更小规格、量化或卸载方案。Some runtimes support system-memory/CPU offload, subject to total memory, architecture and speed constraints. Budget weights, cache and runtime separately before assessing smaller variants, quantization or offload.

例子与判断Example and interpretation

以下是教学情境,不是本站运行或实测记录。A teaching scenario, not a measured or executed site test.

文件装不进显存时,先看运行器是否支持部分卸载、机器内存是否足够,也可比较更小模型或其他量化档。能启动后仍要检查速度与上下文需求,不能把“启动成功”当作“可用”。If weights exceed VRAM, check runtime offload support and system RAM, or assess a smaller model/quantization. After startup, assess speed and context needs. Starting successfully is not the same as being usable.

先懂这几个词Terms behind this

GPU 层卸载-ngl / Offload CPU 推理CPU Inference

出处Sources
  • 按显存倒推选档位(千问 3.8)Choosing by VRAM, backwards (Qwen3.8) ↗
  • llama.cpp 官方仓库llama.cpp repository ↗
围绕这些概念继续读More on these concepts

—