跳到主要内容Skip to main content

显存VRAM

VRAM

  • 硬件与部署Hardware & deployment
  • 第五站 · 跑起来Station 5 · Running It
解决什么问题What problem it solves

显卡上的内存。装不下模型就是硬装不下,跟别的无关。Memory on the graphics card. If the model does not fit, it simply does not run — nothing else matters.

这是什么What it is

GPU 上的高速内存。模型权重和 KV 缓存都要放进去,超了就无法运行。

显存是本地部署的第一道硬门槛,不是性能问题而是「能不能跑」问题。

High-speed memory on the GPU. Model weights and the KV cache both live there, and overflowing means it cannot run.

VRAM is the first hard threshold for local deployment — not a performance question but a can-it-run-at-all question.

为什么需要知道Why it matters

这是本地跑模型唯一需要先算清楚的账。选量化档位本质上就是为了塞进显存。It is the only budget you must settle before running a model locally. Choosing a quantisation tier is essentially about fitting inside VRAM.

出处Sources
  • 按显存倒推选档位(千问 3.8)Choosing by VRAM, backwards (Qwen3.8) ↗
  • 从业者深版:GPU 事实与成本数学(AI 模型站)Practitioner deep-dive: GPU facts & cost math (AI Models site) ↗