跳到主要内容Skip to main content

本地部署Local Deployment

Local Deployment

  • 硬件与部署Hardware & deployment
  • 第六站 · 选得对Station 6 · Choosing Right
解决什么问题What problem it solves

模型下载到自己机器上跑,数据不外发。Download the model and run it on your own machine, so data never leaves.

这是什么What it is

在本机或自有服务器上运行模型推理,不经过第三方接口。

Running model inference on your own hardware or server, without going through a third-party API.

为什么需要知道Why it matters

隐私敏感、要用专门的量化版本,或者长期高频调用。这些场景下本地部署通常更划算。Usually the better choice when data is sensitive, when you need a specific quantisation, or when calling at high volume long-term.

出处Sources
  • 按设备选量化档位(千问 3.8)Pick tiers by device (Qwen3.8) ↗
  • 本地引擎怎么选Nav: how to pick a local engine ↗