推理Inference
Inference
解决什么问题What problem it solves
训练完之后，真正拿来回答你问题的过程。The model you trained is now answering real queries — a different phase with different costs.
这是什么What it is
用一个已经训练好的模型做计算、产出结果的过程。
和训练相反：训练需要大量算力，推理是持续的小规模计算。
Running a trained model to produce an answer. Often confused with "reasoning", but inference simply means using the model.
为什么需要知道Why it matters
你每次和模型对话、每次它在本地生成内容，用的都是推理。算速度和成本时说的也是它。Training and inference have different cost structures. It explains why a model can be cheap to make and expensive to serve.
现在能做什么What you can do now
本地推理的速度受什么影响What affects local inference speed ↗
回到名词地图看第1站的其他 34 个词 →Back to the map: the other 34 terms in station 1 →
出处Sources
- 本地推理的速度受什么影响What affects local inference speed ↗