预填充Prefill
Prefill
解决什么问题What problem it solves
把你输入的那一整段先读完，再开始生成回答的那一步。The step where your whole input is read through before generation begins.
这是什么What it is
模型处理输入部分的阶段。输入越长，预填充越慢，首字延迟越大。
The stage where the model processes the input portion. Longer input means slower prefill and higher time to first token.
为什么需要知道Why it matters
解释了一个常见现象：塞了一大段资料后，模型「想」很久才开始回答。那是预填充在算。It explains a common observation: after you paste a long document the model "thinks" for a long time before answering — that is prefill computing.
现在能做什么What you can do now
回到名词地图看第5站的其他 29 个词 →Back to the map: the other 29 terms in station 5 →