过程监督Process supervision
Process supervision
解决什么问题What problem it solves
不只检查最终答案,而是逐步检查推理过程每一步对不对。Check each reasoning step, not only the final answer.
这是什么What it is
对推理链的每个步骤给标签,而不是只给最后答案对错。
训练一个过程奖励模型(PRM),给每一步打分。
搜索时用 PRM 选更有希望的路径,而不是只看最终结果。
Label every step of a reasoning chain, rather than only right/wrong at the end.
Train a process reward model (PRM) that scores each step.
Use the PRM during search to prefer promising paths, not just lucky final answers.
为什么需要知道Why it matters
只看结果会把「碰巧算对」也当成正确。过程监督能定位具体哪一步开始错。Outcome-only supervision treats a lucky guess as correct. Process supervision locates the first bad step.
同域词条Terms in the same area
现在能做什么What you can do now
回到名词地图看第4站的其他 54 个词 →Back to the map: the other 54 terms in station 4 →
出处Sources
- Let’s Verify Step by Step(arXiv)Let’s Verify Step by Step (arXiv 2305.20050) ↗