跳到主要内容Skip to main content

过程监督Process supervision

Process supervision

  • 核心概念Core concepts
  • 第四站 · 看懂Station 4 · Under the Hood
  • 引用核验 2026-11-19refs checked 2026-11-19
解决什么问题What problem it solves

不只检查最终答案,而是逐步检查推理过程每一步对不对。Check each reasoning step, not only the final answer.

这是什么What it is

对推理链的每个步骤给标签,而不是只给最后答案对错。

训练一个过程奖励模型(PRM),给每一步打分。

搜索时用 PRM 选更有希望的路径,而不是只看最终结果。

Label every step of a reasoning chain, rather than only right/wrong at the end.

Train a process reward model (PRM) that scores each step.

Use the PRM during search to prefer promising paths, not just lucky final answers.

为什么需要知道Why it matters

只看结果会把「碰巧算对」也当成正确。过程监督能定位具体哪一步开始错。Outcome-only supervision treats a lucky guess as correct. Process supervision locates the first bad step.

出处Sources
  • Let’s Verify Step by Step(arXiv)Let’s Verify Step by Step (arXiv 2305.20050) ↗