RLAIF(AI 反馈强化学习)RLAIF
RLAIF
解决什么问题What problem it solves
用另一个 AI 模型代替人类标注偏好,降低 RLHF 的标注成本。Replace human preference labels with another AI model to cut the cost of RLHF.
这是什么What it is
让评审模型对多个候选回答做排序或打分。
把 AI 偏好当作奖励信号,训练策略模型。
通常要配合人类偏好校准,避免评审模型把自己的偏见传下去。
A judge model ranks or scores candidate answers.
Its preferences become the reward signal for training the policy.
Human calibration is usually needed so the judge’s own biases are not amplified.
为什么需要知道Why it matters
RLHF 贵在人工排序。RLAIF 把标注变成可扩展的模型调用,但会引入评审模型的盲区。RLHF is expensive in human ranking. RLAIF scales labelling through model calls but imports the judge’s blind spots.
同域词条Terms in the same area
现在能做什么What you can do now
回到名词地图看第3站的其他 66 个词 →Back to the map: the other 66 terms in station 3 →
出处Sources
- RLAIF 论文(arXiv)RLAIF: Scaling Reinforcement Learning from Human Feedback with AI Feedback (arXiv 2309.00267) ↗