跳到主要内容Skip to main content

机器人策略Robot Policy

Robot Policy

  • 核心概念Core concepts
  • 第四站 · 看懂Station 4 · Under the Hood
  • 引用核验 2026-11-07refs checked 2026-11-07
解决什么问题What problem it solves

说清机器人「看到什么就做什么」的那条映射,它才是机器人行为的直接来源。Name the mapping from what a robot observes to what it does — the direct source of robot behaviour.

这是什么What it is

策略是观测到动作的映射:给定当前状态或观测,策略决定下一步执行什么动作,可以是确定性规则,也可以是输出动作分布的随机策略。

机器人策略通常由学习得到——模仿学习从示范拟合它,强化学习按奖励优化它;训练完成后,部署到机器人上的就是这个映射本身。

策略与环境构成闭环:动作改变环境,新观测又喂回策略。机器人行为的连贯或失控,都要从这个闭环里找原因,而不是归结为某一条单步指令。

A policy is a mapping from observations to actions: given the current state or observation, it decides the next action, either as a deterministic rule or a stochastic policy outputting an action distribution.

Robot policies are usually learned: imitation learning fits them from demonstrations, reinforcement learning optimises them by reward; after training, the deployed artefact is this mapping itself.

Policy and environment form a closed loop: actions change the environment, and new observations feed back into the policy. Coherent or runaway behaviour should be traced through this loop, not blamed on one single-step command.

为什么需要知道Why it matters

看懂「策略」这个词,机器人新闻里的「端到端」「策略泛化」「策略失效」才有落点:它们说的都是同一条观测到动作的映射,在不同条件下的表现。Understanding policy gives robot news terms such as end-to-end, policy generalisation and policy failure a concrete referent: they all describe the same observation-to-action mapping under different conditions.

出处Sources
  • OpenAI Spinning Up · Key Concepts in RL(Policies 一节)OpenAI Spinning Up: key concepts in RL, policies ↗
  • Sutton 与 Barto《Reinforcement Learning: An Introduction》官方书页Sutton & Barto, Reinforcement Learning: An Introduction, official book page ↗