跳到主要内容Skip to main content

视觉语言动作模型Vision-Language-Action Model

Vision-Language-Action Model

  • 模型能力Model capabilities
  • 第二站 · 上手Station 2 · Hands On
  • 引用核验 2026-11-07refs checked 2026-11-07
解决什么问题What problem it solves

让一个模型同时看图、读指令、出动作,端到端控制机器人。Let one model see images, read instructions and output actions to control a robot end to end.

这是什么What it is

视觉语言动作模型(VLA)把视觉编码器、语言模型与动作输出接在一起:输入相机画面和自然语言指令,直接输出机器人该执行的动作。

RT-2 把网络图文知识迁移到机器人控制,显示这类模型能把没见过的指令泛化成新动作;OpenVLA 给出了开源的同类实现。

它与「感知—规划—控制」分模块搭机器人的传统路线相对:一个模型从看到动,中间不再手写每个环节。

A vision-language-action model (VLA) connects a visual encoder, a language model and action output: camera images and natural-language instructions go in, and robot actions come out directly.

RT-2 transfers web image-text knowledge into robot control and shows such models can generalise unseen instructions into new actions; OpenVLA provides an open-source implementation of the same kind.

It contrasts with the traditional modular perception-planning-control route: one model goes from seeing to acting without hand-writing every intermediate stage.

为什么需要知道Why it matters

这是当前具身智能里最受关注的模型形态,新闻里的「机器人大模型」多指它。知道它端到端的本质,就能追问两个边界问题:训练数据覆盖不到的任务怎么办,动作出错时谁来兜底。This is the most watched model form in embodied AI; robot large model in news often means it. Knowing its end-to-end nature lets you ask two boundary questions: what happens on tasks outside training coverage, and who catches action errors.

别名Chinese aliases

VLA · VLA 模型

出处Sources
  • Brohan 等《RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control》Brohan et al., RT-2: vision-language-action models ↗
  • Kim 等《OpenVLA: An Open-Source Vision-Language-Action Model》Kim et al., OpenVLA: an open-source VLA model ↗