跳到主要内容Skip to main content

Computer UseComputer Use

Computer Use

  • 智能体Agents
  • 第三站 · 用深Station 3 · Going Deeper
  • 引用核验 2026-11-03refs checked 2026-11-03
解决什么问题What problem it solves

让 AI 直接操作电脑界面:看屏幕、点按钮、输入文字,而不是只调用 API。Let AI operate a computer directly — read the screen, click buttons, type — instead of only calling APIs.

这是什么What it is

Computer Use 指模型通过截图/无障碍树观察屏幕,并执行鼠标、键盘操作来完成 GUI 任务。

它与「浏览网页」不同:粒度更细、权限更大,风险也更高。

Computer Use means a model observes the screen through screenshots or the accessibility tree and performs mouse/keyboard actions to complete GUI tasks.

It differs from "browsing the web": finer granularity, broader permissions, higher risk.

为什么需要知道Why it matters

很多旧系统没有 API,只能靠界面操作;这也是 agent 从「聊天」走向「替你干活」的关键一步,但需要沙箱与审批。Many legacy systems have no API and can only be driven through their UI. It is a key step from chat to doing work for you, but it needs sandboxing and approvals.

出处Sources
  • Anthropic · Computer Use 官方文档Anthropic · Computer Use ↗
  • OpenAI · Computer use 指南OpenAI · Computer use guide ↗