Computer Use
ELI5 — The Vibe Check
Computer use is AI controlling a desktop — clicking, typing, reading the screen — like an intern who can actually use your Mac. You tell it "fill out this form" and it moves the mouse, reads what's on screen, and types the answers. It's not just generating code. It's doing the actual computer thing. Terrifying and incredibly useful in equal measure.
Real Talk
Computer use (introduced by Anthropic in 2024) lets Claude control a computer via screenshot observation and mouse/keyboard actions. The model sees the screen as an image, reasons about what to click or type, and executes actions in a loop. It works with any GUI application — no API required. Frameworks like BrowserBase and Playwright pair with it for web-specific workflows.
When You'll Hear This
"We used computer use to automate the manual QA steps." / "Computer use filled out the government portal — something no API exists for."
Related Terms
Agent
An AI agent is an LLM that doesn't just answer questions — it takes actions.
Browser Use
Browser use is AI controlling a real browser — scraping, filling forms, navigating UIs — computer use but scoped to the web.
Tool Use
Tool use is when an AI can call external functions, APIs, or programs to do things it can't do alone.