# Computer Use

> A model that works a computer. It looks at the screen, then clicks or types.

**Field:** Artificial Intelligence  
**Category:** AI Agents  
**Also known as:** Computer-Use Agent, Browser Use, GUI Agent

## Think of it like

Think of it like a friend who looks at your screen and moves the mouse for you.

## Definition

Computer use is a kind of tool use where a model works a computer the way a person does. It gets a screenshot of the screen, decides what to do, and sends back an action such as a click, a key press or some typing. The program carries out the action and takes a new screenshot. This loop repeats until the task is done. It lets an agent use apps that have no other way in, but it is slower and makes more mistakes than a direct tool.

## Example

Jack's agent fills in an old expense form that has no API. It reads each screenshot, clicks the right box and types the amounts.

## Why it matters

Most software was built for people with a mouse. Computer use lets agents reach all of it.

## Common mistake

Letting it run on your real desktop while you are logged in to everything. Use a spare machine or account.

## Three principles

- **Sees screenshots.** Like a person.
- **Clicks and types.** Real actions.
- **Slow but wide.** Works where no tool does.

## Related terms

- [Tool Use (Function Calling)](https://learn.benibix.com/term/ai/tool-use)
- [Agent Sandbox](https://learn.benibix.com/term/ai/agent-sandbox)
- [AI Agent](https://learn.benibix.com/term/ai/ai-agent)
- [Robotic Process Automation (RPA)](https://learn.benibix.com/term/development/robotic-process-automation)
- [AI Browser](https://learn.benibix.com/term/ai/ai-browser)

![A loop between the model and a screen. The model gets a screenshot, then sends a click or some typing, then gets a new screenshot.](https://learn.benibix.com/diagrams/ag-computer-use.svg)

---

Source: https://learn.benibix.com/term/ai/computer-use
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
