Microsoft just rolled out a new 'computer use' capability in Copilot Studio

Microsoft just rolled out a new 'computer use' capability in Copilot Studio, enabling users and businesses to build AI agents that can directly operate websites and desktop applications.

The new feature allows agents to interact with graphical user interfaces (GUIs) by clicking buttons, selecting menus, and typing into fields.
The process unlocks automation for tasks on systems lacking dedicated APIs, allowing agents to use apps just like humans would.
Computer Use also adapts in real-time to interface changes using built-in reasoning, automatically fixing issues to keep flows from breaking.
All processing happens on Microsoft-hosted infrastructure, with enterprise data explicitly excluded from model training.

Copilot joins the likes of OpenAI and Anthropic’s Computer Use tools, marking another step in AI’s agentic shift from chat windows into everyday software. While it’s not the only UI automation tool, Microsoft users’ existing business workflows are a perfect use case to take advantage of this type of feature.

0 comments