Microsoft has introduced a powerful new feature in Copilot Studio that enables AI agents to interact directly with websites and desktop applications—essentially letting them “use” a computer like a human would. Dubbed “computer use,” the feature allows agents to click buttons, fill out forms, and navigate interfaces without needing an API connection.
“This allows agents to handle tasks even when there’s no API available to connect to the system directly. If a person can use the app, the agent can too,” said Charles Lamanna, Microsoft’s Corporate VP for Business & Industry Copilot.
The upgraded Copilot Studio can now build agents capable of automating a variety of business tasks, such as data entry, market research, or invoice processing. Impressively, the agents can adapt to changing screens and buttons without breaking the workflow.
This follows Microsoft’s recent rollout of a similar “Actions” feature in its consumer-facing Copilot, which lets the AI book tickets or shop online. However, while Actions is limited to specific partners, the new Copilot Studio feature offers broader integration across websites and apps, making it a more versatile tool for businesses.