On Windows, Copilot Vision will be able to see your screen and guide you through apps. Microsoft is bringing its Copilot Vision feature to both Windows and mobile, taking it beyond the web. Last year, a major part of Microsoft’s Copilot redesign included Copilot Vision, but until now, it was limited to guiding users via the Edge webpage based on what they were seeing.
Copilot Vision will now be able to analyze real-time video from mobile cameras, enabling the AI assistant to offer suggestions like keeping plants healthy or decorating your home. Today, Microsoft is launching Copilot Vision within the Copilot app for IOS and Android, and a similar feature will soon be available on Windows.
The Copilot app on Windows is being updated to support Copilot Vision across your entire PC. This means Microsoft’s AI assistant will be able to help with tasks like using Adobe Photoshop features or analyzing the photos and web pages you’re viewing.
This is different from Microsoft’s Recall feature on PC. When you enable Recall, it automatically takes snapshots, while Copilot Vision works more like screen sharing in Microsoft Teams, allowing you to share an app or your entire desktop. Copilot Vision will be available next week for Windows Insiders, with Microsoft stating that it will be more broadly rolled out once testing is complete.
Today, Microsoft is also updating Copilot with several new features. The AI assistant now supports memory, personalization, web-based actions, podcast creation, in-depth research, and much more.
