Microsoft starts testing two Copilot features, one of them can now ‘See’ your entire screen

Microsoft has started rolling out an update for the Copilot app on Windows to test two new features for the chatbot. The latest update which is available only for Windows Insiders bring major improvements to the AI assistant. As part of the latest update (version 1.25034.133.0 and above), the tech giant has introduced the Copilot Vision tool that will allow the app to analyse and understand the contents of the user’s entire screen. This capability will enable Copilot to offer more context-aware assistance based on what’s visible on the display. The update also brings a second feature—file search—which allows users to quickly locate and interact with files through Copilot.

In a blog post, the company has confirmed that it has started rolling out its latest Copilot app update through the Microsoft Store across all Insider Channels. The Copilot Vision feature will initially be available to Insiders in the US, while the file search functionality is set to arrive for Insiders worldwide.
Given the gradual rollout, not every Insider will receive the update immediately. Microsoft is collaborating with Insiders to preview these improvements and ensure an enhanced Copilot experience for all Windows customers.

The Copilot Vision feature on Windows lets users share any browser or app window with the chatbot, which then reviews the content, provides insights, and offers spoken guidance.
To begin, the user need to click the glasses icon in the composer, selects the desired browser window or app, and asks Copilot for assistance with their current task. When finished, the user can simply click “Stop” or the “X” icon in the composer to end sharing.
Meanwhile, the File search feature in Copilot’s Windows app enables users to locate, open, and inquire about the contents of files on their devices. Users can adjust permissions in the Copilot Settings under Permission settings to control what the app may access, retrieve, or read.
The feature supports a wide range of file types, including .docx, .xlsx, .pptx, .txt, .pdf, and .json files. Users can ask questions to this feature such as “Can you find my resume?”, “Open the trip planning document from last week”, or “Review my budget file and report the dining expenses from last month.”