Microsoft has unveiled a major redesign of its Copilot AI assistant today, introducing voice interaction, visual understanding, and enhanced personalization. The voice, vision, and new interface features are rolling out across web, mobile, and Windows platforms starting today.
Copilot gets voice
Copilot Voice, available in select English-speaking countries, including the US, UK, Canada, Australia, and New Zealand, allowing to engage in natural conversations with the AI. With four synthetic voice options, users can now speak to Copilot and hear responses aloud. There are four voices to choose from – where users can choose from four AI voices: Meadow, Canyon, Grove, and Wave.
However, there's a catch: Copilot Voice comes with a time-based usage limit. While Microsoft hasn't disclosed specific numbers, Copilot Pro subscribers will enjoy more minutes of voice interaction. The exact allocation is "variable," according to Microsoft, adjusting based on demand.
A new set of eyes for Copilot with Vision
For Copilot Pro subscribers, the new Vision feature lets the AI analyse and respond to on-screen content in Microsoft Edge. Users can ask questions about text and images they're viewing, with potential applications ranging from recipe interpretation to shopping assistance.
Microsoft emphasises that Vision sessions are opt-in and ephemeral, with strict privacy measures in place. The company has limited Vision's functionality to a pre-approved list of popular websites, excluding paywalled and sensitive content.
Copilot can now think deeper for complex problems
Another Pro-exclusive feature, Think Deeper, harnesses advanced reasoning models to tackle more complex queries. This tool provides step-by-step answers to multifaceted questions, potentially aiding in decision-making processes and problem-solving.
Think Deeper is initially available to a limited number of Copilot Labs users in Australia, Canada, New Zealand, the US, and the UK.
Copilot gets to know you
Copilot - Personalized Discover Cards
A new personalization setting allows Copilot to tailor its suggestions based on users' past interactions and usage of Microsoft services. This feature aims to provide more relevant recommendations and conversation starters, though it won't be available in the UK or EU initially.
Redesigned interface for Copilot across platforms
The Copilot makeover extends to its user interface, with a warmer and more inviting design across all platforms. A translucent bottom bar now anchors the interface, featuring quick access to past conversations on the left and a plus icon for uploading images, videos, and documents for AI analysis.
The familiar "Message Copilot" box remains for starting new chats, while the Copilot icon on the bottom-left returns users to the homepage. A new microphone icon opens the Copilot Voice feature. These voices can also be applied to Copilot Daily, customizable via the user's profile settings.
Now about the Copilot Daily. It’s the new voice capabilities to deliver personalised audio summaries of news, weather, and potentially task reminders, akin to a customised morning podcast. This feature draws content exclusively from authorised news and weather providers, with Microsoft partnering initially with Reuters, Axel Springer, Hearst, and the Financial Times, and plans to expand its sources over time.
Complementing this, Copilot Discover offers tailored tips on AI features based on your usage of Microsoft services, helping users maximise their Copilot experience.
Microsoft has further deepened Copilot's integration within the Edge browser, enhancing its accessibility and utility. Users can now summon Copilot's assistance effortlessly by typing "@copilot" into the address bar.