Microsoft's Copilot AI can now watch your screen as you browse so you can ask it questions about what you're doing.
After months of teasers, previews, and select rollouts, Microsoft ’s Copilot Vision is now available to try for all Edge users in the U.S. The flashy new AI tool is designed to watch your screen as you browse so you can ask it various questions about what you’re doing and get useful context-appropriate responses. The main catch, however, is that it currently only works with nine websites.
Recommended Videos CEO of Microsoft AI Mustafa Suleyman announced the release on Bluesky yesterday and shared a few of his favorite use cases. Related With Copilot Vision, instead of trying to describe what you’re looking at or what you’re talking about, the AI model can see it right on your screen. On the Food & Wine recipe website, Copilot can help you go hands-free while you cook by answering your questions and reading out parts of the recipe to you. This works because the whole experience is designed to work through voice — you speak directly to the AI and the AI speaks back.
AI Tools Microsoft Microsoft Copilot
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Microsoft starts testing Copilot Vision update that can ‘see’ your screen and appsMicrosoft has started testing new Copilot features with Windows Insiders. You’ll be able to use Copilot Vision to help guide you through apps and games.
Read more »
Microsoft will soon use AI to help you find your photos and files on Copilot+ PCsWindows Search on Copilot+ PCs are getting a much-anticipated feature that's going to make searching easier.
Read more »
Microsoft adds ‘deep reasoning’ Copilot AI for research and data analysisMicrosoft’s new 365 Copilot upgrades are all about agents, with two specifically built for deep research and data analysis.
Read more »
Microsoft 365 Copilot gets an AI Researcher that everyone will loveDT Video
Read more »
Microsoft introduces deep research and analysis tools for CopilotMariella Moon has been a night editor for Engadget since 2013, covering everything from consumer technology and video games to strange little robots that could operate on the human body from the inside one day. She has a special affinity for space, its technologies and its mysteries, though, and has interviewed astronauts for Engadget.
Read more »
Microsoft’s Copilot Agents Transform Executive Decision-MakingMicrosoft Copilot’s Researcher and Analyst agents represent a significant leap toward AI-augmented leadership.
Read more »