Microsoft announces major AI upgrade for Windows with smarter Copilot feature

Microsoft announced improvements to Copilot in a blog post today, including a new Vision feature that allows the AI assistant to view and interact with users’ Windows screens in real time.

As part of Microsoft’s 50th anniversary, it announced a huge improvement to Copilot, making it more personalized and guiding users through tasks at every step. Microsoft introduced Vision in Copilot for the web last year, but the announcement is now for Windows and mobile. You can use the native Windows app to use Copilot when working across various apps, files, and browser tabs. Vision in Copilot will read your screen and interact with it.

Recommended Videos

You can use Copilot to search, organize files, change settings, and work together on projects without constantly switching apps or files. You can access the Copilot app by pressing Alt + Space or by pressing Alt + Space for two seconds for voice commands. Microsoft says the native Copilot app is available today, but the Vision feature will reach the Windows Insider program first next week for future testing. The software giant didn’t mention a specific general release date, so we can only wait.

During a demo, Microsoft showed how Copilot added a second cursor to guide users by highlighting the buttons they needed to click. For example, in Photoshop, Copilot Vision pointed out specific tools and the steps the user needed to follow next. The Vision feature used voice instructions and visual cues to provide a more interactive experience, which is a giant leap forward.

While Vision could make interacting with your Windows computer easier, giving an AI assistant access to everything on your screen could raise privacy concerns. But Microsoft did say that the sessions are entirely opt-in and ephemeral. Microsoft claims Copilot Vision does not save or use anything it interacts with. Microsoft also says that Copilot Vision can answer questions about what’s on your screen and provides an example by saying, “Imagine you’re trying to furnish a new apartment, Copilot Vision can help you search for furniture, find the right color palette, think through your options on everything from rugs to throws and even suggest ways of arranging what you’re looking at.”

Comments on "Microsoft announces major AI upgrade for Windows with smarter Copilot feature" :

Leave a Reply

Your email address will not be published. Required fields are marked *

RECOMMENDED NEWS

Spotify hit band The Velvet Sundown comes clean on AI
COMPUTING

Spotify hit band The Velvet Sundown comes clean on AI

The Velvet Sundown burst onto the music scene in early June and in the space of just a few weeks gai...

Read More →
Chat GPT 5.0 will dramatically change the way you use AI
COMPUTING

Chat GPT 5.0 will dramatically change the way you use AI

OpenAI’s much-anticipated ChatGPT 5.0 is expected to arrive August 7 —and it could change how ev...

Read More →
AI headphones driven by Apple M2 can translate multiple speakers at once
COMPUTING

AI headphones driven by Apple M2 can translate multiple speakers at once

Google’s Pixel Buds wireless earbuds have offered a fantastic real-time translation facility for a...

Read More →
Kagi’s AI search assistant gives you access to all the big models in one place
COMPUTING

Kagi’s AI search assistant gives you access to all the big models in one place

Kagi’s “Assistant” feature, previously only available to Ultimate subscribers, is now rolling ...

Read More →
Clinical test says AI can offer therapy as good as a certified expert
COMPUTING

Clinical test says AI can offer therapy as good as a certified expert

AI is being heavily pushed into the field of research and medical science. From drug discovery to di...

Read More →
OpenAI’s Operator agent is coming to eight more countries
COMPUTING

OpenAI’s Operator agent is coming to eight more countries

OpenAIFollowing  its U.S. debut in January, OpenAI’s Operator AI agent will soon be expanding to ...

Read More →
OpenAI launches GPT-4.5 AI model with deeper knowledge and emotions
COMPUTING

OpenAI launches GPT-4.5 AI model with deeper knowledge and emotions

OpenAI has just introduced its latest AI model, dubbed GPT-4.5, which the company claims is its larg...

Read More →
Google Pixel 9 is getting a scam detection upgrade you’ll want on your phone
COMPUTING

Google Pixel 9 is getting a scam detection upgrade you’ll want on your phone

Over three months ago, Google started beta testing a new safety feature for Pixel phones that can se...

Read More →
DeepSeek has a new rival, and you can try it out right now
COMPUTING

DeepSeek has a new rival, and you can try it out right now

Alibaba has just unveiled its latest reasoning model, and it seems that DeepSeek and OpenAI might ha...

Read More →