Getting Started with Copilot Vision on Windows 11

Using Copilot Vision with Microsoft Edge

Why use Edge with Vision? Edge is a web browser. Using Vision with Edge helps you ask questions about websites, videos, and documents while you browse.

What happens? Copilot looks at the web page and answers your questions about it.

Steps to Use with Edge

1. Sign in to Edge using your personal Microsoft Account. Learn how to sign in and create multiple profiles in Microsoft Edge if you have not done this yet.
2. Go to a website, video, or PDF document you want to ask questions about.
3. Note: Copilot Vision works with most sites. It does not work with sites that have harmful or adult content. When you visit a site that does not work, the Copilot Composer at the bottom shows a grayed-out crossed eyeglasses icon. Copilot will refuse to talk about the page content.
4. Click the Copilot icon

   

   in the upper right corner of Edge. This opens Copilot in the side panel.
5. Press the Voice button

   

   to ask your question.
6. Copilot Vision looks at the page. Then you can have a natural conversation with Copilot about the content.
7. To end a Vision session, close the Copilot Composer or close the Edge window.

Reference

Microsoft

Summary

Copilot Vision is a helpful new feature for Windows 11 that lets you ask questions about what you see on your screen using your voice. You can use it right in the Copilot app or within Microsoft Edge to quickly get information about websites, videos, and more.

Copilot Vision in Windows 11 lets the Microsoft Copilot AI assistant see your active screen so you can ask questions about pictures, apps, and web pages.

This tool first rolled out in Windows 11 version 23H2 to give the assistant the ability to understand what you look at on your desktop.

You turn on the feature inside the Copilot side panel whenever you need help with a visual task on your PC.

What is Copilot Vision?

Copilot Vision on Windows 11 is a built-in assistant feature that looks at your computer screen to help you answer questions about what you are currently viewing. When you turn on Copilot Vision Windows 11, it understands your active screen content so you can get immediate help without needing to explain what is on your display.

When Copilot is on your Windows computer, you can enable or disable it, open Copilot when Windows starts, Pin or Unpin the Copilot side panel, Resize the Copilot side panel, delete chat history in Copilot, create a desktop shortcut, hide the sidebar, use your phone with Copilot, enable file search, and more.

Starting with Copilot version 1.25034.133.0, Microsoft added a new voice feature. This feature answers questions about the page you are looking at. It also suggests what you should do next.

Copilot Vision is available to all Microsoft Edge users. If you subscribe to Copilot Pro, you get more Vision uses.

How to Use Copilot Vision

Using Copilot Vision on Windows 11 requires opening the app and starting a screen-based chat about whatever active window or document you are viewing. You can type or speak your request after turning on Copilot Vision Windows 11, and the assistant reads the visual elements on your display to provide relevant answers right away.

Copilot Vision for Windows 11 analyzes your screen content and engages in a dialogue about the visual information it detects. This interaction allows Copilot to offer relevant assistance based on what is currently displayed on your computer.

Steps to Get Started

1. Open the Copilot app on Windows 11.
2. sign in to Copilot with your Microsoft account if you have not already.
3. When Copilot opens, look for the glasses button (Copilot Vision button) on the composer bar at the bottom.
4. Click the glasses button to let Copilot see your screen.

5. Click the "Share" button to share your screen with Copilot.

6. Use the microphone button to ask questions about what is on your screen.

Understanding the Control Buttons

The bar shows several buttons you can use:

• Voice (microphone) button: Turns the microphone on or off.
• Share screen with Copilot (glasses) button: Shares a different window with Copilot.
• Stop button or X: Stops sharing the window and ends the Vision session.

Using Copilot Vision with Microsoft Edge

Why use Edge with Vision? Edge is a web browser. Using Vision with Edge helps you ask questions about websites, videos, and documents while you browse.

What happens? Copilot looks at the web page and answers your questions about it.

Steps to Use with Edge

1. Sign in to Edge using your personal Microsoft Account. Learn how to sign in and create multiple profiles in Microsoft Edge if you have not done this yet.
2. Go to a website, video, or PDF document you want to ask questions about.
3. Note: Copilot Vision works with most sites. It does not work with sites that have harmful or adult content. When you visit a site that does not work, the Copilot Composer at the bottom shows a grayed-out crossed eyeglasses icon. Copilot will refuse to talk about the page content.
4. Click the Copilot icon

   

   in the upper right corner of Edge. This opens Copilot in the side panel.
5. Press the Voice button

   

   to ask your question.
6. Copilot Vision looks at the page. Then you can have a natural conversation with Copilot about the content.
7. To end a Vision session, close the Copilot Composer or close the Edge window.

Reference

Microsoft

Summary

Copilot Vision is a helpful new feature for Windows 11 that lets you ask questions about what you see on your screen using your voice. You can use it right in the Copilot app or within Microsoft Edge to quickly get information about websites, videos, and more.