Microsoft is expanding the capabilities of Copilot within Windows 11 by introducing a wave of AI features. The update includes Copilot Vision, which can analyze content displayed on the screen. This will allow users to interact with the AI to understand and act upon on-screen information, including across multiple applications. Beyond analysis, Copilot will also be able to perform tasks such as enhancing images. The blog post states a gradual rollout plan, and some features are exclusive to Copilot Plus PCs, including the ‘Click to Do’ preview. Holding the Windows key and clicking on an element can trigger AI actions. Alongside these, new features like an AI sticker generator in Paint, an object select tool, AI lighting for Photos, and an AI screenshot tool are being added. These enhancements are expected to begin rolling out in August, coinciding with the release of other non-AI updates such as a color picker in the Snipping Tool.
