Microsoft Unveils Copilot Plus PCs with Advanced AI Capabilities in Windows 11

Microsoft has recently unveiled its Copilot Plus PCs, integrating advanced AI capabilities directly into Windows 11. This innovation is powered by over 40 AI models running on Windows 11, facilitated by the new Windows Copilot Runtime. This development was detailed at the Microsoft Build conference, highlighting the runtime’s library of APIs, AI frameworks, and toolchains that enable developers to incorporate their own on-device models into Windows applications.

Windows and Surface chief, Pavan Davuluri, introduced the Windows Copilot Library, which offers developers access to AI APIs for features like Studio Effects, Live Captions Translations, OCR, and more, set to be available in June. This library allows for the integration of various functionalities, including filters and portrait blur, into third-party apps. Notably, Meta plans to incorporate Windows Studio Effects into WhatsApp, enhancing video calls with background blur and eye contact features.

Microsoft also showcased its Recall AI feature, designed to document and store PC activities, enabling users to search through a timeline of their actions. This feature relies on the new Windows Semantic Index that stores data locally. Developers will be given tools to create similar functionalities within their apps, utilizing the Vector Embeddings API for building their own vector store and RAG.

Furthermore, developers can enhance the Recall feature by adding contextual information to their apps, improving user engagement and the seamless integration between Windows and third-party applications. These advancements are part of Microsoft’s broader strategy to lay the groundwork for more AI-powered apps, leveraging new Arm-powered systems and upcoming NPUs from AMD and Intel. Microsoft aims to position Windows as the most open platform for AI development, marking a significant moment in the company’s focus on AI for the future of Windows development.