Explained: Why everyone’s talking about the Microsoft AI Copilot+ PCs

livemint.com:

earlier article in Lounge explained, an NPU is a dedicated AI processor, specifically designed to take some of the load off your computer’s CPU and GPU when handling AI-related workload. Essentially, in an AI PC, which will have more computing power and storage, you can run large language models (LLMs) locally. Such devices will not only save time, but, according to a Microsoft blog, also help with productivity and remove previous limitations such as latency, privacy, and cost.

This does not mean that the reliance on cloud computing is being sidelined entirely. As the Microsoft blog says, the best AI experiences will only be possible when the cloud and device work together in tandem. Whether it’s a smartphone or a new computer, every discussion today revolves around how fast the device can be.

The Microsoft Copilot+ PCs are equipped with a new system architecture that brings together the power of its CPU, GPU and NPU. Add to that LLMs running in its Azure Cloud along with its small language models (SLMs), these new Copilot+ PCs are expected to deliver powerful performance not seen in PCs before. “They are up to 20x more powerful and up to 100x as efficient for running AI workloads and deliver industry-leading AI acceleration.

They outperform Apple’s MacBook Air 15" by up to 58% in sustained multithreaded performance, all while delivering all-day battery life," Yusuf Mehdi, executive vice-president, consumer chief marketing officer, wrote in the Microsoft blog post. The devices will also have all-day battery life that will allow for longer hours of video playback and web browsing, among other things. According to Microsoft, the first Copilot+ PCs will launch with both the Snapdragon X Elite and Snapdragon X Plus