Research Archive

May 20, 2024 / Ben Bajarin and Max Weinbach

REPORT: Conclusions and Next Steps

NPUs (Neural Processing Units) are rapidly establishing themselves as the optimal platform for executing a diverse array of AI workloads, especially those requiring prolonged periods of inference. The unique architecture of NPUs, tailored specifically for neural network operations, guarantees efficient and high-performance processing. This architecture is adept at managing parallel computations, employing low precision arithmetic,…

May 20, 2024 / Ben Bajarin and Max Weinbach

REPORT: Copilot+ PCs and a New Category of AI PC

CoPilot+ PCs and a New Category of AI PC Personal computing is at a unique inflection point with generative AI.  Perhaps one we have not seen since the introduction of the graphical user interface. With a tremendous amount of excitement for AI enhanced software running on our computers, the NPU provides such an increase in…

May 20, 2024 / Ben Bajarin and Max Weinbach

REPORT: TOPS of the Morning to You

Given there is a new standard in measuring NPU performance capabilities, it is critical we have a better understanding of the relationship between NPU TOPS and the relationship of TOPS as a metric and AI performance. While we completely agree, TOPS is a difficult metric to measure real-world AI performance, we think of it in…

May 20, 2024 / Max Weinbach and Ben Bajarin

REPORT: The NPU Wattage Advantage

While all compute cores are capable of handling AI workloads, the NPU stands out the most here as its architecture allows it to run these AI workloads at significantly lower wattage than CPU and GPU cores. NPUs have power management technique advantages over the CPU and GPU, specifically on AI workloads. NPUs often include advanced…

May 20, 2024 / Ben Bajarin and Max Weinbach

REPORT: Developer Spotlight – Cephable

Developer Spotlight: Cephable Cephable is an accessibility software platform that allows users to control technology using various input methods beyond the traditional keyboard and mouse. Cephable’s software enables users to control computers, applications, and digital devices using alternative inputs like voice commands, facial expressions, head motions, body gestures, and virtual buttons. Their software makes computing…

May 20, 2024 / Ben Bajarin and Max Weinbach

REPORT: What Makes the NPU Unique

What Makes the NPU Unique Now that AI is front and center, the NPU has become more important than ever for computing devices.  But what differentiates the NPU and why is it better suited than CPUs and GPUs for many AI workloads? When looking specifically at the NPU’s role, it is its dedicated role on…

Trusted by 80% of the top 10 Fortune 500 technology companies