Research Archive

June 3, 2024 / Max Weinbach

AMD Computex 2024 Keynote: New AI-Driven CPUs and GPUs for the Future

At Computex 2024, AMD painted a comprehensive vision for the future of AI computing, addressing everything from the cloud to the edge. The company’s rapid pace of innovation across CPUs, GPUs, AI accelerators and adaptive computing shows no signs of slowing down. By moving to an annual cadence of Instinct MI accelerators, AMD is putting…

June 2, 2024 / Ben Bajarin

Dell Technologies: Seizing the AI Server Opportunity

Dell Technologies is making significant strides in the AI server market, as evidenced by its recent earnings reports. We provide some of the key drivers of Dell’s success in this segment, the opportunities ahead, and the potential challenges that could impact its growth trajectory. Growth in AI Server Demand     Log in to keep…

May 20, 2024 / Ben Bajarin / Max Weinbach

REPORT: Conclusions and Next Steps

NPUs (Neural Processing Units) are rapidly establishing themselves as the optimal platform for executing a diverse array of AI workloads, especially those requiring prolonged periods of inference. The unique architecture of NPUs, tailored specifically for neural network operations, guarantees efficient and high-performance processing. This architecture is adept at managing parallel computations, employing low precision arithmetic,…

May 20, 2024 / Ben Bajarin / Max Weinbach

REPORT: Copilot+ PCs and a New Category of AI PC

CoPilot+ PCs and a New Category of AI PC Personal computing is at a unique inflection point with generative AI.  Perhaps one we have not seen since the introduction of the graphical user interface. With a tremendous amount of excitement for AI enhanced software running on our computers, the NPU provides such an increase in…

May 20, 2024 / Ben Bajarin / Max Weinbach

REPORT: TOPS of the Morning to You

Given there is a new standard in measuring NPU performance capabilities, it is critical we have a better understanding of the relationship between NPU TOPS and the relationship of TOPS as a metric and AI performance. While we completely agree, TOPS is a difficult metric to measure real-world AI performance, we think of it in…

May 20, 2024 / Max Weinbach / Ben Bajarin

REPORT: The NPU Wattage Advantage

While all compute cores are capable of handling AI workloads, the NPU stands out the most here as its architecture allows it to run these AI workloads at significantly lower wattage than CPU and GPU cores. NPUs have power management technique advantages over the CPU and GPU, specifically on AI workloads. NPUs often include advanced…

Trusted by 80% of the top 10 Fortune 500 technology companies