At Computex 2024, AMD painted a comprehensive vision for the future of AI computing, addressing everything from the cloud to the edge. The company’s rapid pace of innovation across CPUs, GPUs, AI accelerators and adaptive computing shows no signs of slowing down. By moving to an annual cadence of Instinct MI accelerators, AMD is putting the pedal to the metal to meet the insatiable demand for AI compute.

But perhaps the most exciting and tangible part of AMD’s Computex announcements was on the client side. The upcoming Ryzen AI 300 Series mobile processors and Ryzen 9000 Series desktop CPUs promise to put serious AI capabilities in the hands of mainstream consumers and commercial users.

The Ryzen AI 300 Series marks AMD’s 3rd generation of AI-enabled laptop processors. By combining the latest Zen 5 CPU cores, RDNA 3.5 graphics, and the cutting-edge XDNA 2 neural processing unit, these SoCs are poised to deliver a massive leap in on-device AI performance and efficiency.

The XDNA 2 NPU itself is a significant milestone, packing 50 TOPS of AI compute and introducing support for the innovative Block FP16 data format. AMD claims this enables higher precision AI vs competing mobile NPUs without compromising performance. Considering the 50 TOPS figure eclipses the AI horsepower in Apple’s M3 and Qualcomm’s Snapdragon chips, AMD appears to have a strong play for leadership in the red-hot AI laptop market.

On the desktop, the new Ryzen 9000 Series processors bring the Zen 5 architecture to enthusiasts and content creators. The flagship 16-core Ryzen 9 9950X, which AMD boldly deems the world’s fastest desktop CPU, should significantly elevate the performance bar for heavy workloads. With a max boost clock of 5.7GHz, the 9950X looks primed to snatch the gaming and productivity performance crown from Intel in the near term.

Beyond the silicon, it was encouraging to see AMD flanked on stage by key partners like Microsoft, HP, Lenovo and Asus. All these tech giants are rallying around AMD’s vision to bring more intelligent, personalized computing experiences to users through local AI processing.

Microsoft’s vote of confidence that Ryzen AI 300 Series will power a new generation of Copilot+ PCs is a strong endorsement of AMD’s AI technologies. The software giant’s Chairman and CEO Satya Nadella highlighted the transformative potential of the AMD partnership across cloud, edge and now AI. The fact that Microsoft is already using AMD Instinct MI300X accelerators to deliver leading price/performance for Azure GPT-4 workloads speaks volumes.

Looking up the stack to the data center, AMD continues to execute on its ambitious server roadmaps. The preview of 5th Gen EPYC “Turin” processors shows that AMD is not standing still after capturing over 30% of the server CPU market. By leveraging the Zen 5 core and promising leadership performance and efficiency, Turin aims to extend AMD’s momentum in the cloud and enterprise. Availability in the second half of 2024 sets the stage for an exciting showdown with Intel’s Granite Rapids Xeons.

On the AI accelerator front, AMD is making a bold commitment to an annual cadence of leadership Instinct MI products. The MI325X coming later this year ups the ante with a massive 288GB of ultra-fast HBM3E memory. And AMD is already charting an ambitious course for the future with CDNA 4 and CDNA Next architectures in 2025 and 2026, respectively. The projected 35X inference speedup of CDNA 4 over the current MI300 series is staggering if it pans out.

Lastly, AMD’s Versal AI Edge portfolio showcases the company’s differentiated ability to combine adaptive computing, AI engines, and CPU cores to accelerate full edge workloads. With the Versal AI Edge Gen 2 series sampling to over 30 early access partners, AMD is staking its claim in the nascent edge AI market. Versal design wins powering everything from genome sequencing to automotive ADAS show the architecture’s versatility.

Zooming out, Computex 2024 provided the clearest evidence yet of AMD’s multi-pronged, full-stack approach to AI computing. From the Ryzen AI 300 Series bringing serious on-device AI to laptops, to the Instinct MI300X powering Azure GPT-4 instances in the cloud, AMD is firing on all cylinders. With an annual cadence of leadership products across CPUs, GPUs, and AI accelerators, the company shows no signs of slowing down.

The partnerships and customer testimonials highlighted at Computex are perhaps just as important as the silicon itself. Broad ecosystem support is critical for democratizing access to cutting-edge AI technologies. In that respect, AMD’s collaborations with Microsoft, HP, Lenovo, Asus, and others to enable intelligent, personalized computing experiences is highly encouraging.

The age of pervasive AI computing is upon us. And with its comprehensive portfolio, robust roadmap, and deep partnerships, AMD is positioning itself as a key enabler of this paradigm shift from the cloud to the edge. The next few years will be a fascinating time as AMD’s technologies make AI more accessible and personal than ever before. Buckle up, it’s going to be an exciting ride.

---

Key Takeaways:
– AMD unveiled new leadership CPU, NPU and GPU architectures powering end-to-end AI infrastructure from the data center to PCs at Computex 2024.
– The expanded AMD Instinct accelerator roadmap introduces an annual cadence of leadership AI accelerators, including the new MI325X accelerator planned for Q4 2024.
– AMD previewed 5th Gen EPYC server processors with Zen 5 cores, on track for 2H 2024 launch, promising leadership performance and efficiency.
– New AMD Ryzen AI 300 Series laptop and Ryzen 9000 Series desktop processors deliver leading performance for AI, gaming, content creation and productivity.

Summary of News:

– AMD introduced an expanded multi-generational roadmap for its Instinct AI accelerators, moving to an annual cadence of leadership products. The MI325X accelerator, coming in Q4 2024, will deliver industry-leading 288GB HBM3E memory capacity.

– A preview of 5th Gen EPYC “Turin” server CPUs was shared, leveraging the Zen 5 core and continuing EPYC’s leadership performance and efficiency. The processors are on track for 2H 2024 availability.

– For PCs, AMD announced Ryzen AI 300 Series mobile processors, its 3rd generation of AI-enabled laptop chips. The SoCs combine Zen 5 CPU cores, XDNA 2 NPU, and RDNA 3.5 graphics to power next-gen AI experiences.

– The XDNA 2 NPU delivers 50 TOPS of AI performance and is the first to support the advanced Block FP16 data format for higher accuracy without sacrificing performance vs competitors.

– AMD Ryzen 9000 Series desktop CPUs were unveiled, based on the Zen 5 architecture. The flagship 16-core Ryzen 9 9950X was claimed as the world’s fastest desktop processor.

– Several key OEM and software partners joined AMD on stage to showcase their upcoming AMD-powered AI laptops and experiences, including Microsoft, HP, Lenovo and Asus. The Ryzen AI 300 Series will power a new generation of Copilot+ PCs.

– On the edge AI front, AMD Versal AI Edge Series Gen 2 adaptive SoCs are now sampling to over 30 early access partners. Versal combines programmable logic, AI engines, and CPUs to accelerate full edge AI applications.

What’s Significant:
AMD’s announcements at Computex 2024 demonstrate its strong commitment to advancing AI and high-performance computing across the entire technology stack, from the cloud to the edge. The company is aggressively pushing an annual cadence of leadership AI accelerators to meet the rapidly growing demand driven by generative AI.

AMD’s close collaboration with key partners like Microsoft, HP, Lenovo and Asus to enable intelligent, personalized PC experiences powered by Ryzen AI highlights the industry-wide shift towards pervasive AI. The new Ryzen processors with dedicated AI engines mark an inflection point that is expected to significantly drive PC demand in the coming years.

On the datacenter front, AMD continues to make strides with its next-gen EPYC processors and Instinct accelerators. The 35x projected AI inference boost of CDNA 4 over the current MI300 series shows AMD is not slowing down its pace of innovation. Microsoft’s endorsement of MI300X’s leading price/performance further validates AMD’s datacenter AI strategy.

Join the newsletter and stay up to date