PGC NEWS

At Computex 2024, AMD outlined its latest CPU, NPU, and GPU architectures powering a comprehensive AI infrastructure spanning from data centers to PCs. AMD announced an expanded roadmap for AMD Instinct™ accelerators, introducing an annual refresh cadence for its leading AI accelerators, including the new AMD Instinct MI325X accelerator with industry-leading memory capacity, expected in Q4 2024. AMD also previewed the 5th Gen AMD EPYC™ server processor, launching in the second half of 2024, with leading performance and efficiency. Additionally, AMD announced the AMD Ryzen™ AI 300 Series processors, the third generation of AMD’s AI-enabled mobile processors, and the AMD Ryzen 9000 Series processors for laptops and desktops.

“This is an incredibly exciting time for AMD as the rapid and accelerating adoption of AI is driving increasing demand for our high-performance computing platforms,” said Dr. Lisa Su, Chair and CEO. “At Computex, we are proud to join with Microsoft, HP, Lenovo, Asus and other strategic partners to launch our next generation Ryzen desktop and mobile processors, preview the leading performance of our next generation EPYC processors and announce an annual refresh cadence for AMD Instinct AI accelerators.”

“We are in the midst of a massive platform shift in AI, with the promise to reshape how we live and work. That’s why our deep partnership with AMD, which has spanned across multiple computing platforms from PCs to custom silicon for Xbox and now AI, is so important to us,” said Satya Nadella, Chairman and CEO of Microsoft. “We’re excited to partner with AMD to bring you these new Copilot+ PCs powered by this new Ryzen AI. We are committed to working closely with AMD, and we will continue to push AI advancements together moving forward across cloud and edge to deliver new value to our joint customers.”

AMD's Dr. Lisa Su at Computex 2024

AMD Accelerates Data Center AI Innovation with Expanded Instinct GPU Roadmap

AMD showcased the momentum of its AMD Instinct™ accelerator line during Dr. Lisa Su’s keynote. AMD announced a multi-year expanded AMD Instinct accelerator roadmap, delivering an annual refresh cadence of leading AI performance and memory capabilities with each generation. The refresh cadence begins with the new AMD Instinct MI325X accelerator, launching in Q4 2024. This will be followed by the AMD Instinct MI350 Series, powered by the new AMD CDNA™ 4 architecture, expected to launch in 2025, delivering a projected 35x increase in AI inference performance over the AMD Instinct MI300 Series with AMD CDNA 3 architecture. Expected to launch in 2026 is the AMD Instinct MI400 series based on the AMD CDNA “Next” architecture.

“The AMD Instinct MI300X accelerator continues to see strong adoption across a wide range of partners and customers, including Microsoft Azure, Meta, Dell Technologies, HPE, Lenovo and others, as a direct result of the AMD Instinct MI300X accelerator’s superior performance and value proposition,” said Brad McCredie, corporate vice president, Data Center Accelerated Computing, AMD. “With an annual product cadence, we’re continuing to innovate, delivering the leading capabilities and performance the AI industry and our customers have come to expect to drive the next evolution of data center AI training and inference.”

Mature AMD AI Software Ecosystem

The open AMD ROCm™ 6 software stack continues to mature, enabling the AMD Instinct MI300X accelerator to deliver impressive performance for some of the most popular LLMs. On a server using eight AMD Instinct MI300X accelerators and ROCm 6 running Meta Llama-3 70B, customers can achieve 1.3x better inference performance and token generation compared to the competition. On a single AMD Instinct MI300X accelerator with ROCm 6, customers can get over 1.2x better inference performance and token generation throughput on Mistral-7B versus the competition. AMD also highlighted that Hugging Face, the largest and most popular repository for AI models, is now testing their 700,000 most popular models nightly to ensure they run well on the AMD Instinct MI300X accelerator. Additionally, AMD is continuing its upstreaming work into popular AI frameworks like PyTorch, TensorFlow, and JAX.

Microsoft CEO Satya Nadella also highlighted how the AMD Instinct MI300X accelerator delivers leading price/performance on GPT-4 inference for Microsoft Azure workloads.

AMD Previews New Accelerators and Unveils Annual Cadence Roadmap

During the keynote, AMD unveiled an annual refresh cadence for the AMD Instinct accelerator roadmap to meet the growing need for more AI compute capabilities. This will help ensure that AMD Instinct accelerators drive the development of next-generation, cutting-edge AI models. The updated annual AMD Instinct roadmap highlights:

• The new AMD Instinct MI325X accelerator, which will deliver 288GB of HBM3E memory and 6 terabytes per second of memory bandwidth, utilizing the same industry-standard Universal Baseboard server design used by the AMD Instinct MI300 series and generally available in Q4 2024. The AMD Instinct MI325X accelerator will feature industry-leading memory capacity and bandwidth, 2x and 1.3x better than the competition respectively, and 1.3x better compute performance than the competitive product.
• The first product in the AMD Instinct MI350 Series, the AMD Instinct MI350X accelerator, is based on the AMD CDNA 4 architecture and is expected to launch in 2025. It will utilize the same industry-standard Universal Baseboard server design as other MI300 Series accelerators and will be built using advanced 3nm process technology, support FP4 and FP6 AI data types, and feature up to 288GB of HBM3E memory.
• The AMD CDNA “Next” architecture, which will power the AMD Instinct MI400 Series accelerators, expected to launch in 2026, delivering the latest features and capabilities that enhance performance and efficiency for large-scale AI inference and training.

Finally, AMD emphasized the continued demand for the AMD Instinct MI300X accelerator as more partners and customers use it to power their demanding AI workloads, including:

Previewed today at Computex, the 5th Gen AMD EPYC processor (codenamed “Turin”) will leverage “Zen 5” cores and continue the performance and efficiency leadership of the AMD EPYC processor line. The 5th Gen AMD EPYC processor is expected to launch in the second half of 2024.

Next-Gen Ryzen 9000 Series Processors with Zen 5 Architecture for Enhanced AI Experiences

AMD announced a series of breakthrough next-generation products and architectures ushering in a new era of AI experiences. AMD is introducing the new AMD Ryzen™ AI 300 Series processors with the world’s most powerful Neural Processing Unit (NPU) for next-generation AI PCs, paving the way for a future full of AI-infused capabilities integrated directly into your laptop. AMD is also introducing next-generation AMD Ryzen 9000 Series processors for desktops, continuing to solidify its leadership position in performance and efficiency for gamers, creators, and professional consumers. These new processors add to the rich portfolio of AI-enabled products in the cloud, edge, client, and beyond.

AMD Ryzen AI 300 Series Processor Diagram

The AMD Ryzen AI 300 Series processors are Copilot+ ready, unlocking a world of new AI experiences on next-generation AI laptops. Built on the new AMD XDNA™ 2 architecture, this new NPU provides 50 TOPS of AI processing power, exceeding Copilot+ AI PC requirements, with 3x the AI engine performance over the second generation of AMD Ryzen AI and up to 2x projected energy efficiency for synthetic AI workloads over the previous generation. The NPU based on AMD XDNA 2 architecture is the industry’s first and only NPU to support the advanced Block FP16 data type, which delivers higher accuracy than lower precision data types used by competing NPUs without sacrificing performance. Powered by the new “Zen 5” architecture, these processors are equipped with up to 12 high-performance CPU cores with 24 threads and more than 50% more on-chip L3 cache than the previous generation “Zen 4” processors for thin and light laptops. With advanced AI architecture and supercharged performance for elite gaming and productive work, the third-generation Ryzen AI Series delivers the ultimate intelligent, private, responsive, and insightful laptop computing experience.

For desktops, the new AMD Ryzen 9000 Series desktop processors represent a significant leap forward, offering users cutting-edge computing power and reliability. Built upon the latest “Zen 5” architecture, the AMD Ryzen 9000 Series desktop processors deliver an impressive 16% average IPC performance improvement over the “Zen 4” architecture of the previous generation Ryzen processors, with the flagship Ryzen 9 9950X, the Ryzen 9000 Series delivers the world’s fastest consumer desktop performance. “We’re thrilled to introduce the Ryzen 9000 Series, the world’s most powerful desktop processor for gamers and creators, as well as the 3rd Gen AMD Ryzen AI processors, delivering leading AI and compute performance for ultra-thin and premium CoPilot+ PCs,” said Jack Huynh, senior vice president and general manager, Client and Graphics Group at AMD. “The AMD Ryzen AI 300 Series processors push the limits of what’s possible with the fastest APU performance, the world’s most powerful NPU with 50 TOPS and the world’s first block floating point NPU doubling the performance of 16-bit applications without sacrificing accuracy.”

AMD Ryzen™ AI 300 Series Processors Deliver Ultimate Performance and AI-Powered Productivity

The AMD Ryzen AI 300 Series features up to 12 high-performance “Zen 5” cores and 24 threads, delivering lightning-fast performance on premium ultra-thin laptops. With a dedicated AI engine built on the new AMD XDNA 2 architecture, the Ryzen AI series elevates productivity and creativity by efficiently handling local AI workloads, content creation, and workflow automation, all while maintaining outstanding power efficiency. Featuring the new AMD RDNA™ 3.5 graphics architecture, these processors come equipped with the latest AMD Radeon™ 800M Series graphics designed to deliver smooth frame rates and AAA gaming experiences. Together, “Zen 5”, AMD XDNA 2, and AMD RDNA™ 3.5 graphics deliver next-generation AI experiences in laptops equipped with AMD Ryzen AI 300 Series processors.

AMD Ryzen AI 300 Series Laptops

The AMD Ryzen™ AI 300 Series processors redefine laptop computing with the following key features:

• Unmatched Performance: The AMD Ryzen AI 300 Series processors deliver lightning-fast performance for intensive multitasking, immersive gaming, and serious content creation, enabling users to tackle demanding tasks with ease.
• Privacy-focused and Responsive AI: Experience the power of personalized AI with AMD Ryzen AI, designed to efficiently handle local AI workloads. From boosting productivity to automating workflows, AMD AI enhances responsiveness and creativity, allowing users to seamlessly create content and accelerate tasks.
• Exceptional Battery Life: Enjoy premium gaming and productivity on the go without compromise thanks to the efficiency of the AMD Ryzen AI 300 Series processors.
• Console-class Gaming on the Go: The integrated AMD Radeon 800M graphics are the world’s best graphics for gaming, ensuring a top-tier gaming experience with high frame rates and ultra-low latency.

AI Ecosystem Support

Working closely with industry partners, AMD is accelerating the next generation of AI computing to unlock the future for AI-powered experiences from productivity and content creation to gaming and entertainment. OEM partners including Acer, ASUS, HP, Lenovo and MSI are announcing more AI PCs powered by AMD Ryzen AI 300 Series processors and ecosystem partners like Microsoft and Zoom are collaborating closely with AMD to expand the capabilities of AI PCs.

On stage at Computex, ecosystem partners demonstrated how they are collaborating with AMD to unlock new AI experiences for the PC. Microsoft highlighted its long-standing partnership with AMD and announced that the AMD Ryzen AI 300 series processors exceed Microsoft’s Copilot+ PC requirements. HP announced new AMD-powered Copilot+ PCs, including the HP Pavilion Aero and showcased Stable Diffusion XL Turbo image generator running locally on HP laptops powered by Ryzen AI 300 Series processors. Lenovo revealed upcoming consumer and commercial laptops powered by Ryzen AI 300 Series processors and highlighted how they are leveraging AMD AI to activate new Lenovo AI software. Asus showcased a diverse portfolio of AI PCs for business users, consumers, creators, and gamers powered by Ryzen AI 300 Series processors.

“We are in the midst of a massive platform shift in AI, with the promise to reshape how we live and work. That’s why our deep partnership with AMD, which has spanned across multiple computing platforms from PCs to custom silicon for Xbox and now AI, is so important to us,” said Satya Nadella, Chairman and CEO of Microsoft. “We’re excited to partner with AMD to bring you these new Copilot+ PCs powered by this new Ryzen AI. We are committed to working closely with AMD, and we will continue to push AI advancements together moving forward across cloud and edge to deliver new value to our joint customers.”

“AI is continuing to reshape customer expectations for PCs across gaming, content creation, professional, and everyday use,” said Jerry Kao, COO, Acer Inc. “With AMD, we’re delivering more AI-powered experiences to our customers with unprecedented power and performance. In the coming months, we are excited to announce new systems powered by AMD Ryzen AI 300 Series processors.”

“As AI PCs continue to evolve, we’re working to ensure users have the best hardware and software to support current and future AI capabilities,” said ASUS Co-CEO, S.Y. Hsu. “Working with AMD, we will be announcing new systems equipped with AMD Ryzen AI 300 Series processors, including the ROG Zephyrus G16, ProArt P16 and PX13, Zenbook S 16, ASUS Vivobook S 14, S 15 and S 16, and TUF Gaming A14 and A16. Together, we are providing users with the best processing power needed to take advantage of emerging AI applications.”

“In the age of AI, HP is committed to delivering personalized experiences that drive greater productivity and growth for everyone,” said Enrique Lores, Chairman and CEO, HP. “HP’s AI PCs bring the benefits of AI to the device securely. Later this year, through our partnership with AMD, we will introduce our next OmniBook AI PC. Its powerful performance and portability will further elevate the experience and help our customers navigate a hybrid world.”

“Long-standing, strong partnerships like the one with AMD are always at the core of Lenovo’s strategy to bring smarter technology and AI to everyone,” said Luca Rossi, President of Lenovo’s Intelligent Devices Group. “Later this year, we’ll be launching Lenovo AI laptops with 3rd Gen Ryzen AI processors for consumers through our premium Yoga brand, for commercial customers through the legendary ThinkPad, and for SMBs through our refined ThinkBook line-up. Whether you’re a creator, a business professional, or a budding entrepreneur, Lenovo will have one of the widest portfolios of AI devices with industry-leading TOPS performance for you.”

“At MSI, we strive to expand the possibilities of what technology can do and the new AMD Ryzen AI 300 Series processors offer the performance needed to drive AI PC innovation,” said Eric Kuo, Executive Vice President & NB BU GM, MSI. “We are excited to announce the latest MSI AI PCs powered by AMD including the Stealth A16 AI+, Summit A16 AI+, Prestige A16 AI+ and Creator A16 AI+.”

“Zoom has been at the forefront of utilizing AI to enhance our customers’ collaboration and productivity experiences through our AI-powered assistant, Zoom AI Companion,” said Xuedong Huang, CTO, Zoom. “We are working closely with AMD to deliver enhanced Zoom Meetings and AI Companion features that can run locally on their powerful, energy-efficient 3rd Gen Ryzen AI platform to further elevate the Zoom user experience.”

AMD Ryzen 9000 Series Desktop Processors Deliver World-Class Gaming and Creation Performance

For gamers yearning for the ultimate competitive edge, AMD Ryzen 9000 Series desktop processors deliver exceptional performance, enabling smooth gameplay and high frame rates across a wide range of titles, from AAA blockbusters to beloved esports games. Moreover, professional content creators can now unlock the full potential of their creative process with AMD Ryzen 9000 Series desktop processors. From 3D modeling and design to animation and product visualization, these processors deliver superior single- and multi-threaded performance, allowing users to design, render, and iterate faster than ever before. Simply put, the flagship Ryzen 9 9950X CPU is the fastest consumer desktop processor. The new Ryzen 9000 Series desktop processors are expected to be available to DIY customers and SI partners beginning in July 2024.

AMD Ryzen 9000 Series CPU

The Socket AM5 motherboard lineup features two new chipsets. Designed to seamlessly integrate with AMD Ryzen 9000 Series desktop processors, the new AMD X870E and X870 chipsets boast support for the latest technologies, such as PCIe® 5.0, DDR5, USB4, and WIFI 7. The AM5 socket platform is built to last with support through 2027 and beyond. These new chipsets feature USB4 as a standard feature and are also designed to support even faster DDR5 memory overclocking using AMD EXPO™ technology.

Both the X870 and X870E feature a total of 44 PCIe lanes and direct PCIe 5.0 NVMe connections to the Ryzen 9000 Series processors for maximum transfer speeds. The X870E differentiates itself with 24 PCIe 5.0 lanes, including 16 dedicated to graphics. When direct-to-processor PCIe 5.0 graphics and storage are enabled simultaneously, the X870E delivers double the bandwidth compared to competitive platforms making it the best supporting platform for Ryzen 9000 Series CPUs.

New AMD Ryzen™ 5000 Series Desktop Processors Extend the Life of the AM4 Platform

Alongside the Ryzen 9000 Series CPUs, AMD continues its unprecedented support for the AM4 platform with two new additions to the Ryzen 5000 Series desktop processor lineup: the AMD Ryzen™ 9 5900XT and Ryzen 7 5800XT desktop processors.

The new Ryzen 5000 series desktop processors are expected to be available to DIY customers and SI partners beginning in July 2024.

AMD Radeon™ PRO W7900 Dual Slot Workstation Graphics Card and AMD ROCm™ 6.1 for Radeon™ GPUs – Making AI Development More Accessible

AMD also announced the AMD Radeon™ PRO W7900 Dual Slot workstation graphics card. It’s optimized for multi-GPU enabled, high-performance platforms, delivering up to 38% better performance per dollar at Llama 3 70B Q4 vs. the competition with the ability to fit the 70B parameter model on a single GPU frame buffer. Empowering developers to conduct AI development locally, it’s the ideal solution for extreme-performance AI workstations while keeping sensitive data in-house.

AMD also announced AMD ROCm™ 6.1 for AMD Radeon™ GPUs to make AI development and deployment with compatible AMD Radeon™ desktop GPUs more portable, accessible, and scalable. It supports up to four qualifying AMD Radeon™ RX or Radeon™ PRO GPUs, offers beta support for the Windows® Subsystem for Linux® (WSL 2), allowing users to run Linux-based AI tools on Windows® systems, and more. The AMD Radeon™ PRO W7900 Dual Slot graphics card and AMD ROCm™ 6.1 are expected to be available beginning June 19, 2024.

Driving the Next Wave of AI Innovation

AMD showcased how its AI and adaptive computing technology is driving the next wave of AI innovation at the edge. Only AMD combines all the necessary IP to accelerate AI application across the entire edge. The new AMD Versal™ AI Edge Series Gen 2 brings together programmable FPGA logic for real-time pre-processing, next-gen AI Engines powered by XDNA technology for efficient AI inferencing, and embedded CPUs for post-processing to deliver the highest performance single-chip adaptive solution for edge AI. AMD Versal AI Edge Gen 2 devices are available now for early access with more than 30 key partners currently in development.