With its new releases at the Advancing AI 2024 event, AMD has positioned itself as a legitimate competitor to Nvidia in enterprise and hyperscaler AI in the datacenter.
AMD held its Advancing AI 2024 event last week, where it launched its latest datacenter silicon—the 5th Generation EPYC processor and the MI325X AI accelerator. On the networking front, the company introduced Pensando Salina and Pensando Pollara to address front-end and back-end networking, respectively. As the silicon market gets hotter and hotter, AMD ’s launches have become increasingly anticipated. Let’s dig into what AMD launched and what it means for the industry.
For AMD, the integration of CPU with GPU is the company’s answer to the challenges faced by enterprise IT and hyperscalers alike. This integration accelerates the creation, cleansing, training and deployment of AI across the enterprise.To meet the entire range of datacenter needs, AMD designed two EPYC Zen 5 cores—the Zen 5 and Zen 5c. The Zen 5, built on a 4nm process, is the workhorse CPU designed for workloads such as database, data analytics and AI.
By comparison, Intel’s Xeon 6E scales up to 144 cores with 12 DDR5 memory channels and 96 lanes of PCIe Gen 5. However, in the first quarter of 2025, Intel will launch its second wave of Xeon 6E, which will scale up to 288 cores. Xeon 6P supports multiplex ranked memory that can boost memory throughput to 8,800 MT/s. So far, I have not seen that AMD is supporting this. To be clear, MRDIMM will not be used for traditional datacenter workloads.Xeon 6P has discrete accelerators integrated into its compute complex to speed up workloads such as AI and database.of benchmarks most closely and objectively measures a CPU’s core performance. In this test, the 5th Gen EPYC significantly outperforms the 5th Gen Xeon.
Over the following few quarters, AMD went on to secure large cloud-scale wins with the likes of Meta, Microsoft Azure, Oracle Cloud Infrastructure and the largest independent cloud provider, Vultr, to name a few. This is important because these cloud providers modified their software stacks to begin the effort of supporting Instinct GPUs out of the box. No more optimizing for CUDA and “kind of” supporting ROCm—this is full-on native support for the AMD option.
Second, the AMD Pensando Pollara 400 represents a leap forward in the design of NICs. It is purpose-built for AI workloads, with an architecture based on the latest version of RDMA that can directly connect to host memory without CPU intervention. AMD claims that this new NIC, which employs unique P4 programmability and supports 400G interconnect bandwidth, can provide up to 6x improvement in performance when compared to legacy solutions using RDMA over Converged Ethernet version 2.
AI Nvidia Turin CPU GPU Enterprise AI Data Center Datacenter
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Boomer blames his generation for Gen Z's lazy work ethic: 'Spoiled by my generation'Today's Video Headlines: 10/14/24
Read more »
Prince William Empowers Next Generation of Filmmakers in Special Crossover EventPrince William attended an event co-hosted by both BAFTA and the Royal African Society that showcased the importance of supporting young people in film, television and games industries.
Read more »
The Pitch: Patient Safety's Next Generation Review - Stunning Doc Explores Technology's Place In HealthcareAn insightful documentary.
Read more »
Study shows artificial light at night changes the behavior of fish, even into the next generationScientists have shown that light pollution—especially light in the blue spectrum—can alter the behavior of fish after only a few nights, and have knock-on effects for their offspring.
Read more »
The next generation of Buffetts is poised to become one of the biggest forces in philanthropyWhen the legendary businessman and leader of Berkshire Hathaway, Warren Buffett, eventually passes away, the next generation of Buffetts — Howard, Susie and Peter — are poised to become one of the most powerful forces in philanthropy.
Read more »
How the next generation of semiconductor factories kicked up a fight over environmental reviewAs the Biden administration pushes to revive the US semiconductor industry, lawmakers want to exempt new factories from a bedrock environmental law.
Read more »