Nvidia on Monday announced a new generation of artificial intelligence chips and software for running AI models.
The announcement comes as companies and software makers still scramble to get their hands on the current generation of H100s and similar chips.Nvidia CEO Jensen Huang delivers a keynote address during the Nvidia GTC Artificial Intelligence Conference at SAP Center on March 18, 2024 in San Jose, California.on Monday announced a new generation of artificial intelligence chips and software for running artificial intelligence models.
“Hopper is fantastic, but we need bigger GPUs,” Nvidia CEO Jensen Huang said on Monday at the company's developer conference in California. Das said Nvidia's new software will make it easier to run programs on any of Nvidia's GPUs, even older ones that might be better suited for deploying but not building AI.
Nvidia says Blackwell-based processors, like the GB200, offer a huge performance upgrade for AI companies, with 20 petaflops in AI performance versus 4 petaflops for the H100. The additional processing power will enable AI companies to train bigger and more intricate models, Nvidia said. Nvidia said that the system can deploy a 27-trillion-parameter model. That's much larger than even the biggest models, such as GPT-4, which reportedly has 1.7 trillion parameters. Many artificial intelligence researchers believe bigger models with more parameters and data
NIM makes it easier to use older Nvidia GPUs for inference, or the process of running AI software, and will allow companies to continue to use the hundreds of millions of Nvidia GPUs they already own. Inference requires less computational power than the initial training of a new AI model. NIM enables companies that want to run their own AI models, instead of buying access to AI results as a service from companies like OpenAI.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
The AI industry’s MVP right now is a CEO who believes that success requires ‘pain and suffering’A look at the life and philosophy of Nvidia CEO Jensen Huang, whose company makes the chips powering the AI revolution.
Read more »
Success requires ‘ample doses of pain,' billionaire Nvidia CEO tells Stanford students: ‘I hope suffering happens to you'“Greatness comes from character,” says billionaire Nvidia CEO Jensen Huang. He told Stanford students that coping and building resilience is key to…
Read more »
Nvidia CEO is $9.6B richer as AI chipmaker's stock soarsNvidia CEO Jensen Huang posted a $9.6 billion increase in his net worth Thursday. The increase coincided with the chip maker's stock seeing a jump of its own.
Read more »
Nvidia's CEO has an extensive, rich real estate portfolioJensen Huang has seen major success with Nvidia and, according to the Wall Street Journal, invested some of it in properties for him and his family over the years.
Read more »
Nvidia CEO Wishes 'Pain and Suffering' on Young PeopleScience and Technology News and Videos
Read more »
When our modern-day DaVinci speaks, I listen. Here's what I plan to do when Nvidia CEO Jensen Huang steps up to the mic this weekJensen's speech at Nvidia's annual GTC developers conference on Monday will be a transformative moment.
Read more »