Nvidia unveils GH200 Superchips for 'most complex AI workloads'
%2Favatars%2FUy0OTzksC7lW.jpg&w=96&q=75)
%2F2023%2F08%2F10%2Fimage%2Fjpeg%2FNmiaXBjBelJfUTkSyg9i8wmIf8YzeJuU1aQW00zX.jpg&w=3840&q=75)
The world's leading supplier of chips for artificial intelligence (AI) applications, Nvidia, has unveiled its next generation of superchips created to handle the "most complex generative AI workloads," the company said in a press release. Dubbed GH200 GraceHopper, the platform also features the world's first HBM3e processor.
The new superchip has been designed by combining Nvidia's Hopper platform, which houses the graphic processing unit (GPU), with the Grace CPU platform, which handles the processing needs. Both these platforms were named in honor of Grace Hopper, a pioneer of computer programming, and by combining them into one pioneering superchip, Nvidia's homage to the great personality continues.
Traditionally, GPUs have been associated with high-end graphic processing in computers and gaming consoles. However, their superior computation abilities have been repurposed for applications such as cryptocurrency mining and, more recently, training AI models.
The power of large computers
Interesting Engineering has previously reported how service providers like Microsoft's Azure put together large computing systems using Nvidia's chips to cater to the needs of OpenAI.
Microsoft spent millions sourcing Nvidia's A100 chips but also built the necessary infrastructure to share the workload of large datasets for training the model. OpenAI used this to develop GPT models that powered the hugely popular ChatGPT.
As the manufacturer of these chips, Nvidia now wants to build such large data processing systems on its own. It has also launched the Nvidia MGX platform using which businesses can train and run their own AI models in-house.
During this time, Nvidia's GPU offering moved to the more powerful H100 Hopper chips, and the company is now strengthening its offering but combining them with CPU cores.
Grace Hopper GH200
Nvidia states that it has achieved the manufacture of its super chip by using its proprietary NVLink technology that allows chip-to-chip (C2C) interconnections. This helps the GPU gain full access to the CPU's memory and deliver 1.2 TB of fast memory in this configuration.
The GH200 also features the world's first HBM3e processor, 50 percent faster than the HBM3 used for computations today. The press release added that a single server consists of 144 Neoverse cores and can deliver eight petaflops of AI performance. With a combined bandwidth of 10TB/sec, the GH200 platform can process AI models that are 3.5 times larger and 3x faster than previous platforms from Nvidia.
The company that briefly joined the $1 trillion valuation club earlier this year is already the market leader with more than 90 percent market share in chips supply for AI and related applications.
GPUs are not just needed to train the AI models but also to run them after that. The demand for these chips is only expected to increase as AI becomes more mainstream, and it is hardly a surprise that not just chipmakers such as AMD but even tech giants like Google and Amazon are developing their offerings in this space.
With the GH200, Nvidia is stamping its authority as the leading technology provider. The chips are expected to be available to users in Q2 2024.
SHOW COMMENT (1)
/2023/09/21/image/jpeg/9yGfJEn6GlSnUjzawTrh9z6QZMlkjMyvjLQFY9Yc.jpg "Parker Solar Probe safely traverses CME event, touches Sun")
/2023/09/21/image/jpeg/CBVh8844CyZW0BUmphFlksoDPFxyFFKSmNCRoJFa.jpg "Motagua River: The most trashed river on earth")
/2023/09/21/image/jpeg/J311aOAku7MVx6I8d5F7GWxicqQaf2PHVMHzO5Va.jpg "This implant could free diabetics from insulin injections one day")
/2023/09/12/image/jpeg/7ZU03vLOnlFnHbET1pxVv2vlF9S2R5ZekupSiNl0.jpg "From lost wings to ruptured fuselages, 7 times planes refused to die")
/2023/07/21/image/jpeg/pwUEpl3SEm3I6iWC1XTLeopv0EMwhfrJ684imYyT.jpg "Are wines losing the battle against climate change?")
/2023/08/30/image/jpeg/Llkj2YI4zCWyQWM06dnC9PZHBRzZLT4na9uWmRXZ.jpg "Maybe you can hear sounds in space after all")
/2023/09/21/image/jpeg/noLW9uHoT66M08SaYrnHQczrj6gY0pqbhYQgBwUl.jpg "This lithium-free e-bike from Pi-Pop needs no batteries")
/2023/07/21/image/jpeg/pLferCk8t5wMCKUFU1Id8VrxUpXfkfQQafzzU4wc.jpg "Strangelets won't destroy the Earth, but are still spooky as hell")
/2023/09/21/image/jpeg/7Xe6g6S1Gw1S2LakvcR1Zc06ZqTnMdJZlaB4na0n.jpg "A rare canine disease is spreading to humans in the UK")
/2023/07/31/image/jpeg/rassNfpW1ruJqJTMdjJ7fLHEXtdOatgkJNgnGYyX.jpg "Using quantum computing to speed up optimization problems")