New chip on the block: Broadcom's Jericho3-AI can connect up to 32,000 GPU chips
%2Favatars%2FEwuSxftyWaVt.png&w=96&q=75)
%2F2023%2F04%2F19%2Fimage%2Fjpeg%2FJ4mTRNcM7FVnvDo92meRbGELFKftTy2r86DfEOoD.jpg&w=3840&q=75)
American semiconductor manufacturing company Broadcom Inc. has released a new chip Jericho3-AI, which is being touted by the company as the highest-performance fabric for artificial intelligence (AI) networks. The new chip will wire together supercomputers.
Jericho3-AI is packed with features like improved load balancing - which ensures maximum network utilization under the highest network loads, congestion-free operation which implies no flow collisions and no jitter, high radix which allows Jericho3-AI to connect to 32,000 GPUs collectively, and Zero-Impact Failover - ensuring sub-10ns automatic path convergence. All of this would lead to cutting down on the job completion times for AI workload.
Designed to lower time spent networking during AI training
The performance improvement that Jericho3-AI brings with it is also cost-effective. It decreases the cost of running AI workloads. Broadcom Inc. claims that the network, in effect, pays for itself. The new chip could be particularly useful for its clients. One of the biggest clients that Broadband currently has on is Apple, with which it currently has a $15 billion deal.
Ram Velaga, senior vice president and general manager, Core Switching Group, Broadcom, said in the statement: “The benchmark for AI networking is reducing the time and effort it takes to complete the training and inference of large-scale AI models. Jericho3-AI delivers significant reduction in job completion time compared to any other alternative in the market.”
Jericho3-AI has been launched at a time when AI is omnipresent. According to International Data Corporation (IDC), it is estimated that worldwide spending on AI, including software, hardware, and services for AI-centric systems, will reach $154 billion in 2023, an increase of 26.9 percent in 2022. And over $300 billion by 2026.
AI-powered platforms need immense computing and processing power for data analytics workloads.
Broadcom’s Jericho3-AI chip will now compete with market leader NVIDIA's InfiniBand, which is another supercomputer networking technology. Reuters spoke to Velaga, who said that while NVIDIA systems are the world’s fastest supercomputers, many companies are reluctant to give up Ethernet to buy both GPUs and networking gear from the same supplier.
"Ethernet, you can get it from multiple vendors - there's a lot of competition," Velaga told Reuters. "If we don't come out with the best Ethernet switch, somebody else will. InfiniBand is a proprietary, single-source, vertically integrated kind of a solution."
SHOW COMMENT (1)
/2023/05/15/image/jpeg/1tHKOQt2LsnpzrZQ5qeSLB8yII9RmTMhZhhcqMhS.jpg "Groundbreaking study reveals strong and changeable magnetic field surrounding repeating fast radio burst")
/2023/05/26/image/jpeg/smTFO3AG7ESAzCi8L0kVnrUEHbVmcjiZ2KhVW0QE.jpg "Potential cure for diabetes found in groundbreaking stem cell study")
/2023/05/24/image/jpeg/44nI5oSvpNg7K7Zi0z3DjK3kyEBwGnalQCV4P7dj.jpg "This scottish woman has never felt pain or experienced significant anxiety or fear, and now we know why")
/2023/05/18/image/jpeg/v3WmZYvyaSybChFRkYuDx3IhL9gLKYPyqb8Ge1ud.jpg "Astronomers discover Earth-Sized planet with active volcanoes")
/2023/05/17/image/jpeg/DkhVUYyTr3zCw7iMFNI06s7EfwX7rbb5FNLrNLqh.jpg "Rimac's electric hypercar Nevera breaks 23 records, does 0-62 mph in 1.81 seconds")
/img/iea/BxG2peqdw9/untitled-2-5.jpg "Can we breathe on Mars? Is Europa habitable? What NASA’s work reveals about humanity's future")
/img/iea/AzwkrdXy6b/untitled-6-3.jpg "So you think you can fashion your future with wearables?")
/2022/12/18/image/jpeg/rUWd5Sfa3IsHMbPZH88VnTmWOoxLTzul6rkEXp1k.jpg "Microwaving the moon may be best for landing spacecraft, propose scientists")
/2022/08/27/image/jpeg/IeFjJbWsXrfA5c11TAP8weCj6j2S9NgsZy25NvHC.jpg "Space cement is here: How it could be used to build houses on Mars and the Moon")
/2023/01/08/image/png/1uxarRWPWEBWUEUijTLto3K3LJoMqJy60me57iMh.png "Transforming future health care technology in the U.S.")