The world's fastest supercomputer with a processing power of 4 exaflops unveiled

The supercomputer is part of the larger constellation of inter-connected supercomputers with a combined capacity of 36 exaFLOPS.
Ameya Paleja
Artist's representation of a supercomputer unit
Artist's representation of a supercomputer unit

G42 

Abu Dhabi-based technology holding group G42 has unveiled the world's fastest supercomputer, the Condor Galaxy-1 (CG-1), which has 54 million cores and a processing capacity of four exaflops, a press release said. The supercomputer is located in Santa Clara, California, and will be operated by Cerebras, a US-based AI firm under US laws.

As artificial intelligence (AI) technology takes center stage, there is a strong demand for supercomputers to help businesses train their own models. Companies like Microsoft have offered to build the extremely expensive infrastructure and rent it out for companies to work on them.

Based in Abu Dhabi, G42 is a holding group in the technology area and aims to create infrastructure for the futuristic world. It works with both nations and corporations to realize its vision and is building the Condor Galaxy system of supercomputers to help solve the biggest problems facing humanity today.

What is the Condor Galaxy System?

Many technology companies have announced setting up massive clusters of graphic processing units (GPUs), the brains of AI models. "Distributing a single model over thousands of tiny GPUs takes months of time from dozens of people with rare expertise," said Andrew Feldman, CEO of Cerebras Systems, which has worked with G42 to deliver the fastest supercomputer.

Instead of using a central supercomputer, Feldman and his team at Cerebras are building a set of interconnected AI supercomputers that can substantially reduce AI model training time. According to Cerebras' approach, setting up generative AI models is only a matter of minutes and can be achieved by a single individual.

Put together, the Condor Galaxy System will have a combined processing power of 36 exaFLOPS, which is unprecedented in today's world of computing.

The fastest supercomputer

At the Condor Galaxy System's core is each supercomputer, the first of which was recently unveiled. Cerebras has assembled 64 of its flagship CS-2 AI processors to assemble the CG-1 supercomputer.

The world's fastest supercomputer with a processing power of 4 exaflops unveiled
Illustration of the CG-1 supercomputer

AMD's EPYC processor cores feed the system and boast 54 million AI-optimized compute cores with 388 terabits per second of fabric bandwidth and 82 TB of memory storage.

At 16-bit computation, the system can deliver four exaFLOPS of computing power, which is four times faster than the fastest supercomputer in the world. It can be used to train 600 billion parameter models and extended to support 100 trillion parameter models. To put this in context, the GPT-4 model from OpenAI is trained using 1.7 trillion parameters.

Cerebras and G42 also have plans to introduce two more installations of the supercomputer, CG-2, and CG-3, in the US in early 2024 while offering CG-1 as a cloud service to customers.

CG-1 can work natively with 50,000 tokens and without any special software libraries. Programming on the CG-1 can be done entirely without using complex distributed programming languages, saving precious time spent on distributing workflow across GPUs, the press release added.

The supercomputer is located at Colovore, a colocation facility in Santa Clara, California. Cerebras will operate it under US laws to ensure that the computing power is not accessible to adversary nations.

G42 and Cerebras are confident that the fastest supercomputer will help address healthcare, energy, and climate change challenges.

Add Interesting Engineering to your Google News feed.
Add Interesting Engineering to your Google News feed.
message circleSHOW COMMENT (1)chevron
Job Board