Tesla Shows Off Its Brand New AI-Training Supercomputer
%2Favatars%2F6UKotck4r9pz.jpg&w=96&q=75)
%2Fimg%2Fiea%2Fy5wWKQxYwX%2Ftesla-supercomputer.jpg&w=3840&q=75)
Tesla's Senior Director of AI, Andrej Karpathy, unveiled the electric vehicle automaker's new supercomputer during a presentation at the 2021 Conference on Computer Vision and Pattern Recognition (CVPR).
Last year, Elon Musk highlighted Tesla's plans to build a "beast" of a neural network training supercomputer called "Dojo".
For several years, the company has been teasing its Dojo supercomputer, which Musk has hinted will be the world's fastest supercomputer, outperforming the current world leader, Japan's Fugaku supercomputer which runs at 415 petaflops.
The new supercomputer seems to be a predecessor to the Dojo project, with Karpathy stating that it is the number five supercomputer in the world in terms of floating-point operations per second (FLOPS).
This supercomputer is certainly not lacking in the processing department. As Karpathy highlights in his presentation, the supercomputer has 720 nodes of 8x A100 80GB (5760 GPUs total). It also has 1.8 EFLOPS (720 nodes * 312 TFLOPS-FP16-A100 * 8 gpu/nodes), 10 PB of “hot tier” NVME storage @ 1.6 TBps, and 640 Tbps of total switching capacity.
An 'insane supercomputer'
The new machine is Tesla's third supercomputer cluster and will no doubt teach the team at Tesla some valuable lessons ahead of its Dojo project release, which Musk has previously teased for this year.
During his presentation, Karpathy said that he wanted to "give a plug to this insane supercomputer that we are building and using now." He also stated that "computer vision is the bread and butter of what we do and what enables Autopilot."
The supercomputer will be used to train Tesla's Autopilot and its Full Self Driving (FSD) AI on vast amounts of data at incredibly high speeds, with Karpathy saying this "requires a huge amount of computing."
Karpathy didn't reveal any information on the Dojo project itself, though he did suggest it will handsomely outperform Tesla's latest machine. Seeing as Musk has stated Tesla will allow other companies to use the Dojo computer to train their neural nets, that's great news for autonomous driving.
Watch Karpathy's presentation here, with him talking about the new supercomputer at around the eight-hour and 12-minute mark.
SHOW COMMENT (1)
/2023/08/10/image/jpeg/cyOAiEwaMk2ITtOhy2mnmZPlf3twLEu0vpYcIeXJ.jpg "From scraps to solutions: charting progress in metals recycling")
/2023/09/28/image/jpeg/vMeOnfZRpOLq4SFGyP47JHUGjWbq6U0JXJ5FQhH5.jpg "Taiwan reveals first indigenous submarine amid growing threat")
/2023/09/28/image/jpeg/k5h3SzgHCtjTANneWkrzc1PKKIE54CnSHDKPm0z7.jpg "X rising from the ashes? CEO envisions profits in 2024")
/2023/09/28/image/png/JxWeuRBc3TFCMjNiVXu2UIt90UamRuAnXtEPxWhT.png "Are plastic-eating worms the solution to plastic waste?")
/2023/09/11/image/jpeg/FyjoRiLdd9sOj0dytR3WjS3yDS1ON5OKg7bkfRUv.jpg "Life by 2100: nanotech, cybernetics, and commercial space travel")
/2023/08/26/image/png/ny1gzL2fwjRLIco8gac58tlSGZKREl4XSp340YAB.png "12 science, tech, and engineering newsletters you need to check out")
/2023/09/28/image/jpeg/AtjB9nEOiZuYEOD35oMNtLJJXp0cWNGyinEwAMMG.jpg "Atomic clocks on the horizon: Unveiling the power of scandium")
/2023/08/31/image/jpeg/RCklqoUliiOZrZ9TKBHqXIlgLKpe8S7RGLk87bzO.jpg "Giorgio Rosa, the engineer who built his own island")
/2023/09/28/image/jpeg/egDBIcHsFAv4CYZfZrlpC5HlIAfJdSZKnHc6qMBT.jpg "Apple’s AI chief has announced engine switch update in iOS 17")
/2023/08/03/image/jpeg/Q9IvuRvY7jvsrewv390Jv5WQd2bAFZMorhVeIFE9.jpg "Does hydrogen have a future as a clean energy source?")