NVIDIA Introduces the First Ever Interactive AI Rendered Virtual World

NVIDIA has introduced a new deep learning-based model that aims to catapult the graphics industry into the AI chapter, the result is the first ever interactive artificial intelligence-rendered virtual world. The researchers used a conditional generative neural network as a starting point and then trained a neural network to render new 3D environments.

Now, the AI breakthrough will allow developers and artists of all kinds to create new interactive 3D virtual worlds based on videos from the real world, lowering the cost and time it takes to create virtual worlds.

“NVIDIA has been creating new ways to generate interactive graphics for 25 years – and this is the first time we can do this with a neural network,” said the leader of the NVIDIA researchers Bryan Catanzaro, Vice President of Applied Deep Learning at NVIDIA. “Neural networks – specifically  – generative models are going to change the way graphics are created.”

“One of the main obstacles developers face when creating virtual worlds, whether for game development, telepresence, or other applications is that creating the content is expensive. This method allows artists and developers to create at a much lower cost, by using AI that learns from the real world,” Catanzaro said.

“The capability to model and recreate the dynamics of our visual world is essential to building intelligent agents,” the researchers stated in their paper. “Apart from purely scientific interests, learning to synthesize continuous visual experiences has a wide range of applications in computer vision, robotics, and computer graphics,” the researchers explained.