NVIDIA Researchers Created AI That Turns 2D Images into 3D Models

NVIDIA created a machine learning called DIB-R, which can turn 2D images into 3D models.
Nursah Ergü

Would you like to turn your child's drawings into real? It'd be the best gift to give your child their own work of art.

If you'd like to do it, then here's a great invention for you. NVIDIA researchers invented Artificial Intelligence, which is called DIB-R, that can turn 2D images into 3D models. The machine can predict what would the 2D image look like in three dimensions and create a 3D model, by taking lighting, texture, and depth into the consideration. 


The model will be presented by the NVIDIA researchers at the annual Conference on Neural Information Processing Sytems (NeurIPS), Vancouver. 

NVIDIA Researchers Created AI That Turns 2D Images into 3D Models
Line 1, 3, 5, 7 on the left are 2D images, Line 2, 4, 6, 8 are the produced 3D objects, Source: NVIDIA

According to NVIDIA's website, this machine is especially useful for fields like robotics. It also says on the website, "For an autonomous robot to interact safely and efficiently with its environment, it must be able to sense and understand its surroundings. DIB-R could potentially improve those depth perception capabilities."

NVIDIA's director of AI, Sanja Fidler told Venture Beat's Staff Writer Khari Johnson, "Imagine you can just take a photo and out comes a 3D model, which means that you can now look at that scene that you have taken a picture of [from] all sorts of different viewpoints. You can go inside it potentially, view it from different angles — you can take old photographs in your photo collection and turn them into a 3D scene and inspect them like you were there, basically."