NVIDIA Opens New Research Lab for Teaching Robots to Safely Work Alongside Humans
%2Favatars%2FBUoTZ6lM79yi.jpg&w=96&q=75)
%2Fimg%2Fiea%2Fo2GzgQ016p%2Fnvidia-robotics.jpg&w=3840&q=75)
NVIDIA is opening a new robotics research lab in Seattle to drive breakthrough robotics research mostly in mastering a kitchen. The aim of the lab is to enable the next generation of robots to safely work alongside humans.
RELATED: NVIDIA OPENS UP ITS HOLODECK VR DESIGN SUITE
Fully integrated systems
“In the past, robotics research has focused on small, independent projects rather than fully integrated systems. We’re bringing together a collaborative, interdisciplinary team of experts in robot control and perception, computer vision, human-robot interaction, and deep learning,” said new lab lead Dieter Fox, senior director of robotics research at NVIDIA and professor in the UW Paul G. Allen School of Computer Science and Engineering.
The lab will host close to 50 research scientists, faculty visitors, and student interns where they will investigate robotics in realistic scenarios. The first of these is real kitchen where a mobile manipulator does everything from getting objects from cabinets to helping cook a meal.
The robot builds on NVIDIA’s expertise in photorealistic simulation, using deep learning to detect specific objects solely based on its own simulation. As such, it does not require any tedious manual data labeling.
Cutting-edge technologies
The unique system integrates cutting-edge technologies developed by the lab researchers. These technologies enable the robot to detect objects, track the position of doors and drawers, and grasp and move objects from one spot to another.
The technologies used are: Dense Articulated Real-Time Tracking (DART), a method of using depth cameras to keep track of a robot’s environment, Pose-CNN: 6D Object Pose Estimation, a method for detecting the 6D pose and orientation of objects, Riemannian Motion Policies (RMPs) for Reactive Manipulator Control, a new mathematical framework that combines a library of simple actions into complex behavior, and Physics-based Photorealistic Simulation, realistic simulation environments that model the visual properties of objects as well as the forces and contacts between objects and manipulators.
“We really feel that the time is right to develop the next generation of robots. By pulling together recent advances in perception, control, learning, and simulation, we can help the research community solve some of the world’s greatest challenges,” said Fox.
SHOW COMMENT (1)
/2023/05/17/image/jpeg/DkhVUYyTr3zCw7iMFNI06s7EfwX7rbb5FNLrNLqh.jpg "Rimac's electric hypercar Nevera breaks 23 records, does 0-62 mph in 1.81 seconds")
/2023/05/15/image/jpeg/qWnTxwK5AzkYGhQliDBD7W14DWhfZriDltyDJEoF.jpg "How the White House's $450 million investment is helping the US transition towards clean energy")
/2023/05/18/image/jpeg/gWm8PmQkrvvrIF6xsTiaBhe2MeMRukgrDIyBKi8j.jpg "How about we terraform Venus and Mars at the same time?")
/2022/10/20/image/jpeg/ScA5gk4REbDQ0xaXiJjAYjs9IqTA9kJhFE9TvQcx.jpg "300 million cigarette butts and counting: Indian company converts them into beautiful products")
/2023/05/26/image/jpeg/1JXrkwK7efWVsmu4aRFf4fdD1Ptufo7ZAU7UMPLd.jpg "US Carrier Strike Group can be countered with 24 hypersonic missiles, China claim")
/2023/05/26/image/jpeg/smTFO3AG7ESAzCi8L0kVnrUEHbVmcjiZ2KhVW0QE.jpg "Potential cure for diabetes found in groundbreaking stem cell study")
/2023/05/18/image/jpeg/7YRZL0agHGosIz9ddc2DCyfsFt5RkrZcCNU1uvnW.jpg "Ultrafast imaging tech unlocks 'impossible' pathway in photosynthesis for new clean fuels")
/2023/05/15/image/jpeg/1tHKOQt2LsnpzrZQ5qeSLB8yII9RmTMhZhhcqMhS.jpg "Groundbreaking study reveals strong and changeable magnetic field surrounding repeating fast radio burst")
/2023/05/25/image/jpeg/FUaPL4JAHr0bKBYl2kmMVVOIp7DPfFeyghATlbXA.jpg "Ancient Chinese shipwrecks reveal details on Silk Road trade")
/2023/03/15/image/jpeg/tvO3OX3yUnZOx51bCywccHwYOkKTwBHBCSZRY0IH.jpg "Opening up Tesla's Supercharger network could help EV users in the US")