AI System Creates 3D 'Motion Sculptures' Using Video Footage
/avatars/Vy5toVC0BNbz.jpg)
/2023/02/25/image/jpeg/jcCDNA6gIS7HajXpspba80jRw2RJJz5AGWHiyY11.jpg "The science behind the propellers moving the world’s largest ships")
/2023/02/19/image/jpeg/G4Kjw5BkCROdRTaxjw70IN0O0koHutnju4kOJsM1.jpg "The world's tiniest 3D printer is smaller than a match")
/2023/03/31/image/jpeg/p4E7GmjjwYlaMeXe3yhzWICEjiKzwuHn3piDg0wx.jpg "Historic Flatiron building has gone up for auction: Rare opportunity to own iconic landmark")
/2023/03/30/image/png/t1eFljMPiX3YvgL96mH4IJnnov7g2U4GjVdo4rTQ.png "Introducing the Liebherr LB 44: The ultimate drilling machine for heavy-duty projects")
/2023/03/29/image/jpeg/8IgnuE9Z0cyiNJ2oOL08NEsMVYG7TQQWmEiFcvMh.jpg "Keeping Ukraine’s sky safe from Russia: The U.S. made AN/TWQ-1 avenger missile system")
/2023/03/28/image/jpeg/tsbpl4HhO264YzHWKZoWNrYIdcJC4ppHd6YCJuB8.jpg "Game of drones: Bayraktar TB-2, MQ-9A Reaper and RQ-4 Global Hawk")
/2023/03/28/image/jpeg/fNsBx9xgKy1SEASXKU18B2KZTRcBgzzJG9Kdd4yp.jpg "Hydraulic press crushes everything in its path")
/2023/03/26/image/jpeg/e2ZbHmmpV0iEwRxiiQ6LuRNajslaLxRDnpFy7lJx.jpg "Drug cartel's submarine fleet: How do drug cartels smuggle cocaine across the sea?")
/2023/03/24/image/jpeg/1Kp0qCH9AWc4FL9BE8O6xzuDdohaN8L5e05pNhlc.jpg "This is why the ChatGPT founder is investing $180M in life extension")
/2023/03/24/image/jpeg/HfK3sTbJx1RArDpqjI7f4sA91pjiBOIdyNhzQobx.jpg "The incredible story of Cologne Cathedral's 600-year construction")
MIT CSAIL has released some mesmerizing footage of a system that visualizes complex human motion via 3D motion sculptures. The video shows how the system creates a 3D structure swept by a human body as it moves through space.
The system, called MoSculp is first fed an input video. The system then embeds it back into the scene in a 3D-aware fashion. MIT CSAIL says users of the system can customize the sculpture design by selecting different materials and lighting conditions.
By visualizing movement with this system, human movement can begin to be understood in ways that are impossible when viewing purely with the naked eye. The motion sculptures reveal space-time motion information that allows viewers to interpret how different parts of the human body react at different times.
The system has potential to be used by both professional athletes and their coaches as well as doctors and other practitioners working to understand a human movement that could assist with the development of mobility aids and prosthetics.
“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says Ph.D. student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”
The research team will present their paper on MoSculp next month at the User Interface Software and Technology (UIST) conference in Berlin, Germany.
Via: MIT CSAIL
SHOW COMMENT (1)
/2023/03/05/image/jpeg/CTcTiUAkLIhblWMrSU0v5V1tKAOC8eTLTd1dI4d2.jpg "Archaeologists find an overlooked treasure of a 15th-century Norse king")
/2023/03/29/image/jpeg/qUTECIJXuje913rWE7nS5TILsW2UU7fWHBJHRRBW.jpg "Elon Musk, AI experts sign open letter for immediate pause of AI more powerful than GPT-4")
/2023/03/29/image/jpeg/z2ydgcBgz8xbAphQoMNz3RcLaVvL0y7D0teUkNza.jpg "The 7 best noise-cancelling headphones for airplane travel")
/2022/10/13/image/jpeg/LEvS6EiIR5zUpREEP3uNnoY0I8NWNzFpTCE98ls6.jpg "Does being a veggie make you depressed? – The Blueprint")
/img/iea/jg6P5ge9wx/rachel-o3tiy5piork-unsplash.jpg "Researchers are figuring out how we make memories — and how to study better")
/2023/03/30/image/jpeg/SMeLriyPCkOsP34uUDXu6Qdo9uopkTkYjJHr1dD6.jpg "Belgian woman blames ChatGPT-like chatbot ELIZA for her husband’s suicide")
/2022/08/22/image/jpeg/bNhaH9G0SWBK0YNuxPMWh34HsaJrx7pEJ83iwe30.jpg "Engineered cells touted to treat the most aggressive cancers in the world")
/2023/03/29/image/jpeg/2HHtpYseZffpH9WLJ7nR95ueq5t0XAbIVJk4nARG.jpg "These 'new' amino acids may forge weight loss without surgery or nausea")
/2022/11/21/image/jpeg/wR38bF4f5lUW2y8niI3P0v8sY9pLnT6ra3fl60kd.jpg "Dams could sustainably feed 1.15 billion people, but as a last resort")
/2023/03/30/image/jpeg/vXZ07k96dx1Wjgf5ihtNEGTWuKsLGfBpeUuAoS20.jpg "The Last of Us? 61-year-old infected with 'world first' plant fungus infection")