AI System Creates 3D 'Motion Sculptures' Using Video Footage
%2Favatars%2FVy5toVC0BNbz.jpg&w=96&q=75)
/2023/02/25/image/jpeg/jcCDNA6gIS7HajXpspba80jRw2RJJz5AGWHiyY11.jpg "The science behind the propellers moving the world’s largest ships")
/2023/02/19/image/jpeg/G4Kjw5BkCROdRTaxjw70IN0O0koHutnju4kOJsM1.jpg "The world's tiniest 3D printer is smaller than a match")
/2023/10/02/image/jpeg/MOcUZpZARJOhpkuCTYT9qOFVxgXFim1einL26uVc.jpg "Why Russo-Iranian kamikaze drones can not pass Gepard?")
/2023/10/01/image/jpeg/XkSY9MHMeqXU4Ywz4ScJk4TSXB50rIlVp9jq922u.jpg "MIT makes a super thin solar cell that can turn any surface into a power plant")
/2023/09/30/image/jpeg/6IjK0KBN2CeWMA7df6Up3U6thpVJXxlG6O1Vqavl.jpg "What are these black balls doing in the reservoir?")
/2023/09/29/image/jpeg/voFjWPgxbHXwheGsIQF2L0gAW0jbujHVnN2I2wEN.jpg "GE Aerospace’s Sensiworm made flying safer!")
/2023/09/28/image/png/JxWeuRBc3TFCMjNiVXu2UIt90UamRuAnXtEPxWhT.png "Are plastic-eating worms the solution to plastic waste?")
/2023/09/27/image/jpeg/NkLowKFkYRa5HSpVpzAqp8LxzcqazLWg5FPsmprr.jpg "How this Chinese hypersonic fleet killer will counter U.S. Navy")
/2023/09/26/image/jpeg/zHjalQG1HPbbeDvmS7EoO2EavIo4eaQxvwe5LgUD.jpg "Why we put wind turbines underwater")
/2023/09/25/image/jpeg/QrGYVahotQMvit1WXPMwhWH2HcKqtALSZo6UJyXS.jpg "How Will M10 Booker make The U.S. Army Unstoppable")
MIT CSAIL has released some mesmerizing footage of a system that visualizes complex human motion via 3D motion sculptures. The video shows how the system creates a 3D structure swept by a human body as it moves through space.
The system, called MoSculp is first fed an input video. The system then embeds it back into the scene in a 3D-aware fashion. MIT CSAIL says users of the system can customize the sculpture design by selecting different materials and lighting conditions.
By visualizing movement with this system, human movement can begin to be understood in ways that are impossible when viewing purely with the naked eye. The motion sculptures reveal space-time motion information that allows viewers to interpret how different parts of the human body react at different times.
The system has potential to be used by both professional athletes and their coaches as well as doctors and other practitioners working to understand a human movement that could assist with the development of mobility aids and prosthetics.
“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says Ph.D. student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”
The research team will present their paper on MoSculp next month at the User Interface Software and Technology (UIST) conference in Berlin, Germany.
Via: MIT CSAIL
SHOW COMMENT (1)
/2023/07/25/image/jpeg/FmiX8wihzsK5QlLyCAvLuWG8mFQPJq6DlJVhmaMW.jpg "Bridging the gap between doctors and medical technology")
/2023/10/02/image/jpeg/SyIyrNew2ZFgUtr0V8d7h2Eziqj81XHQBlVOQLmC.jpg "Plastic rain: Scientists find microplastics in cloud water")
/2023/09/12/image/jpeg/E1LfUWjqRrg0bFqBnRzB7XzmfJAd6YPNclMl5I9n.jpg "How AI can revolutionize health on long-duration spaceflights")
/2023/08/08/image/jpeg/fHnqDi31I8aDjZWq07Bcdw8dwQN7rR8nDchS6e9t.jpg "Improved ICEs or all-in on EVs: which is better for the future?")
/2023/08/12/image/jpeg/YpIBySMmJsZiGQlarXybqbSBEqLy3heGb8irafUg.jpg "Predictions for what the world will be like in 2100?")
/2023/10/02/image/jpeg/QerCPdXBiIYHQ5X1Ki5BLFFRuZbLxbkIyBc6Siz9.jpg "Whoosh: Indonesia's high-speed rail dream becomes a reality")
/2023/10/02/image/jpeg/Bb0e3wa9z4zX8nrXRSHcJymB0MvBAjAG9OPnIIgD.jpg "Virus from endangered species can treat diabetic foot ulcers")
/2023/10/02/image/jpeg/xeK9Y1vqkvj2jIqZTcqNySLuqMBYiPj4ruWzCPPB.jpg "Webb spots strange objects hiding in the nearby Orion Nebula")
/2023/08/31/image/jpeg/RCklqoUliiOZrZ9TKBHqXIlgLKpe8S7RGLk87bzO.jpg "Giorgio Rosa, the engineer who built his own island")
/2023/10/02/image/jpeg/nEF9PzbIMgldHQul26NilG3JzkayhZpqlujpHYTG.jpg "A daily dose of dark tea can save you from diabetes")