This Open-Sourced Low Cost Robot Learns Through Reinforcement Learning
%2Favatars%2FBUoTZ6lM79yi.jpg&w=96&q=75)
%2Fimg%2Fiea%2Fypwqk1p3GN%2Fimage.png&w=3840&q=75)
Researchers at Aalto University and OTE Robotics have engineered a low-cost robot that can be used to test reinforcement learning (RL) algorithms, reported Tech Xplore. The bot is called RealAnt and is a real-world model of the 'Ant' robot simulation environment. It is also quite affordable at only 899 Euros (1090 USD).
RELATED: 15 ENGINEERS AND THEIR INVENTIONS THAT DEFINED ROBOTICS
"The initial inspirations for our work were RL studies that successfully demonstrated learning to walk from scratch on ant-like quadruped and humanoid robot simulations," Jussi Sainio, co-founder of Ote Robotics, told Tech Xplore.
"The underlying premise with RL algorithms is that programming a robot to do tasks becomes much easier and more 'natural'—one just needs to define the available sensor measurements, motor actions, then set a target goal and plug them all into a reinforcement learning algorithm, which figures out the rest."
Simulation-based training not required
RL used to require thousands of hours of robot simulation training. However, more recently, researchers have succeeded in teaching robots to walk with very little training data. This means that robots can now be trained in real-world environments without the use of lengthy simulation-based training.
"We quickly realized that RealAnt-like walking robots were not easily and affordably available, especially for reinforcement learning, which can easily damage the robot with abusive controls," Sainio explained.
"There was no complete combined software and hardware stack that one could take and get started with real-world reinforcement learning, compared to the simulator environments. I thus started to build my own robot and interface software prototypes."
And what impressive prototypes did Sainio build! According to Ote robotics' website, the robot comes with eight Robotis Dynamixel AX-12A smart actuators, a Robotis OpenCM9.04A board, a USB, a tag with reference tag plates, and a 12V 5A power supply.
The website adds that the "RealAnt robot platform from Ote Robotics is designed for real-world reinforcement learning research and development."
SHOW COMMENT (1)
/2023/08/03/image/jpeg/a4peRyX4ysBOqbw4BbDHzMCIbTjXOWejwu83UrQp.jpg "You can hear silence, claim researchers, settling an old debate")
/2023/10/03/image/jpeg/Al4Gl0iMWgPXjc51WnvbYpVpE6qCQfbIgomZqOlw.jpg "Tom Hanks clarifies AI doppelganger in ad is not him")
/2023/09/22/image/jpeg/N09BSEVNiNkMLnA50kD8o3yiMP8ye1mAEFwtWa4G.jpg "Is carbon capture the missing piece in the net zero puzzle?")
/2023/10/03/image/webp/L7KLU89gsFvisRshbjvp9QHrkN6tnQ2CAhkvaGJ9.webp "Spotify users may be able to generate AI playlists using prompts")
/2023/08/03/image/jpeg/Q9IvuRvY7jvsrewv390Jv5WQd2bAFZMorhVeIFE9.jpg "Does hydrogen have a future as a clean energy source?")
/2023/10/03/image/jpeg/7sieWxLc91yP91j9OopqqGBzfXElMuh5Z2mlCkdR.jpg "NASA aircraft reveals metallic nature of asteroid Psyche")
/2023/09/04/image/jpeg/UEuPO8vP8YA3PICuhwuvmebK4Pl9Cm1cShTAqGB2.jpg "Chinese researchers create dancing microrobots using lasers")
/2023/10/03/image/jpeg/6EbkGsb53lNOp8gI4Vu1bBNokGlTyzPjdEdDja93.jpg "Sound waves filmed within diamond crystal in a first")
/2023/09/17/image/jpeg/GbE6r76apLXoZKM51ON51o6JUc2WqeXfniLozi4E.jpg "Here's why robots are bad at passing CAPTCHA tests — at least in theory")
/2023/10/03/image/jpeg/5FGTtlykzDOzckutMMS4zDT9H0ahOFYVI1MLw9OJ.jpg "Underwater drone 5G mesh one step closer after latest NATO test")