Watch derpy robots show off their soccer skills thanks to new AI training method

Short, stumpy robots learned how to play soccer — and improved their skills dramatically thanks to a new AI training technique that combines several pre-existing methods.

Scientists have trained miniature humanoid robots to play soccer using a new artificial intelligence (AI) training method — and footage shows the robots demonstrating their skills in a one-on-one game.

In the short clips, two bipedal robots play several games in which one is attacking a goal and the other is defending it. 

They kick the ball around, block shots and scurry across the pitch — all while waving their arms and falling over in the process. But at least they try to maintain their balance and recover quickly after a fall. 

It might not look like it at first, but they’re also playing highly strategically — learning how the ball moves and anticipating their opponent’s next moves as they try to outwit and outpace them, the scientists said in a study published April 10 in the journal Science Robotics.

Google DeepMind scientists trained their miniature Robotis OP3 robots to play soccer using a technique called “deep reinforcement learning.” (Image credit: Google Deepmind)

Humanoid robots are difficult to configure because every movement needs to be programmed — which requires scientists to compile enormous amounts of data. Many modern humanoid robots, however, have been given a helping hand thanks to AI. Self-learning, thanks to AI, would mean robots wouldn’t need ever single motion and movement pre-scripted or programmed. For example, the Figure 01 robot can learn by just watching video — with scientists previously teaching it to make coffee by showing it just 10 hours of training footage.  

Related:Forget making coffee — Boston Dynamics puts Atlas to work lifting heavy automotive struts in latest flex

In the new study, Google DeepMind scientists trained their miniature Robotis OP3 robots to play soccer using a technique called “deep reinforcement learning.” This is a machine learning training technique that combines several different AI training methods. 

window.sliceComponents = window.sliceComponents || {};

externalsScriptLoaded.then(() => {
window.reliablePageLoad.then(() => {
var componentContainer = document.querySelector(“#slice-container-newsletterForm-articleInbodyContent-4S77zsoxcYVng9ta58NjYh”);

if (componentContainer) {
var data = {“layout”:”inbodyContent”,”header”:”Sign up for the Live Science daily newsletter now”,”tagline”:”Get the worldu2019s most fascinating discoveries delivered straight to your inbox.”,”formFooterText”:”By submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.”,”successMessage”:{“body”:”Thank you for signing up. You will receive a confirmation email shortly.”},”failureMessage”:”There was a problem. Please refresh the page and try again.”,”method”:”POST”,”inputs”:[{“type”:”hidden”,”name”:”NAME”},{“type”:”email”,”name”:”MAIL”,”placeholder”:”Your Email Address”,”required”:true},{“type”:”hidden”,”name”:”NEWSLETTER_CODE”,”value”:”XLS-D”},{“type”:”hidden”,”name”:”LANG”,”value”:”EN”},{“type”:”hidden”,”name”:”SOURCE”,”value”:”60″},{“type”:”hidden”,”name”:”COUNTRY”},{“type”:”checkbox”,”name”:”CONTACT_OTHER_BRANDS”,”label”:{“text”:”Contact me with news and offers from other Future brands”}},{“type”:”checkbox”,”name”:”CONTACT_PARTNERS”,”label”:{“text”:”Receive email from us on behalf of our trusted partners or sponsors”}},{“type”:”submit”,”value”:”Sign me up”,”required”:true}],”endpoint”:”https://newsletter-subscribe.futureplc.com/v2/submission/submit”,”analytics”:[{“analyticsType”:”widgetViewed”}],”ariaLabels”:{}};

var triggerHydrate = function() {
window.sliceComponents.newsletterForm.hydrate(data, componentContainer);
}

if (window.lazyObserveElement) {
window.lazyObserveElement(componentContainer, triggerHydrate);
} else {
triggerHydrate();
}
}
}).catch(err => console.log(‘Hydration Script has failed for newsletterForm-articleInbodyContent-4S77zsoxcYVng9ta58NjYh Slice’, err));
}).catch(err => console.log(‘Externals script failed to load’, err));

This cocktail of techniques included reinforcement learning, which hinges on virtually rewarding the completion of goals; supervised learning; and deep learning using neural networks — layers of machine learning algorithms that act like artificial neurons and are arranged to resemble the human brain.

The robots initially worked off a scripted baseline of skills before the scientists applied their combined deep reinforcement learning AI training technique.

In their matches, the AI-trained robots walked 181% faster, turned 302% faster, kicked the ball 34% faster and took 63% less time to recover from falls when they lost balance,  compared with robots not trained using this technique, the scientists said in their paper.

The robots also developed “emergent behaviors” that would be extremely difficult to program, such as pivoting on the corner of their foot and spinning around, they added. 

The findings show that this AI training technique can be used to create simple but safe motions in humanoid robots more generally — which could then lead to more sophisticated movements in changing and complex situations, the scientists said.

READ MORE

Graphene-coated face masks: COVID-19 miracle or another health risk?

Credit: Pixabay/CC0 Public Domain As a COVID-19 and medical device researcher, I understand the importance [...]

It’s Pooches vs. Poachers in the Fight Against Wildlife Smugglers

A Canines for Conservation handler and his dog inspect a vehicle as a part of [...]

Macho Birds Age Faster

A male houbara bustard displays his feathers to get a female Yves Hingrat The houbara [...]

Was an Irish monk the first European to reach America?

It has been a lifelong discussion on who first found the Americas. nattrass / Getty [...]

Researchers develop novel nonwovens that are electrically conductive but thermally insulating

Scanning electron image of fibers in a novel electrospun nonwoven which exhibits an unusual combination [...]

Amazing Underwater Photos of Ocean Creatures

Brian Skerry Harp Seal (Brian Skerry ) Photojournalist Brian Skerry has taken photos for National [...]

The First Supernova

A combined image from the Chandra and XMM-Newton X-ray observatories of RCW 86, which was [...]

How to Make Homemade Laundry Detergent

Detergent can easily be made at home with household ingredients. africa_pink / Shutterstock Have you [...]