Robots & gadgets

A humanoid robot learned cornhole from one video of a person

Gemini Argon took control of Apptronik's Apollo, built its own simulation, ran system identification and trained throws on the real robot, landing consecutive airmails after a few shots. Then it had the robot explain what it did.

View on X
2.5Klikes
258reposts
695saves
221Kviews
Made with
Gemini Argon, Apptronik Apollo
Role
Robotics researcher, Google DeepMind
Posted
Norman Di Palo@normandipalo

I’m still half in disbelief
We asked Gemini Argon to teach the Apollo humanoid to play cornhole, and it zero-shotted it

All we gave it was a video of a person doing it. It then took control of the robot, generated its own sim env, performed some sysID, and trained launches on the real robot.

It took it a few real shots to improve and then land many consecutive airmails.

The process was so long and articulated that we asked the robot itself to explain what it did to us, as you can see at the end of the video. It even came up with the gestures

Great demo for a great model @googledeepmind @apptronik

View on X
Still from the video

More like this