Fun experiment getting Hermes, active and operational on a Nintendo 3DS.
I can talk to it from the 3DS and it does real work on my Mac. It can searches the web, writes and runs code, and pretty much anything else an agent can do. The 3DS is the remote.
Getting voice in was interesting part. The 3DS browser can't reach the mic, so Hermes and I installed custom firmware and wrote a small homebrew app in C. Hold A to talk and let go to send. The audio goes over to my Mac, Whisper turns it into text, and Hermes takes it from there. The 3DS is completely unaffected still works as intended.
Anything needing approval is surfaced. The screen goes dark and the command shows up. A approves, B denies.
The Hermes Girl animates through every state: listening, thinking, searching, writing code, sending helpers, done, asleep. There are 13 states in total.
Anyways here’s a few simple interactions.
🤖🖤
Apps & websites
An AI agent controlled from a Nintendo 3DS with voice
Jarlan Perez got Hermes running as a controllable agent from a Nintendo 3DS. A custom homebrew app captures voice (Whisper converts it to text) and sends commands to a Mac, with on-screen approve/deny for sensitive actions and 13 animation states.
231likes
8reposts
81saves
29Kviews
- Made with
- Hermes, Whisper
- Role
- Design Director at Yuga Labs
- Posted
