So I got a Steam Frame in case you missed the TreeHouse Defense System (TDS) release that adds AR/VR support to viewing the dashboard via the Steam Frame.
The other piece of that is I submitted some interesting vulnerabilities I found in the Steam Frame as well but I’m waiting on Valve to respond beyond acknowledging they got my report. That disclosure embargo ends in like 1.5 months? or so regardless.
Anyway, I was trying to think of what else I can do with the frame that’d be novel and interesting. Ideally useful. So I decided to add hermes support for it.
Biggest use case by far is when I’m hacking on a random component or PCB I can tell my Hermes to look at the chipset through the frame, find the data sheet and show me it, same with something on its filesystem or one of my lab boxes.
But more importantly, I gave my Hermes a body, and you too can do that! Yes you can swap the model out to whatever you’d like. Personally I made my model with an image -> 3D model using Meshy AI. Then claude + an MCP or two. It’s definitely rough around the edges but it works for a prototype.
You can also ask/talk/tell your hermes to do things. It’s a full bridge to your hermes just with some extras of it being able to capture the live video feed (or a frame if you prefer) of the frame and populate objects in your VR/AR space.
Anyway, here’s the demo video of me showing off some of what RealHermes can do:
Grab it from GitHub HERE
END TRANSMISSION