#Will AR integration for IRL streams be interesting?

1 messages · Page 1 of 1 (latest)

plain quarry
#

When watching the Neuro/Evil IRL stream, I thought it would be nice if you can have an AI guide seamlessly integrated in to your experience when traveling around. It's so happen that I got an AR glasses from my friend, so I wrote an app to implement this.

https://github.com/ECHO-HELLO-WORLD424/NeuroGlasses/tree/main

When implementing this I realized that maybe AR glasses can be used in IRL streams too. Here are some of the ideas that are possible to implement:

  1. HUD Can Sync Twitch View (sort of)
    During Neuro/Evil's tour, it seemed that Rob need to watch Neuro/Evil/Chat from phone. The glasses can accepts OpenAI API style streaming text/audio input and play them with the glasses' HUD/speaker, which means it should be able to sync textual content on Twitch. While I can't play video on the glasses, It's possible gather different static Neuro images (happy face, cry face, question mark face ...) and Neuro can update the image on HUD via NeuroSDK

  2. Neuro Can Operate HUD
    HUD layout is defined by a simple json string and can be update with a short json string. This enables Neuro to draw whatever she want to draw (e.g., she can draw a box on the item she wants to buy) on the glasses. Meanwhile the HUD (in theory) can be synced to Twitch because it is possible to render the same UI on regular android machines via glasses' SDK

ic_launcher.webp
GitHub
GitHub - ECHO-HELLO-WORLD424/NeuroGlasses: Rokid Glasses Integratio...

Rokid Glasses Integration for AI applications, inspired by Neuro - ECHO-HELLO-WORLD424/NeuroGlasses

#

This is what the glasses look like with the app mentioned above.

latent belfry
#

glasses neuro spotted

last ingot
#

That's impressive

unreal glen
#

The day neuro can appear in my glasses in the day I finally buy one of those AR glasses

gritty edge
#

this is pretty cool. dont know if collab partners would want to spend money on glasses that they may use once every few months to a year.

plain quarry
#

Indeed, but I guess they don't have to actually buy one since I believe there are ones you can rent (Perhaps? Depends on where you live. In China there are a lot of them for rent on XianYu, Chinese version of eBay)

gritty edge
#

oh i see dont think there is anything like that is America. Maybe japan but i dont know