visual sonnet
RobGPT is my little companion that from a start could do things like chase a laser and recognise your face.
with the help of ChatGPT and a bottle of VyVanse i managed to use whisper to send a text of what i said to the GPT and the answer back is sent to gTTS to give him a voice, i didnt want him to sound like a middle aged woman so i used pydubs audiosegment to pitch up the voice, giving him the cute persona he needs
coral sky
Cool! It's Arduino? Open source? I would love to build my own
visual sonnet
It's a raspberry:) it's fairly simple really
coral sky
cool!
lyric ocean
This is really Cool, Amazing work!
visual sonnet
This is really Cool, Amazing work!
thanks
icy galleon
Cute robot!
junior kindle
now imagine incorporating gpt 4 in this where it can take pictures of its environment, and recognize where it is. Could potentially use gpt4 to understand who its talking to and where its going.
jagged mantle
This is so cool! I was thinking of making something like this too actually! I wonder if Arduino will be capable to do this too
visual sonnet
Cute robot!
thanks!
visual sonnet
now imagine incorporating gpt 4 in this where it can take pictures of its enviro...
exactly, thats the plan! right now my idea was for it record a snippet of audio/video everytime it sees me so it can have like memories of me. also record randoim snippets throughout its on time to kinda create memories like we do.
visual sonnet
This is so cool! I was thinking of making something like this too actually! I wo...
for just the robotics part arduino is good but i believe the raspberry's compute power is is needed for the a.i
visual sonnet
Update, I can now read main battery voltage, one step closer to making it find its charger on its own
errant wing
Good luck!
copper garnet
amazing!
visual sonnet
Rob update: now I've added new startup and shutdown animations inspired by old 80-90s computers because he is rather slow sometimes lol and I've been able to send system data to GPT so it can tell me how it's doing 🙂
junior kindle
so cute, anyway to get this guy wireless?
visual sonnet
He is wireless, he's just connected to his charger here. He's powered by a simple 4ah 12v lead acid
warped pond
Nice. I’m busy building one of my own. I like the voice 👍
visual sonnet
Nice. I’m busy building one of my own. I like the voice 👍
Awesome!!
fathom flower
Woah thats awesome.. i‘m looking forward to see your vision „come alive“
warped pond
Have you any idea of what the breakdown is regarding delay? It has to record your speech, send it to whisper, get the results back, send it to chatgpt, get those results back, send those to gtts, get a sound file back, then process the sound file and play it? What are the parts of the chain causing the most delay and have you any ideas/plans how to speed things up?
naive snow
cute
visual sonnet
Have you any idea of what the breakdown is regarding delay? It has to record you...
its the gTTS response that takes the most time, i get the text from the GPT very fast, I have now managed tho to chunk up the response text so now it starts talking the second it gets the response back 🙂
patent phoenix
Wow thats really cool. Wish i had the skills to build one myself. 😄
visual sonnet
Rob wants to share his latest upgrades ☺️
celest sluice
Ow. So cute.~
visual sonnet
Update: Rob can now ask you what your name is and check it's memory if you name is saved, if not ot snaps a picture of you and adds it to his memory ❤️
warped pond
Is there any chance of you uploading the code somewhere so I can have a look through?
visual sonnet
Is there any chance of you uploading the code somewhere so I can have a look thr...
Yeah, I can prolly upload the project here or something, thing is i have severe adhd so some files are named "kshshj.py" for example and some functions are in Swedish lmao xD but I'll try and sort things out and post it here! Let's fill the world with Robs!
tranquil pelican
Cool👍
warped pond
I’m most interested in how you’re putting the pieces together. Like, what information are you sending from the camera into the language model? And stuff like, if you ask Rob to look to the left, can he do that?
visual sonnet
I’m most interested in how you’re putting the pieces together. Like, what inform...
Yeah so my voice is translated to text and sent together with system data in brackets like [volts: 12.bla bla ] and so on and he's prompted not ro react to those if not asked. As for controlling him the language model is not even needed or used here, because of the voice-text conversion I can script it to react to certain keywords to trigger other functions outside of the main function, like face recognition and laser point hunting etc etc before returning to main. No data from the camera is sent to the language model. Just the names connected to saved images.
I do wait for the language model to respond before going to another function and everytime i add new features i tell him that in the pre-prompt so he responds in a relevant matter.
Yes i can tell him to do whatever and he'll do it right away or right after playing the GPT response
warped pond
Handling fame like a pro. His voice is so cute!
visual sonnet
Rob went to his first party!
warped pond
happy midsummer!
visual sonnet
Happy midsummer to you to!
bleak garnet
This is cool, is there a repo to contribute?
visual sonnet
This is cool, is there a repo to contribute?
Not right now I'm afraid
Started work on legs, first step: cardboard prototype
visual sonnet
Progress kind of
Finished product would be like 700-1000€ plus the api subs so not massmarked consumer ready yet
blissful kindle
Thank you for sharing. It's very interesting
visual sonnet
Thank you for sharing. It's very interesting
No problemo 👍
The little bucket of bolts reacts to getting a new body! (Now using GPT4 of course!)
visual sonnet
nova lichen
lol I love this little guy
visual sonnet
lol I love this little guy
Thank you!
visual sonnet
Rob gets his first arm! 😄
inland prairie
Rob gets his first arm! 😄
so cute, how did u start making Rob?
visual sonnet
so cute, how did u start making Rob?
Started of simple with wheels and a frame to learn python etc, then I just added on thing at the type, eventually he started talking back lmao
sharing my reddit showcase of a conversation with Rob while showing what I have to stare at everyday til I go insane lmao
arctic dagger
Hey I think I saw this on reddit! Was it you?
visual sonnet
Probably lol
visual sonnet
It passed the mirror test yall
warped pond
Was that genuine surprise at the end there? How does he know what he looks like? Really nice work btw 😂👌
obsidian sorrel
RobGPT is my little companion that from a start could do things like chase a las...
WE NEED TO REVIVE THIS
obsidian sorrel
Rob gets his first arm! 😄
WHAT THE ||BEEP|| FOR REAL?!
wanton ferry
