sweet fjord
So I'm not planning on using this device for smart home automation, but instead, a Gemini-powered assistant that can link into my Google services but also allow me to link other things in too.
Just wondering if anyone is doing something similar. Memory etc.
Bonus points if someone has already done the project and it's something that can be "integrated" or "installed".
stark wigeon
Which device?
sweet fjord
Which device?
Sorry, the voice assistant preview edition
stark wigeon
I don't think you can do it without having HA in the middle. And still - PE has access to the HA devices, but not to Google Home devices. I'm pretty sure there's no way to connect PE directly to the Google.
Maybe some MCP server could do that, but you still need intent server for this (the one that will link STT, TTS and MCP together).
sweet fjord
I don't think you can do it without having HA in the middle. And still - PE has ...
Well I'm able to use Google Search, for instance, as my speaker agent, and able to use ElevenLabs as my output. So in tha regard I have a "Gemini" smart speaker.
What doesn't work is basically anything else. I was hoping that I could implement a memory system at the very least, to then interact with in a dashboard - like a memory repository - being able to upload files, add in things I want it to remember etc.
Having it as a dashboard would make it platform agnostic.
As I expand on it, I'd like it to integrate with more things - Limitless Pendant for all the audio I record during the day, and whatever "plugins" I'd like to add later, like Google Calendar etc.
I assumed this smart speaker would obviously need to be integrated into HA, which I'm fine with, but if it's really made more for controlling your home then maybe I'm barking up the wrong tree
sweet fjord
And I know HA has a lot of Google hooks into their services, so was hoping to leverage that.
sweet fjord
Also I could just use .ICS calendar, I'm assuming, to hook in my calendar too?
I'm surprised there's not more talk about building something out that isn't purely home control
stark wigeon
It's more like using highly specialized device with something it's not intended to. 🙂
HA can use calendars. I doubt it can manage events, but it definitely can read.
sweet fjord
I just assumed if there's an integration in HA then it should be able to be accomplished with this device.
Also, HA in general seemed to me about skirting around the norms to do crazy, or at least different kinds of projects not possible on other platforms.
But hey, I'm seeming to be in the minority!
stark wigeon
Well integrations do differ. Google is pretty closed platform, so integrations are somewhat limited.
HA is just aiming to provide the common ground for all devices it can. It's platform - so you can use it as you wish. But voice specifically is tied to HA tightly, because there's too much troubles making it right. 🙂
sweet fjord
Can you expand on how voice makes it too much trouble? I'd assume linking a LLM to HA would allow for more organic action-calling