#Companion app as assist satellite

1 messages · Page 1 of 1 (latest)

slender portal
#

Surprised this didn't come up here, but couldn't find it. Is there a way to make the companion app an assist satellite. This could be especially useful in conjunction with ask_question and start_conversation.

steady dove
#

Currently it is not possible

slender portal
steady dove
#

No one built yet, sounds like weird user experience.. perhaps for wall mounted tablets makes sense

slender portal
#

I can think of so many use cases, especially on my phone. Just one example - phone connects to carplay -> ask a question (e.g. "would you like to open the garage gate?")

cloud cradle
#

I agree that there are many use cases but all I can think of are somewhat stationary situations (car, wall panel, phone in docking station) and I think that's the reason it is not on everyone's radar yet. People think "why would I want to have my phone ask me questions out of my pocket"

slender portal
#

I don't know what't the definition of stationary, but here's one that I think doesn't fit it - an automation with a trigger when one of the kids gets home, asking me whether to turn something on.

#

I could be anywhere when that happens

steel timber
#

asides from answering with your voice which can be super weird in some situations and not work at all if its in your pocket or not near you....an actionable notification seems the best fit....also what do you do if you dont have your phone and only take out your watch? lots of considerations at play

slender portal
#

I agree that there are lots of considerations, but I think those can be solved.
In any case, even just the "stationary" use cases are interesting enough IMO.

steady dove
#

If the app is in background, consider that none of those ideas would work, only in foreground. OS limitation.

#

Unless coming from a context where Assist "calls" you, using a phone call UI

slender portal
#

First of all, assist calling you is definitely an interesting idea.
Second, even if it's just with CarPlay / Android Auto as a first step, i think it will be immensely useful.

steady dove
#

The thing is that CarPlay doesn't allow that either, the "call UI" would also be required.

slender portal
#

Got it. Currently I'm using iOS shortcuts to achieve that, but that doesn't work reliably enough, and writing automations with shortcuts is a pain. I like the "call UI" idea.

steady dove
#

Whats your current use case which you use shortcuts for?

slender portal
#

For example - when I start the car, I have it asked me all sorts of questions (should it open the gate? should variout things around the house be turned off, etc...)

steady dove
#

Wouldn't be better to just open the carplay app and tap to execute those actions? It's all personal preference I know, but just checking

slender portal
#

Not really, because:

  1. I want to start driving, so would rather use my voice than fingers
  2. The carplay app is not easy to navigate if you want to control several entities
steady dove
#

For point 1 I don't have a counter offer haha, it's a preference.
2. You can put all those actions in the "Quick access" tab and then execute what you need, it can even be a script that does it all for you

slender portal
#

Yes, but the answers aren't consistent, so it pretty quickly becomes a mess with all of the options (2^number of entities involved)

slender portal
#

Do you want me to open up an architecture discussion for this?

opal axle
#

I have also been trying to figure out a reliable way to trigger voice assists through carplay without success. This would be fantastic if it can developed.

steady dove
#

@slender portal Honestly I don't think the Apps will ever be Assist satellites, they are just not the same as a speaker laying on your desk and they are limited to what iOS and Android platforms.

Regarding CarPlay, I saw that ChatGPT can now be triggered from the CarPlay widgets in iOS 26, so this looks promising for Assist as well

#

But feel free to start this conversation, it's just my perspective, perhaps others can bring more value to the discussion as well

slender portal