Advice on TTS interruption handling

[elder sparrow]

Hello, I am leading a small team right now, and we are developing an AI call center with Twiliio, and we're using Deepgram both for STT transcription and TTS. We are integrating into businesses soon and have clients lined up. You guys are the best. We love your STT and your TTS. They're both awesome products.

Currently, we are using Twilio's Gather function with speech_model set to deepgram_nova-2. We also have barge_in set to True, which allows interruptions.

We are exploring the possibility of directly integrating with Deepgram STT API with webhook/streaming to reduce costs since Twilio charges us a large fee for using gather. Do you have any advice, tips, docs, or even just features that will assist us to implement interruption handling so that a customer could interrupt the Deepgram TTS, start listening (with Deepgram STT), and then automatically end point?

Thank you!

[final basalt]

Thanks for asking your question. Please be sure to reply with as much detail as possible so we can assist you efficiently.

It looks like we're missing some important information to help debug your issue. Would you mind providing us with the following details in a reply?

• The programming language you are working in (e.g. JavaScript, Python).
• The deepgram product you are using (e.g Speech to Text, Agent API)
• A request ID that triggered your error or issue.

[elder sparrow]

Python. Deepgram STT and TTS api

[flint panther]

Hi @elder sparrow , I apologize that you didn't receive a response to this sooner. Let me see what I can find for you in terms of resources about interruption handling

[flint panther]

Actually we have a product coming out soon that has interruption handling built in, our Voice Agent API. I can get you early access if you're interested. Here's the product announcement page https://deepgram.com/product/voice-agent-api and the docs https://developers.deepgram.com/docs/voice-agent

[final basalt]

Hey there @elder sparrow~! Did you forget about this thread? Let us know if you still need help!

[elder sparrow]

Great! I requested access under the email [email protected]. My startup is scaling now, and I realized OpenAI's realtime API was way too expensive even though it was great. Will yours have a similar problem?

[flint panther]

Hey @elder sparrow ... I'm working on getting you access to the Voice Agent API. Can you let me know the name of your company?

[elder sparrow]

Yeah I put it as ProfitPathAI. I'm not set on that name though.

[flint panther]

OK I'll pass that on... I think we just need to know so we can set you up with some docs / slack channel

[flint panther]

@elder sparrow We've sent you the invite! You should check your email for the invitation.