#Filtering toolkits by disabled tag in tool router doesn't prevent it recommending those tools

9 messages · Page 1 of 1 (latest)

topaz mulch
#

Instead, it recommends the tools, only for the tool to fail when the agent tries to call it, due to the exclusion.
What is the point of tool router if it cannot filter out excluded tools at the point of routing??

My use case is using the readOnlyHint etc tags as a workaround for proper filtering by scope. By setting these flags globally users can prevent the agent performing these broad actions. Which it does, but only by causing them to error...

I agree with @scenic pelican in this thread https://discord.com/channels/1170785031560646836/1463479555141533780
that without at least one of these features, the tool router isn't really fit for purpose in a production app, without a load of extra guardrails - at which point we may as well roll our own.

Hope you will treat this as a high priority issue as the tool router is a great idea in principle.

scenic pelican
#

Yeah, would love to hear a response from Composio on this. Don't wanna be too harsh, but without working tool filtering and scope validation the tool router doesn't make sense to recommend for production use imo. At least not without a big disclaimer

topaz mulch
#

Cheers. I notice Rube has the same limitation - if I connect an account but don't grant all the requested scopes, the agent carries on regardless and errors when it tries to call it.
Thanks Composio team, this is a really great feature if you are planning to iron this out

sour eagle
#

Hey @topaz mulch, really appreciate this feedback. Would you mind hopping on a quick call with our product team? We're keen to understand your workflow better and discuss how we can improve this. Calendly link

Calendly
15 mins - Palash Support - Palash Kala

General chat to know overall feedback about the product

dusk herald
#

@sour eagle
I wanna work with your team as an AI/ML full stack engineer.
I am very familiar with AI agent development and RAG system.
Can I schedule a meeting via your calendly link?

sour eagle
dusk herald
#

Please check my CV and let me know if you'd like any additional information or a time to connect for a quick call.

sour eagle