How to debug a tool | OpenAI | Page 1

frosty umbra Jul 10, 2024, 6:28 AM

#

Does anyone know of a setup to test and debug tools locally? Preferably in vscode

I have only seen the syntaxis from the OpenAI tools but unclear how one debugs when writing such tools

junior steppe Jul 11, 2024, 4:07 AM

#

there's a bunch of examples of tool use, as well as on claude's pages too

willow umbra Jul 14, 2024, 8:24 PM

#

frosty umbra Does anyone know of a setup to test and debug tools locally? Preferably in vscod...

What sort of tools are you working with? My basic debugging flow for tools is just to have prints in the tool such that when its called you can see what's happening

frosty umbra Jul 15, 2024, 8:16 AM

#

@junior steppe you mean function calling examples like these?

overall it would be nice if there is a collection of all these "tools" somewhere (also from the community) so that one can reuse them more easily

#

@willow umbra atm just with vscode. I have the https://github.com/mckaywrigley/chatbot-ui deployed and for the "Tools" section it allows you to define something with these schema:

{'openapi': '3.0.0',
 'info': {'version': '1.0.0',
  'title': 'Event Management API',
  'description': 'An API for managing event data'},
 'paths': {'/events': {'get': {'summary': 'List all events',
    'operationId': 'listEvents',
    'responses': {'200': {'description': 'A list of events',
      'content': {'application/json': {'schema': {'type': 'array',
         'items': {'type': 'object
...

but I am, not sure how to debug here. Also I have not checked much the function calling feature so I that might be a place to start (?) (https://towardsdatascience.com/leverage-openai-tool-calling-building-a-reliable-ai-agent-from-scratch-4e21fcd15b62)

junior steppe Jul 15, 2024, 3:36 PM

#

the one thing langchain has done correctly is defining tools from functions easily.

I would recommend defining a tool from https://python.langchain.com/v0.1/docs/modules/tools/custom_tools/

@tool
def multiply(a: int, b: int) -> int:
    """Multiply two numbers."""
    return a * b

And then passing it into this function https://api.python.langchain.com/en/latest/utils/langchain_core.utils.function_calling.convert_to_openai_tool.html

So, convert_to_openai_tool(multiply)

Defining Custom Tools | 🦜️🔗 LangChain

When constructing your own agent, you will need to provide it with a list of Tools that it can use. Besides the actual function that is called, the Tool consists of several components:

#How to debug a tool