Qwen tool calling

[regal fog]

So, I am testing the model and I can't seem to get it to call the tools either

[silver scroll]

I've used qwen a bunch on ollama so I can help if needed

[regal fog]

My guess is that, even though the model is compliant with the OPENAI library, it seems that it's not (for the 2.5-coder,14B)

[regal fog]

Did you manage to get it to do some tool calling ?

[silver scroll]

yep! one sec

[silver scroll]

so one thing about all these different models is they all respond differently to prompts. So a good system prompt for gpt-4o might not be great for qwen.

Anyway, for qwen I always put - Always write changes to files to the original files in the workspace in the system prompt so that when it comes up with new files or file changes it calls the write function after

[regal fog]

(based on the image) Completely off, based on current llm branch (dev version)

Like it currently just doesn't see my local (ollama qwen) tools

[silver scroll]

It's working fine for me on 17-llm.1 but let me pull llm.2

[regal fog]

Is it with qwen-coder-2.5 ?

[silver scroll]

qwen2.5-coder:14b

[regal fog]

Yeah so exactly the same 🙏

[silver scroll]

Yep definitely working on my end, screenshot in a sec

one sec i'll run another prompt and screenshot the tool calling

To fix I'd try more prompting and maybe if you can share what NodeWorkspace looks like in case there's a bug with it

[regal fog]

cc @fervent lagoon 🙏

[regal fog]

Re-compiling the engine -- interested to sync 5 min when finished recompiling, just to double chefck 🙏

(it's gonna take 10min, my computer is heating ahha)

[regal fog]

i'm on dev-audio 🙏 Feel free to hop in anytime