#Help with using Qwen Coder as api on A40 48GB (not reading in the .MD files on start)

1 messages · Page 1 of 1 (latest)

stone crane
#

I think my md files are NOT being injected. When I use anthropic api (first few days of using openclaw, ran outta tokens FAST!) anyway on anthropic haiku 3, everything worked great, md was very obviously used and we got on like a house on fire.

I knew things would change moving to a self-hosted api, I got this model working Qwen2.5-Coder-32B-Instruct-AWQ, but now its like the bot just thinks its a chatbot with no real prompting or memory etc. It also cant use anything or read in those files. What happened?

For contrast, on my first go around, with anthropic haiku, it got to know me, started using MEMORY.md, had me install things so tools could work, was doing TTS over my speakers and wrote 5 chapters of a book, copied them to its host laptop usb drive, and printed them on my network printer. I mean, it worked pretty good.

I nuked that bot (I still have the workspace stashed away) and started over, but I cannot for the life of me get any agency out of any models and I can host a few on this bad boy.