#Agent style support in unsloth studio
1 messages · Page 1 of 1 (latest)
@hallow elk we're working on exposing an api endpoint from unsloth studio for GGUFs using llama-server, that way you can call the model from your own external workflow, claude code or even openclaw
Thanks but integrated workflow into studio for two things like router littlellm or python or some script language and for orchestration LangGraph becouse this is only way to get better resolution with small custom fine tuned llm on hardware with limited resources , problem is not so much tool cooling but use multiple fine tuned llm for specific task in orchestrated manner
we removed litellm because of the hack, we had it in recipes
yes but we're not an agentic platform. that would be a completely different product imho
and if we ever do it, we're probably not gonna use langgraph..
I was thingking you version of simple littellm and simple langraph just basic one for testing models but for deployment no there are different product but for testing and proof of concept to have all in one IDE
we already have tool calling , web search etc in chat
but you can't implement agent-style workflows reliably in a compacted way
imho
having said that
will think of a way, but definitely plugging in litellm or langgraph is not where we're heading
until then you can simply call the model and test it in an agentic framework via the openAPI compatible endpoint we're working on (should be out next week)