tiny-llm

[vocal wharf]

hi everybody
Sharing the llm library I built for running LLM apps in production: https://github.com/zozoheir/tinyllm/tree/main
Here is an example of creating and evaluating Agent: https://github.com/zozoheir/tinyllm/blob/main/docs/examples/agent_example.py
it's great for building LLM based workflows to do things like [input meeting notes] -> [upload summary to a database]. Sort of like an LLM workflow API u can plug to the rest of your tech stack. LLM responses are standardized and easy to debug/trace.
any feedback welcome!

[stoic lily]

This looks nice! I'm using LiteLLM and I've been looking for something like TinyLLM to give me one more abstraction later and extra tooling for RAG etc.

Many of the LLM libraries today (langchain, llama-index, deep pavlov...) have made serious software design commitments which I believe were too early to make given the infancy of the industry.