where are api references for llm modules?

[hazy elm]

total newbie here. I was checking out examples for agents at https://github.com/dagger/agents/blob/main/toy-programmer/main.go and coudn't find references for Llm() or WithToyWorkspace() anywhere.
I've tried https://docs.dagger.io/api/reference/ with no luck.

Can anyone guide me to right direction for agent api docs ?

[vocal zenith]

👋 the LLM type is part of the Core API, but still in a dev branch, hence not yet in the "main" API docs.

We are rushing to get it merged, should be done in the next 2 weeks

this is why the docs for building AI agents with Dagger (https://docs.dagger.io/ai-agents) have you install a special pre-release version (VERSION=v0.17.0-llm.4)

[hazy elm]

aha. thanks. will look forward to the release. I suspect WithToyWorkspace() is also some type of generics api that can be applied to user-supplied data type?

[vocal zenith]

Yes, the static part of the LLM type is very small.

The "magic" comes from introspecting all available types (including from installed modules, like ToyWorkspace) and adding a setter and getter function for attaching them to the LLM state

So you can develop your own JCSuperModule; then LLM will magically have LLM.withJCSuperModule() and LLM.JSCuperModule()

[hazy elm]

got it. very cool. thanks for clearing that up.

[vocal zenith]

It also works with core Dagger types 🙂 For example:

dagger <<EOF
SRC=$(git https://github.com/dagger/dagger | head | tree | directory ./docs)

llm | with-directory $SRC | with-prompt "you have access to a directory. Inspect its contents to determine what software project it is part of. Search for all .mdx or .md files, summarize them in 1 paragraph max, and write the summary to SUMMARY.md" | directory | terminal
EOF

or:

dagger <<'EOF'
llm | with-container $(container | from alpine) | with-prompt "you have access to a container. Install everything needed to develop in Python" | container | publish ttl.sh/my-python-dev-container
EOF

[hazy elm]

good. This(https://github.com/dagger/dagger/blob/llm/core/llm.go) must be the code. Will look more into it.

[hazy elm]

btw, I tried this and my shell interpreted $ so I had to escape both appearances with \$.