#You can now deploy Chroma ๐Ÿงฌ in Kubernetes โ˜

1 messages ยท Page 1 of 1 (latest)

inland creek
#

You can now deploy Chroma ๐Ÿงฌ in Kubernetes โ˜

inland creek
noble dagger
# inland creek https://github.com/amikos-tech/chromadb-chart

Great! We also work with Kubernetes at work and plan to create Helm Charts for the Chroma database tomorrow. We will take a look at your charts and possibly provide feedback ๐Ÿ™‚

If you need someone to test or review new features, feel free to reach out to me ๐Ÿ™‚

noble dagger
# inland creek We're looking to make this as production ready as possible so new features such ...

Our Chroma DB runs together with backends and frontends behind a firewall with an ingress to the frontend. So we don't need an additional auth layer on top.
I am currently working on building a Strapi plugin on top of the Chroma API. When accessing the Chroma database through it, I have my auth layer. Of course, this has a minimal performance impact since I'm not communicating directly with Chroma.

#

Having an AuthN/AuthZ layer would still be nice, as it might save me from having to manage permissions in Kubernetes ๐Ÿค”

inland creek
#

@noble dagger If you need auth then that is a problem I have already solved. I use oauth_proxy2 + Keycloak (but any IdP will do). I'm preparing an article about this + I'll update the chart with the setup. DM me I can send you my preliminary manifests and notes about this

inland creek
#

We now support 0.4.3 and 0.4.4 (last night's release)

noble dagger
#

We have our chroma k8s setup done, I'll compare it next week with your repo ๐Ÿ™‚

inland creek
#

I'm done with Auth (OIDC with Keycloak) + Backup/Restore but haven't had time to properly test and release those changes, possibly next week ๐Ÿ™‚

inland creek
#

Chroma 0.4.5 is now also supported

primal sluice
#

@inland creek you are a shipping machine!

inland creek
#

@primal sluice I cannot take credit for the awesome tools at open source's disposal, besides you guys make it easy by not breaking the API ๐Ÿ˜‰

noble dagger
inland creek
#

well the Chroma team has done a fantastic job

#

so many abstractions you can literally make this work in most scenarios

inland creek
#

new release 0.1.10 of the chart now supports lower k8s API version 1.23.0 through 1.27.x

inland creek
#

new release 0.1.11 supports Chroma 0.4.6 and has multi-arch images which would reduce the boot time of containers quite a bit