supple flare
Hi there!
I'm using Dagger to power the build of my OSS project mycelium see: https://github.com/Fristi/project-mycelium-v2/blob/main/.dagger/src/index.ts
I improved the build today by pinning docker images, apt-get and using fine grained source directories and cached volumes as input
Locally it seems to work for a few parts of the build, but on CI (GHA) it builds all again. How to resolve ?
hasty gate
Hi there!
I'm using Dagger to power the build of my OSS project mycelium see: h...
hey Mark! we used to have a beta distributed caching service as part of Dagger Cloud which we have paused for now as we're revamping it with improvements based on the feedback we've received. Let me ping @crisp wigeon here so we can contact you once we're ready to onboard users to the new thing hopefully very soon 🙏
supple flare
That would be great! Curious when it will be possible 🙂
crisp wigeon
Hey Mark, best way to get distributed caching today is to use Depot https://dagger.io/blog/dagger-and-depot
they have built in support for Dagger and fast caching.
supple flare
That's an easy solution, but in GHA you can also restore directories between runners right? Could that be used to enable cache with running dagger in GHA?
hasty gate
That's an easy solution, but in GHA you can also restore directories between run...
that doesn't work. GHA cache is very tricky to work with. Behind the scenes it's an object storage service, not a network block storage device. So there's a bunch of operations that are simply slow, timeout or just can't cope with the default space you get (10gb) in the free tier
that's one of the things which made us look for other solutions and not recommended the native GHA caching given it's not designed for these type of workloads