dagger cache limit?

[latent trench]

Just ran into this error, nothing fancy just a java project. wondering what the magicache limit is?

time="2024-07-16T06:16:12Z" level=error msg="failed to export cache" error="unexpected status code: 400: <?xml version=\"1.0\" encoding=\"UTF-8\"?><Error><Code>EntityTooLarge</Code><Message>Your proposed upload exceeds the maximum allowed object size.</Message></Error>"

[mossy halo]

this error seems to be coming from the underlying storage provider. Looks like in this case it's AWS which has a maximum object size of 5gb. https://docs.aws.amazon.com/general/latest/gr/s3.html

cc @sand urchin. Not sure if it's possible to shard cache volumes somehow outside the context of storage drivers.