contextual directory data exceeding error on CI

[grim bane]

🧵 @next breach moving discussion here to keep it focused

only using this:

// +ignore=["!**/go.mod", "!**/go.sum", "!**/*.go", "!**/*.json"]

as far as I understand this filter should only add go related files + json files

this is the biggest items in repo

925M    .
389M    ./services
370M    ./.git
367M    ./.git/objects
365M    ./.git/objects/pack
348M    ./.git/objects/pack/pack-994a4382b620d5f172e9e0983913af037bec3fc4.pack
135M    ./<redacted service dir>
 98M    ./<redacted service dir>
 72M    ./<redacted dir>
 71M    ./<redacted test data>.json
 65M    ./<redacted>

[pallid elbow]

You need a first pattern of "**" otherwise nothing is really being excluded.

[grim bane]

oh, first I need to exclude everything than add by ! again

than video in blog post for 0.130 shows wrong config. I got this ignore pattern from video

[pallid elbow]

Oops @orchid hearth

[grim bane]

by the way, I tried it but it didn't worked.

// +ignore=["**", "!**/go.mod", "!**/go.sum", "!**/*.go", "!**/*.json"] is this the correct one?

[orchid hearth]

Hmm interesting! @novel arch could you share an updated video with me? I’ll remove the gif from the blog post for now.

@static plaza 👀 in case we need to make an issue for this one

[grim bane]

I guess previous issue failed from cache or something else, currently it started to working as expected

but original issue still exist after ignore adjustments

8   : ci: Ci!
9   :   upload /builds from ae12e2z4nbx52qfy3wd3sytip (client id: foecfbpqeyr64z206w9uvnst0, session id: jqel3mn4ytcctb4nqnqd1q2pt) (exclude: **, !**/go.mod, !**/go.sum, !**/*.go, !**/*.json, !**/*.sql, !**/*.sh, !**/*.yml, !**/*.yaml, !**/*.xml, !**/*.txt)
9   :   upload /builds from ae12e2z4nbx52qfy3wd3sytip (client id: foecfbpqeyr64z206w9uvnst0, session id: jqel3mn4ytcctb4nqnqd1q2pt) (exclude: **, !**/go.mod, !**/go.sum, !**/*.go, !**/*.json, !**/*.sql, !**/*.sh, !**/*.yml, !**/*.yaml, !**/*.xml, !**/*.txt) ERROR [2.8s]
9   :   ! rpc error: code = Internal desc = received 4294967295-bytes data exceeding the limit 98428 bytes
8   : ci ERROR [2.8s]
8   : ! failed to set call inputs: failed to load contextual arg "source": failed to load contextual directory "/": failed to import local module src: rpc error: code = Internal desc = received 4294967295-bytes data exceeding the limit 98428 bytes

[static plaza]

This one should works, that's strange

[grim bane]

yes it work, not sure why it failed during first try.

[novel arch]

@orchid hearth do you mean the video in https://dagger.io/blog/dagger-0-13... if so, it wasn't created by me

[grim bane]

Small summary to make it clear.

• after fixing ignore pattern to // +ignore=["**", "!**/go.mod", "!**/go.sum", "!**/*.go", "!**/*.json"] I started to get less files in module.
• failing loading due to size of the contextual issue still persist and occurs ~10-20% of ci/cd runs at the moment.

[orchid hearth]

@static plaza should we update the .gif or anything else realted to this?

[static plaza]

It's strange you still have fails, since we're actually importing the dir with the ignore, it's not like we first load the dir then apply ignore so it's should be much lighter

[grim bane]

still I need to pass most of the repo which includes big json files contains test data etc.

[static plaza]

I see, you cannot compress it and extract it once you're in the container? To avoid this problem

[grim bane]

no, this is a mono repo contains ~100+ different components managed by different teams. I already filtered big part of the repo but some ci jobs still failing.

it seems we're exceeding limits here, can't we change this limit. Is it something configurable by dagger engine?

 received 4294967295-bytes data exceeding the limit 98428 bytes

[static plaza]

I'm pretty sure you can config the underlying buildkit engine following that doc: https://docs.dagger.io/manuals/administrator/custom-runner

If there's an option in Builkit to increase that limit, then you'll need to run the dagger engine with that toml config (see doc)

[next breach]

👀

this limit isn't configurable

this limit comes from a grpc message being too large

but i have no idea why a message like this can be too large?

we chunk file contents, so this shouldn't be an issue 🤔

also, why is the limit constantly changing?

wait no

this is different from other grpc message issues i've seen

https://github.com/moby/buildkit/issues/4948

we did recently bump grpc

hm, it looks like https://github.com/grpc/grpc-go/issues/7641

we should downgrade grpc temporarily until this is fixed imo

[next breach]

opened a pr to do that: https://github.com/dagger/dagger/pull/8507