#Dagger Cloud

1 messages · Page 1 of 1 (latest)

low sorrel
#

I looked through your traces from before that happened to see if there were any clues on what might have caused it

#

(I'm fairly certain this has popped up occasionally for a while now, don't think it's new to v0.19.10)

#

with an extremely odd error

#

was that error obviously related to something you were testing?

teal bough
#

Yes its what I was testing 😛

#

it successfully failed that time

low sorrel
#

I see

teal bough
#

but maybe another time I cancelled a call at an unfortunate time and got into a weird state?

low sorrel
low sorrel
teal bough
#

oh but that was after things were broken

#

so yeah there's the one you first linked and then the next run things were busted

low sorrel
#

if this happens again can you run:

docker logs dagger-engine-v0.19.10 2>&1 | cat >engine-logs.txt
docker exec dagger-engine-v0.19.10 tar czf - /var/lib/dagger > engine-state.tar.gz

and send me that data?

#

basically exfiltrate amap before blasting it away

teal bough
#

yeah for sure

teal bough
low sorrel
teal bough
#

nothing that would do this I think

> git status
On branch defaultable_containers
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
    modified:   core/integration/module_go_test.go
    modified:   core/integration/module_python_test.go
    modified:   core/integration/module_typescript_test.go
    modified:   core/integration/toolchain_test.go
    modified:   core/modfunc.go
    modified:   core/typedef.go
low sorrel
#

I'm not sure, the fact that the engine in this case was an ephemeral one doesn't help laughcry

#

As a silver lining, while I was looking at the engine logs in your trace I saw a line from containerd saying it didn't find something called igzip, which turns out to be the latest/greatest way to compress/decompress image layers, superseding pigz, so I guess we may get a little perf boost from that 🤷‍♂️ https://github.com/dagger/dagger/pull/11709

teal bough
#

Nice! Well I nuked my engine and reran the tests and it worked, so I guess the cache in the engine was indeed borked. I didn't see anything particularly interesting in the engine logs from the failed run but here's a snippet thats a bit sus

time="2026-01-16T17:43:05Z" level=debug msg="load cache for dagop.ctr Container.withExec with wynzr02x3n5uj5fm6ftk3gxpp::r61wgwrge6ivcl9relgz12w15"
time="2026-01-16T17:43:05Z" level=debug msg="load cache for dagop.ctr Container.withExec with wynzr02x3n5uj5fm6ftk3gxpp::hy95kdum09vapy6mj3jexc68a"
time="2026-01-16T17:43:05Z" level=warning msg="TrimErrPathPrefix: unhandled type" type="<nil>"
time="2026-01-16T17:43:05Z" level=debug msg="load cache for dagop.ctr Container.withExec with wynzr02x3n5uj5fm6ftk3gxpp::qe8w0iz7sq1qmkcwpyvjf5j2y"
time="2026-01-16T17:43:05Z" level=debug msg="function call done" client_hostname=dagger client_id=l9xxv05dnml205pratxwxbv5x function=env module=go object=Go session_id=hlvtviyuimty9n3k6x099uc79 spanID=0b2d689e17998ef6 traceID=d1e6243862b29cae66521a2b2a92fdf8
time="2026-01-16T17:43:05Z" level=warning msg="collectPBDefinitions: unhandled type" type="*core.CacheVolume"
time="2026-01-16T17:43:05Z" level=warning msg="collectPBDefinitions: unhandled type" type="*core.CacheVolume"
time="2026-01-16T17:43:05Z" level=debug msg="ListType.ConvertFromSDKResult: got nil value"
time="2026-01-16T17:43:05Z" level=debug msg="ListType.ConvertFromSDKResult: got nil value"
time="2026-01-16T17:43:05Z" level=debug msg="ListType.ConvertFromSDKResult: got nil value"
time="2026-01-16T17:43:05Z" level=debug msg="ListType.ConvertFromSDKResult: got nil value"
time="2026-01-16T17:43:05Z" level=debug msg="ListType.ConvertFromSDKResult: got nil value"