persist gomodcache between CI runs | Discord Gophers | Page 1

undone swallow May 28, 2025, 6:47 PM

#

I am using woodpecker-ci, anyone knows how I can cache the module downloads between runs? takes forever.
there is a volume mount option, but I have no idea where the folders for the cache live.

hearty cypress May 28, 2025, 6:53 PM

#

it'll depend on which image you're using

undone swallow May 28, 2025, 6:55 PM

#

hearty cypress it'll depend on which image you're using

It was a test run for golangci-lint, nothing else

#

Let me get the yml file real quick

#

when:
    - event: push
      branch: "**"

steps:
    - name: lint
      image: golangci/golangci-lint:v2.0.2
      commands:
          - golangci-lint run -v

hearty cypress May 28, 2025, 7:05 PM

#

looks like it's /go/pkg

#

mount a folder to that path and you should be good

undone swallow May 28, 2025, 7:06 PM

#

hearty cypress mount a folder to that path and you should be good

ty, 'll give it a go

hearty cypress May 28, 2025, 7:07 PM

#

if you're using the golang image to compile as well, you should be able to use the same path there too

rose geyser May 28, 2025, 8:49 PM

#

you can compare with the github actions, I think the directories are configurable (like for go itself people change the gopath so it gets cached)

undone swallow May 28, 2025, 9:19 PM

#

rose geyser you can compare with the github actions, I think the directories are configurabl...

yeah, I am slowly caching things in the pipeline. it's quite annoying that the woodpecker container has absolutely no coreutils in it though

#

my slow brain eventually figured out I could copy busybox over and use that to get a shell

undone swallow May 31, 2025, 12:50 AM

#

@hearty cypress @rose geyser after much work I managed to make this monster of a CI pipeline work

#

well, it's a pretty standard pipeline but the code generation and caching the tooling was an annoyance

rose geyser May 31, 2025, 12:52 AM

#

grats. what’s ur cache key?

undone swallow May 31, 2025, 12:54 AM

#

rose geyser grats. what’s ur cache key?

if you mean how I invalidate this stuff, I haven't even started to think how... right now I just run a cron that wipes the cache directory every so often

#

may just do a checksum based on go.mod and go.sum and invalidate everything based on if it changes

rose geyser May 31, 2025, 1:02 AM

#

can you have more than 1 build in flight? (is the cache some s3 bucket or shared somehow or just local to runner)

undone swallow May 31, 2025, 1:02 AM

#

rose geyser can you have more than 1 build in flight? (is the cache some s3 bucket or shared...

local to the runner, we have a single runner setup, so the cache is never shared

#

sorry, I lied. it's not local to the runner

#

but we only have 1 runner

#persist gomodcache between CI runs