#github in parallel ?

1 messages · Page 1 of 1 (latest)

gritty crater
#

Hello. Let s say that I have these pipelines in github:

jobs:
  job1:
    runs-on: ubuntu-latest
    steps:
      - name: this is a very CPU intensive task that will take 5 minutes (even when running in dagger) 
        run:  echo "whatever"

  job2:
    runs-on: ubuntu-latest
    steps:
      - name: this is a very CPU intensive task that will take 5 minutes (even when running in dagger)
        run:  echo "whatever"

  job3:
    runs-on: ubuntu-latest
    steps:
      - name: this is a very CPU intensive task that will take 5 minutes (even when running in dagger)
        run:  echo "whatever"

  final:
    needs: [job1, job2, job3]
    runs-on: ubuntu-latest
    steps:
      - name: this will run hafter all other jobs have ran
        run:  echo "whatever"

My question is : How do I daggerize it keeping the following features:

  • multiple machine to run my pipelines (running job1 and job2 and job3 on the same machine would lead to 15 minutes build)
  • not handle to much yaml (I / nobody likes yaml files)

Thank you. (also is there anyway to start a github job / github action from withing a running dagger pipeline ?)

atomic vale
# gritty crater Hello. Let s say that I have these pipelines in github: ``` jobs: job1: r...

Hello! If you are certain that the 3 jobs need to run on 3 different machines, then you should keep them separate, each calling dagger with the appropriate arguments, see https://docs.dagger.io/ci/integrations/github-actions

Dagger provides a GitHub Action that can be used in any GitHub Actions workflow to call one or more Dagger Functions on specific events, such as a new commit.

#

There is definitely some yaml overhead, but the good news is that it almost never changes once setup.