Tags and metrics

[candid horizon]

Hi everyone,

I need your help with my business case. I work on a platform team for a large company with thousands of projects. Each project is self-managed and pays for its own CI/CD resource usage (CPU, RAM, etc.). My team and I want to launch a Dagger offer for projects with a shared, ready-to-use Dagger Engine (for better DX). This means that each container launched through the same Dagger engine could belong to a different project. The problem is that we need to track each project's usage to charge them accordingly.

According to the Dagger documentation, it is possible to have telemetry for the engine. However, we haven't found a proper way to track metrics for each project. We see OTEL metrics for any container launched by the Dagger Engine, but we can't distinguish them with a tag that could be an ID or the project name, for example.

Do you have any suggestions for tracking the usage of each project with a shared Dagger Engine? Perhaps it's not currently possible, and I should reconsider my architecture and provide a dedicated Dagger Engine for each project.

[limber osprey]

hello! one possibility might be to use the fact that dagger telemetry is annotated with the dagger module emitting it. As long as each project defines its own dagger modules (which is the recommended approach especially for large organizations), you should be able to build your metering logic from there

just in case, it's probably a good idea to have a fallback to dedicated engines per project as you mentioned

@candid horizon want to get on a zoom call with a couple engineers to do a deep dive?

[pastel citrus]

^ this.

There's also additional metadata in the trace like the git repository used which could also help as a project identifier.

If you're using Dagger Cloud, you have the ability to create multiple tokens for each our your projects and we can give you fine-grained details about the usage of each of those tokens.

@candid horizon

[candid horizon]

Sorry for the delay in getting back to you. A zoom call sounds good to me why not! Could you please share your availability? I’ll be available starting from August 27.

[candid horizon]

I don't see any git information in the trace. How can I see that ? And we don't use Dagger cloud for the moment