workflow to compare model outputs

[andybeet]

When the code base is changed a workflow would execute that would run the model from its current "new" state and again from the current state of main. Comparisons between the two would then be made to determine if any unexpected issues arise

We would need

• basic comparison of model runs to identify unexpected issues. Eg. Biomass comparison

What kinds of metrics would we want to compare?

[andybeet]

We will just use biomass by species as the metric. If any species biomass changes by >10%, the workflow will fail. (This was discussed at Advantlis, Norway 2026)

Note: a failed workflow will not necessarily imply the code base change was buggy, since it will be expected that biomass changes will occur in some instances of codebase changes.