Skip to content

Automate SDK comparison baseline updates #3062

@lbussell

Description

@lbussell

The Problem

Today, we have SDK baseline comparison tests that make our CI show a warning. Since it doesn't fail the pipeline and updating the baseline is cumbersome, the CI is permanently yellow and we gain no value from the comparison tests.

Solution

We should automate updating the SDK comparison test baseline (and potentially the poison test too if that's applicable). I think this could happen in the monthly source-build-release pipeline along with the automated updates to global.json and Private.SourceBuilt.Artifacts versions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area-testingImprovements in CI and testing

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions