Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crater seems to sometimes test outdated crates #727

Open
RalfJung opened this issue May 8, 2024 · 1 comment
Open

Crater seems to sometimes test outdated crates #727

RalfJung opened this issue May 8, 2024 · 1 comment

Comments

@RalfJung
Copy link
Member

RalfJung commented May 8, 2024

The crater run at https://crater-reports.s3.amazonaws.com/beta-1.78-1/index.html tested version 2.0.1 of the stabby-abi crate. However, at the time of that crater run (which unfortunately not visible in the report, you have to find the PR to see it started on March 26), version 4 of that crate had already been released (release of 4.0.0: March 4). Why did crater test an outdated version of the crate?

This unfortunately led to us missing a regression, since stabby 2 failed to build with the stable baseline for that beta regression run, making crater unable to detect further regressions. See here for context.

Cc @rust-lang/infra -- not sure who is maintaining crater?

@RalfJung
Copy link
Member Author

RalfJung commented May 8, 2024

In fact the latest beta run at https://crater-reports.s3.amazonaws.com/beta-1.79-1/full.html still tests stabby-abi 2.0.1. Something seems very wrong here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant