Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the automatic link to Shepherd test results #2450

Closed
svgeesus opened this issue Jan 26, 2023 · 2 comments
Closed

Remove the automatic link to Shepherd test results #2450

svgeesus opened this issue Jan 26, 2023 · 2 comments

Comments

@svgeesus
Copy link
Contributor

Bikeshed currently adds an automatic test widget to CSSWG specs, both on drafts.csswg.org and on W3C /TR. This used to be very helpful, giving an implementation report broken out by spec section.

Given that:

  1. The tests that it reports on are now missing more than 2 years of additions, corrections and updates
  2. The reports rely on manual test running by an actual person, which I previously saw as a good use of my time and now don't because running a known-incorrect test has no value
  3. The tests and the reports give an inaccurate and very negative view of the state of implementation
  4. There is no prospect of the Shepherd test situation improving (the recent "month of work" to stop the drafts server falling over all the time did not include any work on the test area)
  5. The presence of the widget encourages people to run tests, and they will then draw inaccurate conclusions or even change implementations "to pass" known incorrect tests.

Then adding this link to all CSSWG specs has negative value and I am asking that Bikeshed remove (comment out code that adds) this widget. If at some future time it starts working again it can always be added back.

6237 well maintained tests? Or 118 out of date ones?

image

Related:

@tabatkins
Copy link
Collaborator

Agreed, done. I'll cut a new release in a little bit.

@svgeesus
Copy link
Contributor Author

\0/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants