Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add flaky test attribute and mark CanSeekForwardOnInterpolationFail as flaky #6140

Merged
merged 2 commits into from Jan 18, 2024

Conversation

frenzibyte
Copy link
Member

Been failing for quite some time now.

@@ -156,7 +156,13 @@ public void NeverInterpolatesBackwardsOnInterpolationFail()
Assert.Greater(interpolatedCount, 10);
}

// always failing on single-thread macOS CI, failing when test asserts interpolating.IsInterpolating = false
Copy link
Sponsor Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If it always fails, flaky probably won't work? It's only intended for intermittent failures.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well sometimes it passes (see current CI status), so I wasn't sure about fully ignoring it. But I could easily do so, and make the ignore macOS-only using Assert.Ignore. Will leave it to your call.

Copy link
Sponsor Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Dunno, I read your comment "always failing" and made the assumption that was the case. Change the comment to "Intermittently failing" i guess

@peppy peppy merged commit 1aeb3d6 into ppy:master Jan 18, 2024
13 checks passed
@frenzibyte frenzibyte deleted the add-flaky-test-attribute branch January 18, 2024 09:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants