New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
use dialog fixtures and fix flaky tests #1249
Conversation
while super focused on flaky test errors I forgot about linter errors. ok, now this is ready for review. |
Signed-off-by: Allie Crevier <allie@freedom.press>
Thanks @creviera for opening this, the tests do appear to be more reliable. With
|
@emkll curious how many times you had to run |
also, could you post your results of the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
could you post your results of the make test
make test is working fine, I've tried over 20 runs and it's reliable
In sd-app
, make test-random
is now almost working as expected (had 1 failure due to deleted object in 20 runs)
I'm inclined to merge as-is based on my results described above and the variance in my local environment, as this is already a significant improvement
Merging per the conversation in standup today, thanks @creviera ! |
Description
Fixes #1139
Test Plan
Confirm #1139 is fixed.
make test
instead ofmake test-random
and modify how many times you loop if you're not satified with 10 (I've tested with 100)