Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a halt-on-failure configuration parameter, allow fuzzing to continue to discover multiple results #22

Closed
Xenomega opened this issue Aug 29, 2022 · 0 comments · Fixed by #33

Comments

@Xenomega
Copy link
Member

Xenomega commented Aug 29, 2022

Currently the project will halt when the first failed test is discovered. Instead, we should have this as a configurable option where by default, we continue fuzzing to find other violations, but a user can specify to halt-on-failure if they choose.

This will require the following changes:

  • Adding a configuration parameter that enables halt-on-failure.
  • Refactoring of fuzzerWorker.testTxSequence to continue testing the sequence for other failures rather than stopping on the first failure.
  • Refactoring fuzzerWorker.run to not halt when a unique test is reported for the first time.
  • Refactoring the test results structures a bit
  • Removing property tests to validate as we find ways to violate them (to avoid re-testing them).
  • Adding logic to halt when there's nothing left to test.

This should be done with or after #21 , as that will change the results structure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant