Skip to content

Conversation

tamarinvs19
Copy link
Collaborator

@tamarinvs19 tamarinvs19 commented Sep 11, 2023

Description

Fuzzing forks

  • Used forks in python fuzzing: now we can go back to previous annotation with history having.
  • Current strategy: try to go back to the best annotations per 12 attempts.
  • Current results (number of executions per second) is not worse then previous version on examples.
  • Suitable case: samples/controlflow/conditions.py. Here we can set a big timeout and cover all branches through returning to the previous annotations.

Execution counter

  • Added cli argument --execution-counter to save a number of executions. It can be helpful if you need to measure the speed of utbot python
  • Added some scripts in samples/testing_utils to collect and show executions information.

Code refactoring

  • Small cosmetic changes

How to test

Automated tests

Run run_tests_all.sh and check that all examples have expected coverage

Self-check list

Check off the item if the statement is true. Hint: [x] is a marked item.

Please do not delete the list or its items.

  • I've set the proper labels for my PR (at least, for category and component).
  • PR title and description are clear and intelligible.
  • I've added enough comments to my code, particularly in hard-to-understand areas.
  • The functionality I've repaired, changed or added is covered with automated tests.
  • Manual tests have been provided optionally.
  • The documentation for the functionality I've been working on is up-to-date.

@tamarinvs19 tamarinvs19 added comp-fuzzing Issue is related to the fuzzing comp-cli Issue related to CLI lang-python Issue is related to python support labels Sep 11, 2023
@tamarinvs19 tamarinvs19 self-assigned this Sep 11, 2023
Copy link
Collaborator

@Markoutte Markoutte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tamarinvs19 tamarinvs19 merged commit 45e1d37 into main Sep 12, 2023
@tamarinvs19 tamarinvs19 deleted the tamarinvs19/python-fuzzing-refactoring branch September 12, 2023 07:30
tamarinvs19 added a commit that referenced this pull request Sep 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp-cli Issue related to CLI comp-fuzzing Issue is related to the fuzzing lang-python Issue is related to python support
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants