Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Coverage Measurement in FuzzBench #453

Closed
jonathanmetzman opened this issue Jun 17, 2020 · 12 comments
Closed

Improve Coverage Measurement in FuzzBench #453

jonathanmetzman opened this issue Jun 17, 2020 · 12 comments
Assignees

Comments

@jonathanmetzman
Copy link
Contributor

We're planning on doing a lot of changes to improve coverage measurement in FuzzBench.
This will the tracking bug for those efforts.
@Shadoom7 can you mention this bugs in your pull requests so they can be tracked better.

@jonathanmetzman
Copy link
Contributor Author

The first step in these efforts is integrating clang coverage with FuzzBench.
There are some questions about whether it is fast enough for this purpose.
@Shadoom7 will try replacing SanitizerCoverage with clang coverage on a branch, and then do experiments to compare the speed of measurement using clang coverage vs sanitizercoverage. Ideally we would not support both systems, but if clang coverage is too slow. We will only use it at the end of an experiment.

@jonathanmetzman
Copy link
Contributor Author

Related to #77

@Shadoom7
Copy link
Contributor

#564
This PR replaces the sanitizer coverage with clang coverage

@Shadoom7 Shadoom7 pinned this issue Jul 21, 2020
@Shadoom7 Shadoom7 unpinned this issue Jul 21, 2020
@Shadoom7
Copy link
Contributor

#565
This PR will collect and store the covered region data in cloud storage

@Shadoom7
Copy link
Contributor

#595
This is the rebased version of #565.

@Shadoom7
Copy link
Contributor

#602
Some fix to ensure the coverage info is always dumped.

@Shadoom7
Copy link
Contributor

#618
Generate the clang coverage reports.

@Shadoom7
Copy link
Contributor

#622
A fix to reduce the memory use during measuring.

@Shadoom7
Copy link
Contributor

#657
Implemented two matrix and plots to measure and display the unique coverage of each pair of fuzzer and benchmark.

@Shadoom7
Copy link
Contributor

#662
Add one column in the Experiment table in database to better support merging between experiments.

@Shadoom7
Copy link
Contributor

#680
Fix the broken coverage reports.

@Shadoom7
Copy link
Contributor

#685
Some fix and implemented one more summary ranking plot of unique coverage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants