Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance regression tests #3215

Open
adangel opened this issue Apr 12, 2021 · 0 comments
Open

Performance regression tests #3215

adangel opened this issue Apr 12, 2021 · 0 comments
Labels
an:enhancement An improvement on existing features / rules for:performance The goal of this change is to improve PMD's performance

Comments

@adangel
Copy link
Member

adangel commented Apr 12, 2021

Is your feature request related to a problem? Please describe.
See #2048 (comment)

If we have a regression test that checks performance, we might see such issues earlier.

Describe the solution you'd like
The solution is not clear yet. Maybe we can leverage pmd-regression-tester to keep an eye on performance/runtime of the analysis?
The specific problem was with xpath rules, where type res was not enabled before…
Depends on the ruleset
Maybe extra rule for performance testing, that calls e.g. type res or other components (not a real rule) (eg rulesets/internal/diagnostics.xml) / benchmark

As a first step: Maybe analyze a defined set of projects with every release and record the timings.

Another first step: Manual Github Actions workflow - with parameter using two PMD versions (last release, current SNAPSHOT) - to compare the timings.

Describe alternatives you've considered
TODO

Additional context

@adangel adangel added an:enhancement An improvement on existing features / rules for:performance The goal of this change is to improve PMD's performance labels Apr 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
an:enhancement An improvement on existing features / rules for:performance The goal of this change is to improve PMD's performance
Projects
None yet
Development

No branches or pull requests

1 participant