Adding profiling tests#3603
Merged
rv-jenkins merged 37 commits intodevelopfrom Aug 30, 2023
Merged
Conversation
Robertorosmaninho
force-pushed
the
profiling-tests
branch
from
8841eca to
3996c76
Compare
F-WRunTime
reviewed
Aug 28, 2023
Changing the path of `spwan-kserver`
F-WRunTime
approved these changes
Aug 29, 2023
dwightguth
suggested changes
Aug 29, 2023
Contributor
dwightguth
left a comment
dwightguth
left a comment
There was a problem hiding this comment.
We don't need IMP twice.
Set as an error not finding the kframework.deb package
dwightguth
approved these changes
Aug 30, 2023
rv-jenkins
pushed a commit
that referenced
this pull request
Sep 5, 2023
Fixes #3517 Follow up of #3603 This PR Introduces Bencher.dev to track performance regressions on our benchmarks. The Benchmarks already run in the Test-PR Workflow as "Performance Tests" CI. This PR introduces a third-party program that will collect the JSON results of these executions and display them in a graphical online tool. It will also set a threshold for the time/space that each test, and if an execution passes this limit, the tool will post a comment on the PR warning the developer which tests the regression was observed. The CI will also fail, which won't prevent the PR from being merged.
5 tasks
Closed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Part of #3517
Introduce tests to work as a benchmark for profiling
kompilebuild time and space consumed.These tests were obtained with
kompile -Eon each semantic/test and are the following:A new make command is introduced here:
make profile, which runsmake clean && /usr/bin/time --format x --output y make kompile.Where
yis the file name.profiling-results.jsonwhich contains the information in this formatx:This output file will be consumed later by a framework to measure and compare the performance results.