Continuous performance testing #2000
Labels
answered
For when a question was asked and we referred to forum or answered it.
c: Performance
For when we could improve the performance / speed of Matomo.
c: Tests & QA
For issues related to automated tests or making it easier to QA & test issues.
Task
Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
We have done a lot of work on unit testing, integration testing and come up with an excellent Hudson setup. These have proved incredibly useful and time saving.
Now, it would be great to be able to automatically tell whether Piwik overall performance is impacted by a change or set of changes.
There are a few facts that we want to keep an eye on, and learn more about:
To help assess whether Piwik performance is improved following a change, and to generally help developers be more aware of the performance of Piwik in a high load environment, we could automate performance testing completely.
This is my proposal for continuous performance testing in Piwik. Please comment if you have any feedback or idea.
Performance test script
Manually run this script
A manual run of the script, with very high speed, concurrent connections, is equivalent to a stress test. It will highlight what is the limit of traffic piwik can handle.
Continuously run this script
The goal is to run this script as part of our continuous integration process.
Other notes
The text was updated successfully, but these errors were encountered: