Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarking #102

Closed
hkdobrev opened this issue Feb 13, 2014 · 3 comments
Closed

Benchmarking #102

hkdobrev opened this issue Feb 13, 2014 · 3 comments

Comments

@hkdobrev
Copy link
Contributor

One of the most important features of Parsedown is its speed. It would be very useful to have a consistent way of measuring the performance of the parser across versions.

The purpose of this issue is to be the place to discuss implementations.

@hkdobrev
Copy link
Contributor Author

I think some kind of benchmarking should be performed on the CI server for every push and pull request. This way the author and the contributors would be able to easily see which feature or bug request is slowing it down without the hassle of installing software.

Some questions could be discussed about the implementation like:

  • Should the benchmarking should be a part of this repo?
  • Should there be a dedicated benchmarking tool for Parsedown only?
  • How do you perform the actual benchmark?
  • How do you compare the results across versions?

Some tools which could be used:

@cebe
Copy link
Contributor

cebe commented Feb 14, 2014

I think some kind of benchmarking should be performed on the CI server

I think this would cause problems because travis servers are not a good environment for benchmarking. They are virtual machines that are sometimes paused for a few milliseconds while running software so you can not do accurate measurements. Had some problems with testing timeouts there some time ago.

@aidantwoods
Copy link
Collaborator

Closing, but feel free to reopen if there is a reliable way of benchmarking performance on travis/another CI server :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants