Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Overhaul benchmarking system #30

Open
unzvfu opened this issue Mar 21, 2020 · 1 comment
Open

Overhaul benchmarking system #30

unzvfu opened this issue Mar 21, 2020 · 1 comment
Assignees

Comments

@unzvfu
Copy link
Owner

unzvfu commented Mar 21, 2020

From data61#50:

Including, in no particular order

  • Generate data and graph it, rather than generating large difficult-to-interpret tables.
  • Generate data for all functions.
  • Allow generating data for specific functions.
  • Generate graphs of relative performance for related functions (e.g. How much faster is squaring to multiplication for various sizes?)
  • For each operation, work out the appropriate amount of data to use (currently we use a tiny amount for small fixnums and a largish amount for bigger fixnums -- this is inconsistent).
  • Understand what the optimal performance could be in important cases (e.g. mulmod, modexp).
  • Normalise the data gathered relative to some appropriately chosen device parameters (e.g. #SMs, #cores, core frequency, ...)
@unzvfu
Copy link
Owner Author

unzvfu commented Mar 21, 2020

Consider using the Google Benchmark library.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant