Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test BenchmarkDotNet against unstable/multimodal benchmarks from CoreCLR/CoreFX repo #714

Closed
5 tasks
adamsitnik opened this issue Apr 10, 2018 · 1 comment
Closed
5 tasks
Assignees
Milestone

Comments

@adamsitnik
Copy link
Member

We are considering switching from xunit-performance to BenchmarkDotNet for CoreCLR and CoreFx repositories.

One of the requirements is to test BDN against the most problematic benchmarks:
https://github.com/dotnet/coreclr/issues/11657#issuecomment-365743836
https://github.com/dotnet/coreclr/issues/16613#issuecomment-371589608

  • port the benchmarks to BenchmarkDotNet
  • run them every 6 hours for at least 2 weeks for same .NET Core version
  • store the results
  • analyze the results
  • share the results + analyzis

/cc @AndyAyersMS

@adamsitnik
Copy link
Member Author

Done, everything available in a new repo: https://github.com/dotnet/performance/

+-20 of the 2000 benchmarks are not stable. Mostly multithreaded benchmarks (which rely on ThreadPool heuristics), loop body alignment (for benchmarks that do have their own loop), array body alginement

@AndreyAkinshin AndreyAkinshin modified the milestones: v0.11.x, v0.11.4 Feb 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants