Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

performance tracking integrated into the development process #3199

Open
andrewrk opened this issue Sep 9, 2019 · 2 comments
Open

performance tracking integrated into the development process #3199

andrewrk opened this issue Sep 9, 2019 · 2 comments
Labels
enhancement Solving this issue will likely involve adding new logic or components to the codebase. frontend Tokenization, parsing, AstGen, Sema, and Liveness.
Milestone
0.14.0

Comments

@andrewrk
Copy link
Member

andrewrk commented Sep 9, 2019 •
edited

Once the self-hosted compiler (#89) can build meaningful programs, it needs benchmarks to test the performance of various things. Such benchmarks should be run by the CI on every commit, and it should be easy to see a comparison across commits.

Such reports should also contain resource usage as well, such as peak memory usage.
@andrewrk andrewrk added enhancement Solving this issue will likely involve adding new logic or components to the codebase. frontend Tokenization, parsing, AstGen, Sema, and Liveness. labels Sep 9, 2019
@andrewrk andrewrk added this to the 0.6.0 milestone Sep 9, 2019
@andrewrk andrewrk mentioned this issue Sep 9, 2019
Closed
@andrewrk andrewrk modified the milestones: 0.6.0, 0.7.0 Mar 12, 2020
@andrewrk andrewrk modified the milestones: 0.7.0, 0.8.0 Oct 14, 2020
@andrewrk andrewrk modified the milestones: 0.8.0, 0.9.0 Jun 4, 2021
@andrewrk
Copy link
Member Author

Implemented at https://ziglang.org/perf/. The only missing component in order to close this issue is automatically running the benchmarks with the CI.

@andrewrk andrewrk modified the milestones: 0.9.0, 0.10.0 Nov 30, 2021
@andrewrk andrewrk modified the milestones: 0.10.0, 0.11.0 Aug 23, 2022
@andrewrk andrewrk modified the milestones: 0.11.0, 0.12.0 Apr 9, 2023
@epompeii
Copy link

Would you like to use the default CI runners or a dedicated/bare metal runner?

I've been working on a continuous benchmarking tool similar to Zig Performance called Bencher: https://github.com/bencherdev/bencher
So I'm curious what you are targeting for this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement Solving this issue will likely involve adding new logic or components to the codebase. frontend Tokenization, parsing, AstGen, Sema, and Liveness.
Projects
None yet
Milestone
0.14.0
Development

No branches or pull requests
2 participants
@andrewrk @epompeii