Add measured CLI timings and richer benchmark variants#1130
Add measured CLI timings and richer benchmark variants#1130frankslin merged 3 commits intoBYVoid:masterfrom
Conversation
Extend the benchmark binary to compare compiled ocd2 configs against temporary text-json variants without duplicating committed config files. The benchmark runner now rewrites config dictionaries to text inputs on the fly, registers grouped in-process and command-line benchmark families, and prints grouped console output with explicit throughput plus command-line stage breakdowns. Add --measured_result to the opencc command-line tool so end-to-end benchmark runs can record structured load/convert/write/total timing data as JSON. Cover the new option with a command-line test and make the benchmark target depend on the opencc executable so command-line benchmarks run reliably in the build tree.
|
Example result: |
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 28dfb5e98a
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Use CMake's resolved opencc target path for command-line benchmarks so Windows multi-config generators launch the correct executable instead of hardcoding src/tools/opencc(.exe). Write generated benchmark config variants under the benchmark build directory instead of the source config directories, which keeps the source tree clean and allows read-only source checkouts to run the benchmark suite.
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: ff79da9658
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Rewrite benchmark-generated segmentation resource paths so jieba text_json cases keep resolving cppjieba dictionary assets after configs move into the build tree. Wrap BM_CommandLine system commands with an outer quoted string on Windows, matching the command-line tests and avoiding cmd.exe path parsing failures when build paths contain spaces.
Extend the benchmark binary to compare compiled ocd2 configs against temporary text-json variants without duplicating committed config files. The benchmark runner now rewrites config dictionaries to text inputs on the fly, registers grouped in-process and command-line benchmark families, and prints grouped console output with explicit throughput plus command-line stage breakdowns.
Add --measured_result to the opencc command-line tool so end-to-end benchmark runs can record structured load/convert/write/total timing data as JSON. Cover the new option with a command-line test and make the benchmark target depend on the opencc executable so command-line benchmarks run reliably in the build tree.