Skip to content

E2e bench only#17

Merged
sylvestre merged 2 commits into
mainfrom
e2e-bench-only
May 31, 2026
Merged

E2e bench only#17
sylvestre merged 2 commits into
mainfrom
e2e-bench-only

Conversation

@sylvestre
Copy link
Copy Markdown
Contributor

No description provided.

sylvestre added 2 commits May 31, 2026 11:05
Replace the matcher micro-benchmarks with a single end-to-end 'search'
group driven through uumain over a multi-megabyte file: a literal
pattern (which a buffer-at-a-time searcher can accelerate) and an
extended-regex control (which cannot). Matching pre-split lines in
isolation cannot reveal how the searcher feeds data to the matcher;
this does.
Cover the real-world grep usage shapes from the tldr page end-to-end
through uumain over a shared multi-MB corpus (plus a directory with a
binary file for -rI):

  search pattern, -F fixed string, -rI recursive ignoring binary,
  -C 3 context, -Hn --color=always, -o only-matching, -v invert,
  -Ei extended + ignore-case.

Kept alongside the pure-scan throughput benches (literal vs regex, no
match). A rare marker keeps matched output small so the full-file scan
dominates the timing.
@codecov
Copy link
Copy Markdown

codecov Bot commented May 31, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 95.28%. Comparing base (ede1676) to head (6e6db24).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main      #17   +/-   ##
=======================================
  Coverage   95.28%   95.28%           
=======================================
  Files           6        6           
  Lines        1422     1422           
  Branches      140      140           
=======================================
  Hits         1355     1355           
  Misses         66       66           
  Partials        1        1           
Flag Coverage Δ
macOS_latest 96.09% <ø> (ø)
ubuntu_latest 96.09% <ø> (ø)
windows_latest 0.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 31, 2026

Merging this PR will create unknown performance changes

🆕 10 new benchmarks
⏩ 17 skipped benchmarks1

Performance Changes

Benchmark BASE HEAD Efficiency
🆕 literal_no_match N/A 27.6 ms N/A
🆕 invert_match N/A 75.3 ms N/A
🆕 only_matching N/A 55 ms N/A
🆕 recursive_no_binary N/A 29.6 ms N/A
🆕 extended_icase N/A 121.1 ms N/A
🆕 context N/A 32.4 ms N/A
🆕 filename_lineno_color N/A 55.1 ms N/A
🆕 fixed_string N/A 29.5 ms N/A
🆕 search_pattern N/A 29.5 ms N/A
🆕 regex_no_match N/A 29.9 ms N/A

Comparing e2e-bench-only (6e6db24) with main (ede1676)

Open in CodSpeed

Footnotes

  1. 17 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@sylvestre sylvestre merged commit c614a57 into main May 31, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant