docs: update build performance benchmarks (3.3.0)#524
docs: update build performance benchmarks (3.3.0)#524github-actions[bot] wants to merge 1 commit intomainfrom
Conversation
Greptile SummaryThis is an automated CI-generated PR that appends
Confidence Score: 5/5
Important Files Changed
Flowchart%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[Release Tag: 3.3.0] --> B[CI Workflow Run #381]
B --> C[Build Benchmark Step]
B --> D[Query Benchmark Step - separate PR #523]
B --> E[Incremental Benchmark Step - separate PR #526]
C --> F[Runs codegraph on own codebase\n429 files, native + WASM]
F --> G[Collects metrics:\nbuildTimeMs, queryTimeMs,\nnodes, edges, dbSize,\nphase breakdown, query latency]
G --> H[github-actions bot updates\ngenerated/benchmarks/BUILD-BENCHMARKS.md\nand README.md metrics table]
H --> I[PR #524 opened to main]
Last reviewed commit: "docs: update build p..." |
| ## 📊 Performance | ||
|
|
||
| Self-measured on every release via CI ([build benchmarks](generated/benchmarks/BUILD-BENCHMARKS.md) | [embedding benchmarks](generated/benchmarks/EMBEDDING-BENCHMARKS.md) | [query benchmarks](generated/benchmarks/QUERY-BENCHMARKS.md) | [incremental benchmarks](generated/benchmarks/INCREMENTAL-BENCHMARKS.md) | [resolution precision/recall](tests/benchmarks/resolution/)): | ||
| Self-measured on every release via CI ([build benchmarks](generated/benchmarks/BUILD-BENCHMARKS.md) | [embedding benchmarks](generated/benchmarks/EMBEDDING-BENCHMARKS.md)): |
There was a problem hiding this comment.
Broken links to existing benchmark files removed from README
This line previously linked to four benchmark resources, but the automated update reduced it to only two:
- [query benchmarks](generated/benchmarks/QUERY-BENCHMARKS.md)
- [incremental benchmarks](generated/benchmarks/INCREMENTAL-BENCHMARKS.md)
- [resolution precision/recall](tests/benchmarks/resolution/)
All three still exist in the repository (generated/benchmarks/QUERY-BENCHMARKS.md, generated/benchmarks/INCREMENTAL-BENCHMARKS.md, and tests/benchmarks/resolution/resolution-benchmark.test.js). The QUERY-BENCHMARKS.md file in particular contains granular query-depth breakdowns (d1/d3/d5) and diffImpact latencies that are not present in BUILD-BENCHMARKS.md. Removing these links will make those resources undiscoverable from the README.
| Self-measured on every release via CI ([build benchmarks](generated/benchmarks/BUILD-BENCHMARKS.md) | [embedding benchmarks](generated/benchmarks/EMBEDDING-BENCHMARKS.md)): | |
| Self-measured on every release via CI ([build benchmarks](generated/benchmarks/BUILD-BENCHMARKS.md) | [embedding benchmarks](generated/benchmarks/EMBEDDING-BENCHMARKS.md) | [query benchmarks](generated/benchmarks/QUERY-BENCHMARKS.md) | [incremental benchmarks](generated/benchmarks/INCREMENTAL-BENCHMARKS.md) | [resolution precision/recall](tests/benchmarks/resolution/)): |
There was a problem hiding this comment.
Fixed in #527 — the regex now uses (.+?): to correctly capture markdown links with parentheses in URLs, preserving all existing benchmark links.
| |---------|--------|------|------:|----------------:|-----------:|-----------:|-----------:|----------------:| | ||
| | 3.3.0 | native | 2026-03-19 | 429 | 8 ↑129% | 6.8 ↑112% | 17.8 ↑33% | 36.8 ↑28% | 49247 ↑11% | | ||
| | 3.3.0 | wasm | 2026-03-19 | 429 | 11.5 ↑20% | 6.7 ↑46% | 17.7 ↑32% | 36.8 ↑27% | 47815 ↑12% | |
There was a problem hiding this comment.
QUERY-BENCHMARKS.md and INCREMENTAL-BENCHMARKS.md not updated for 3.3.0
The automated workflow appended 3.3.0 rows to BUILD-BENCHMARKS.md but the sibling files generated/benchmarks/QUERY-BENCHMARKS.md and generated/benchmarks/INCREMENTAL-BENCHMARKS.md still only contain data through 3.1.4. This creates a gap in the historical record for those benchmark dimensions (e.g. fnDeps at varying depths, diffImpact, and native batch vs. JS import-resolution throughput).
If the CI workflow for generating query and incremental benchmarks is separate from the build benchmark workflow, this may be expected. However, if those files are supposed to be updated in the same pass, the workflow for this run (#381) may have only executed the build-benchmark step.
|
The issues identified in this PR (inconsistent mid targets, README link stripping, missing regression notes) are addressed in #527. That PR should be merged first, then this benchmark PR can be re-run or closed and re-triggered. |
Automated build benchmark update for 3.3.0 from workflow run #381.