Skip to content

Improve index benchmark details#749

Merged
jviotti merged 1 commit intomainfrom
granular-benchmark
Mar 18, 2026
Merged

Improve index benchmark details#749
jviotti merged 1 commit intomainfrom
granular-benchmark

Conversation

@jviotti
Copy link
Member

@jviotti jviotti commented Mar 18, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

@augmentcode
Copy link

augmentcode bot commented Mar 18, 2026

🤖 Augment PR Summary

Summary: This PR improves benchmark and profiling detail for the indexer.

Changes:

  • Enhances benchmark/index.sh to capture and emit explicit timings for indexing registries of 100 / 1000 / 10000 schemas.
  • Outputs these new “Index N schemas” results alongside existing add/update/cached-rebuild metrics in the benchmark JSON.
  • Splits indexer timing in src/index/index.cc into separate profiling buckets for delta-plan creation vs build execution.
  • Renames profiling labels to distinguish (Delta) vs (Build) for Producing/Combining phases.

Technical Notes: Profiling uses successive PROFILE_END checkpoints, so the new labels provide finer-grained stage breakdowns without changing the underlying execution steps.

🤖 Was this summary useful? React with 👍 or 👎

Copy link

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Index (community)

Details
Benchmark suite Current: 39f1b31 Previous: 943da3c Ratio
Add one schema (0 existing) 21 ms 21 ms 1
Add one schema (100 existing) 39 ms 43 ms 0.91
Add one schema (1000 existing) 189 ms 195 ms 0.97
Add one schema (10000 existing) 1888 ms 1955 ms 0.97
Update one schema (1 existing) 19 ms 20 ms 0.95
Update one schema (101 existing) 37 ms 39 ms 0.95
Update one schema (1001 existing) 207 ms 206 ms 1.00
Update one schema (10001 existing) 2110 ms 2168 ms 0.97
Cached rebuild (1 existing) 11 ms 10 ms 1.10
Cached rebuild (101 existing) 12 ms 14 ms 0.86
Cached rebuild (1001 existing) 30 ms 30 ms 1
Cached rebuild (10001 existing) 229 ms 240 ms 0.95
Index 100 schemas 152 ms
Index 1000 schemas 1624 ms
Index 10000 schemas 56176 ms

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit af096f0 into main Mar 18, 2026
6 checks passed
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Index (enterprise)

Details
Benchmark suite Current: 39f1b31 Previous: 943da3c Ratio
Add one schema (0 existing) 23 ms 22 ms 1.05
Add one schema (100 existing) 38 ms 38 ms 1
Add one schema (1000 existing) 192 ms 182 ms 1.05
Add one schema (10000 existing) 1914 ms 1905 ms 1.00
Update one schema (1 existing) 21 ms 20 ms 1.05
Update one schema (101 existing) 39 ms 38 ms 1.03
Update one schema (1001 existing) 201 ms 196 ms 1.03
Update one schema (10001 existing) 2076 ms 2149 ms 0.97
Cached rebuild (1 existing) 12 ms 11 ms 1.09
Cached rebuild (101 existing) 14 ms 13 ms 1.08
Cached rebuild (1001 existing) 34 ms 31 ms 1.10
Cached rebuild (10001 existing) 231 ms 228 ms 1.01
Index 100 schemas 163 ms
Index 1000 schemas 1545 ms
Index 10000 schemas 55503 ms

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti deleted the granular-benchmark branch March 18, 2026 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant