Skip to content

Increase indexing benchmarks based on registry size#693

Merged
jviotti merged 1 commit intomainfrom
more-benchmark
Mar 3, 2026
Merged

Increase indexing benchmarks based on registry size#693
jviotti merged 1 commit intomainfrom
more-benchmark

Conversation

@jviotti
Copy link
Member

@jviotti jviotti commented Mar 3, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

Copy link

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 1 file

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode
Copy link

augmentcode bot commented Mar 3, 2026

🤖 Augment PR Summary

Summary: Updates the indexing benchmark to scale measurements based on registry size.

Changes:

  • Adds helpers to generate minimal JSON Schemas and time a single indexing run
  • Benchmarks the cost of adding one schema when the registry has 0, 100, and 1000 existing schemas
  • Pre-fills the schemas directory to the target sizes and runs an untimed index to establish the baseline
  • Emits progress information to stderr and outputs a JSON array of results in milliseconds

Technical Notes: The benchmark now produces three separate datapoints (“add one schema” at different registry sizes) to better reflect growth behavior as the registry expands.

🤖 Was this summary useful? React with 👍 or 👎

Copy link

@augmentcode augmentcode bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Index (community)

Details
Benchmark suite Current: db4f5a8 Previous: 302db47 Ratio
Add one schema (0 existing) 40 ms
Add one schema (100 existing) 714 ms
Add one schema (1000 existing) 7456 ms

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Index (enterprise)

Details
Benchmark suite Current: db4f5a8 Previous: 302db47 Ratio
Add one schema (0 existing) 49 ms
Add one schema (100 existing) 711 ms
Add one schema (1000 existing) 7697 ms

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit c6157d3 into main Mar 3, 2026
5 checks passed
@jviotti jviotti deleted the more-benchmark branch March 3, 2026 15:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant