Skip to content

DiffContext v0.2.0 - Benchmark Suite

Choose a tag to compare

@trakshan-mishra trakshan-mishra released this 14 Jun 05:00
· 160 commits to main since this release

Added

  • Repository-wide context selection
  • Benchmark framework
  • Recall metric
  • Precision metric
  • Context reduction metric
  • Runtime metric

Benchmark Results

simple_repo

Recall: 100%
Precision: 100%
Reduction: 0%

medium_repo

Recall: 33.33%
Precision: 100%
Reduction: 75%

Known Limitations

  • Cross-file import resolution not implemented

Next

v0.3.0 Import Resolution