Skip to content

v2.6.8 — index Zeek DSLs + secondary source/DSL/template/build extensions

Choose a tag to compare

@mrsladoje mrsladoje released this 02 Jul 13:18

Extension-coverage widening

An extension-coverage audit of all 200 SWE-rebench-V2 task-bench repos — every repo's file tree (at exact base_commit) and every gold-patch fix file cross-checked against the production indexing admission gate — found exactly one task whose entire bug fix lived in a file sweet-search could not index: zeek-1734, fixed in src/broker/comm.bif. .zeek/.bro were allowlisted (~2.6.2), but Zeek's build-time DSLs were not.

Added to the indexing allowlist (FILE_PATTERNS.include + EXTENSION_MAP/FILENAME_MAP)

  • Zeek DSLs: .bif .pac .pac2 (→zeek), .spicy .evt .hlt (→spicy)
  • Cython: .pyx .pxd .pxi (→python)
  • Scala build/worksheets: .sbt .sc (→scala)
  • Ruby build/manifest: .rake .gemspec .podspec .ru (→ruby), Rakefile, Gemfile
  • CoffeeScript; .pcss / .styl
  • Templating: twig liquid njk hbs handlebars mustache gohtml eex heex leex (→html); pug jade haml slim; jinja jinja2 j2 tera tmpl tpl gotmpl (generic)
  • .NET / MSBuild: .props .targets .proj .vbproj .fsproj .resx .nuspec (→xml)
  • Autotools / scripts: .m4 .ac (→m4), .am (→makefile), .awk, .sed, *.in
  • Misc: .sln, go.mod, go.work, .ipynb (generic fixed-window chunking; image-heavy notebooks self-filter via the 1 MB size gate)

Notes

  • Discovery-only change (adds files to the crawl) — not a ranking signal, so it cannot regress GCSN.
  • Post-change re-check: full-blind fix tasks 0/200 (was 1); 157 fully clean.
  • .mp4 / .parquet / .csv / .png and other binary/data types remain rejected.
  • ⚠️ Existing indexes must be rebuilt for the new coverage to take effect.