Standalone localization benchmark on patch-derived-locations protocol

[nikolay-e]

Context

FastContext evaluates its explorer standalone via patch-derived reference locations with instance-wise precision/recall/F1 at file/module/function granularity on SWE-bench Verified — externally validating exactly our evaluation protocol. Standing on the same protocol makes diffctx directly comparable to trained explorers in one table.

Tasks

• Adapter producing file/module/function-level P/R/F1 from locate-mode output against patch-derived reference locations
• Run diffctx (RRF + learned when available) on the same instance set; report side-by-side with published explorer numbers
• Include latency + cost columns (ours: 0 model cost)

Acceptance

• one reproducible table: diffctx vs trained-explorer baselines on identical protocol; committed artifacts
  Depends on: 02-locate-mode