feat(scrapeURL/index): index metrics

[mogery]

Summary by cubic

Add debug metrics for index hits and misses in scrapeURLWithIndex to improve observability and help tune maxAge. Supports ENG-3555 by adding structured index logs for GCP distribution analysis.

• New Features

  • Logs index metrics on hit/miss via meta.logger.debug with module: "index/metrics".
  • Fields: hit (bool), age (ms, on hit), maxAge, dynamicMaxAge.

• Refactors

  • Removed unused imports (addDomainFrequencyJob, storage).

[cubic-dev-ai]

1 issue found across 1 file

Prompt for AI agents (all 1 issues)

Understand the root cause of the following 1 issues and fix them.


<file name="apps/api/src/scraper/scrapeURL/engines/index/index.ts">

<violation number="1" location="apps/api/src/scraper/scrapeURL/engines/index/index.ts:343">
Age metric sign is inverted; use now - created_at to report a positive age.</violation>
</file>

_{React with 👍 or 👎 to teach cubic. Mention @cubic-dev-ai to give feedback, ask questions, or re-run the review.}