[Feature] Local kNN dimension estimator

[Xmaster6y]

What does this PR do?

Key insights about the PR.

Linked Issues

• Closes #?
• #?

Checklist

• I have read the CONTRIBUTING guide.
• I have added tests for my changes if needed.
• I have updated the documentation if needed.

---

Summary by cubic

Add a per-point local intrinsic dimension estimator using k-NN distances, plus a shared neighbor-distance utility now used by TwoNn for consistent filtering and duplicate handling. Docs now cite Farahmand et al. (2007).

• New Features

  • LocalKnnDimensionEstimator(k | "auto") computes d(x) = ln(2) / ln(R2k/Rk); validates k, requires N ≥ 2k+1, and ignores self/≤eps neighbors.
  • Supports (N, D) and (..., N, D); outputs (..., N). Configurable in_key/out_key and eps. Exported in tdhook.latent and tdhook.latent.dimension_estimation; tests cover batch/custom keys, determinism, known manifolds, auto-k, and error cases.

• Refactors

  • Added sorted_neighbor_distances in _utils and switched TwoNnDimensionEstimator to use it to reduce duplication and unify neighbor filtering.
  • Added ICML '07 citation (Farahmand–Szepesvári–Audibert) to references.

^{Written for commit 42463fb. Summary will update on new commits.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 96.71%. Comparing base (975080d) to head (42463fb).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main      #38      +/-   ##
==========================================
+ Coverage   96.61%   96.71%   +0.09%     
==========================================
  Files          31       33       +2     
  Lines        1980     2038      +58     
==========================================
+ Hits         1913     1971      +58     
  Misses         67       67              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[cubic-dev-ai]

No issues found across 6 files

Confidence score: 5/5

• Automated review surfaced no issues in the provided summaries.
• No files require special attention.

_{Auto-approved: Adds a new intrinsic dimension estimator with tests, uses small focused changes, no sensitive or critical logic touched.}

[cubic-dev-ai]

1 issue found across 2 files (changes from recent commits).

Prompt for AI agents (all issues)

Check if these issues are valid — if so, understand the root cause of each and fix them.


<file name="docs/source/references.bib">

<violation number="1" location="docs/source/references.bib:238">
P3: The conference location is misspelled; ICML 2007 was in Corvallis, Oregon. Correcting the metadata avoids citation inaccuracies.</violation>
</file>

_{Reply with feedback, questions, or to request a fix. Tag @cubic-dev-ai to re-run a review.}