MyOpenCRE mapping: reuse Module C Librarian retriever/reranker (RFC TODO 3)

[northdpole]

Context

RFC #876 TODO 3 defines application/utils/mapping_job.py with bi-encoder → pgvector top-20 → cross-encoder rerank. GSoC Module C (The Librarian) implements the same pipeline:

• C.1 candidate retriever — week_3: Module C (The Librarian) — C.1 candidate retriever (in-memory + pgvector) + pipeline switch #937 (approved)
• C.2 cross-encoder reranker — week_4: Module C (The Librarian) — C.2 cross-encoder reranker #957

Maintainer decision on #876: do not build a second parallel mapping stack. Wire MyOpenCRE run_mapping to reuse Module C components where possible.

Requirements

• Implement run_mapping by calling librarian/candidate_retriever + librarian/cross_encoder (or shared interfaces) instead of duplicating encode/rerank logic
• Map RFC user_standard_sections status enum (AUTO_MAPPED, NEEDS_REVIEW, etc.) to Librarian confidence thresholds — document mapping in RFC or inline
• rq job remains in mapping_job.py but delegates retrieval/rerank to Librarian modules
• Tests: fixture upload produces deterministic status counts; USER_CONFIRMED rows never auto-remapped (RFC constraint)
• Coordinate merge order: Module C W1–W3 (week_1: Module C (The Librarian) — RFC contracts + eval harness + golden dataset #922 → week_2: Module C (The Librarian) — C.0 input boundary: SectionValidator + ExplicitLinkResolver #925 → week_3: Module C (The Librarian) — C.1 candidate retriever (in-memory + pgvector) + pipeline switch #937) before or in parallel with MyOpenCRE TODO 3

Out of scope

• Full Librarian graph-write / HITL flow (Module C C.3–C.5)
• Per-user embedding storage (RFC explicitly forbids)

Related

• docs/rfc/user-auth-myopencre.md TODO 3
• Add support for users #586, Module C PRs week_1: Module C (The Librarian) — RFC contracts + eval harness + golden dataset #922, week_2: Module C (The Librarian) — C.0 input boundary: SectionValidator + ExplicitLinkResolver #925, week_3: Module C (The Librarian) — C.1 candidate retriever (in-memory + pgvector) + pipeline switch #937, week_4: Module C (The Librarian) — C.2 cross-encoder reranker #957