Goal: provide the factually correct reference for every fact mentioned in a piece of research or an interview.
Problem statement: interviews, news articles, and research papers routinely make claims that need fact-checking or a correct citation, and doing this by hand is slow and inconsistent.
SecretSource is a pipeline that takes a document (PDF, references, media), extracts its claims, finds and retrieves the evidence those claims should cite, and has a panel of verifier agents judge whether each claim is actually supported — producing an annotated report a human reviewer can adjudicate.
- Input — a PDF (with references/media) is uploaded.
- Parse + quality — parsed with GROBID + Docling, then checked by a quality gate.
- Claims + citations — a claim-extractor agent pulls out atomic, typed, cite-worthy claims; citation scope maps each claim to its reference(s) and flags missing citations.
- Evidence flow — references are resolved via source tools (Crossref, OpenAlex, Semantic Scholar, PubMed, arXiv), gated on whether full text or only an abstract is available, then retrieved with BM25 + ColBERTv2 (text) and ColPali/ColQwen (visual).
- Specialist review — three verifier agents (evidence text+visual, quantitative, validity/overclaim) judge each claim against the retrieved evidence.
- Decide, explain, learn — an aggregator fuses and calibrates the verdicts and routes uncertain cases; a report is generated (annotated PDF, verdict + evidence, safer rewrite); a human reviewer adjudicates, corrects false flags, and feeds labels back into the loop.
| Folder | Contents |
|---|---|
agents/ |
Agent definitions for the pipeline stages (claim extraction, evidence verification, aggregation). |
skills/ |
Reusable skills/workflows the agents draw on. |
tools/ |
Standalone tools used by the pipeline, e.g. the paper-PDF resolver. |
docs/ |
Project documentation and reference material. |
| Name | Student ID |
|---|---|
| Chanya Kittichai | 66070503412 |
| Nuttadon Lertritdacha | 66070503419 |
| Vitawat Kitipatthavorn | 66070503482 |
| Patiharn Liangkobkit | 66070503489 |