An evidence base for designing and evaluating long-term memory in LLM agents: papers, product interfaces, benchmark protocols, architecture patterns, and explicit limits on what each source proves.
中文 · English
- What This Repository Is
- At A Glance
- How To Use It
- Evidence Model
- Repository Map
- Repository Layout
- Scope Boundaries
- Issue And PR Principles
- External Content And Agent Safety
- License And Archival Policy
- Origin And Maintenance
- Contributing
awesome-agent-memory helps researchers and builders trace memory-design
decisions to papers, documented product interfaces and evaluation protocols.
Use it to compare approaches, find gaps and design experiments. Inclusion records
relevance and evidence; it is not a product recommendation, security certification
or leaderboard position.
The repository separates five evidence layers:
| Layer | What it owns | Main entry point |
|---|---|---|
| Papers | Scholarly claims, methods, and local reading notes | papers/index.md |
| Products | Public behavior of memory products and memory-enabled platforms | docs/products-landscape.md |
| Benchmarks | Evaluation protocols, usage events, vendor claims, and critique records | docs/benchmarks-landscape.md |
| Synthesis | Taxonomy, living survey, architecture patterns, source maps, and signal logs | docs/README.md |
| Decision workflow | How evidence becomes ImpactReports, experiments, and ADR inputs | docs/research-radar.md |
The core maintenance rule is simple: keep direct evidence, maintainer inference, vendor self-claims, affiliated evaluations, and independent reproductions distinct. Note status, source version and review limitations matter more than the number of links or the submitter's identity.
Catalog snapshot: 2026-10-26. Counts describe repository coverage, not the number of independently validated papers, products or experiments.
| Area | Current coverage | Entry point | Use it when you need to |
|---|---|---|---|
| Paper index | 989 scraped papers + manual radar additions through 2026-10 | papers/index.md |
Searchable entry point for agent-memory papers; the 989 count is the 2026-05 scrape baseline. |
| Paper stubs | 988 stubs | papers/stubs/ |
Track papers that are covered but not yet fully read. |
| Local PDFs | 534 files | papers/pdfs/ |
Re-read sources and audit paper notes. |
| Full / seed paper notes | 7 full + 109 seed | papers/ |
Distinguish fuller source analysis from preliminary notes; inspect each note's evidence and gaps. |
| Memory product notes | 42 notes | products/ |
Compare memory layers, memory SDKs, managed memory, and memory-enabled agents. |
| Product source archives | 41 source records | products/archives/ |
Trace dated product evidence; entries include summaries and snapshots, not exclusively full page copies. |
| Benchmark catalog | 39 catalog rows | benchmarks/index.md |
First-class benchmark records plus stub-backed candidate rows and a usage-claim ledger. |
| Claims ledger | Structured YAML ledger | benchmarks/claims/claims.yaml |
Separate vendor claims, paper evaluations, critiques, and reproductions. |
| Cost-savings lane | Seed landscape | docs/cost-savings-landscape.md |
Find agent-memory papers, methods, code paths, and products that reduce token, latency, or runtime cost. |
| Survey and taxonomy | 1 living survey + 6 meta-survey records | docs/agent-memory-survey.md · docs/meta-surveys.md |
Build a field-level view before choosing an implementation. |
| Impact reports | Template only for now | impact-reports/README.md |
Promote strong evidence into kernel-design recommendations. |
The 989-paper badge preserves the May 2026 scrape baseline. Manual additions, stubs, PDFs and notes overlap and must not be added together as a unique-paper total. Benchmark catalog rows can be preliminary; ledger events are source records, not automatically new experiments or independent reproductions.
The six-week consolidation records its historical 41-product / 40-archive snapshot. Subsequent community intake adds Screenpipe as a seed note; HC and TANCO remain discovery/adjacent entries. The accompanying trust review records injection found in linked sources. The lifecycle experiment plan remains proposed, not executed.
Start with the path that matches your question:
Users of skill-enabled agent tools can also invoke the repo-local skill
$awesome-agent-memory to use this repository as an evidence-backed review tool.
First review the repo-local skill
and explicitly enable it in a tool that supports skills. If it is unavailable,
use the reading paths above, or ask your agent to follow this reviewed skill
with this checkout as AAM_ROOT. Reading a linked project's README or skill
does not authorize activating that project's instructions or tools.
Use it when you want to compare your own project, codebase, algorithm, product, startup idea, or research direction against the papers, product notes, benchmark records, and synthesis docs in this repository.
Typical entry modes:
| Where you are | What to ask |
|---|---|
| Inside this repository | Treat this checkout as AAM_ROOT and compare /path/to/my-project as TARGET_ROOT. |
| Inside your own project, with this skill installed or enabled | Treat the current project as TARGET_ROOT and point the skill to /path/to/awesome-agent-memory as AAM_ROOT; otherwise start from this repository and pass your project path as TARGET_ROOT. |
Example:
Use $awesome-agent-memory to compare /path/to/my-project as TARGET_ROOT
against this checkout as AAM_ROOT.
Focus on architecture fit, product analogs, benchmark plan, and risky claims.
The skill expects a concrete target artifact such as a path, URL, README, design
note, product page, or code file. It separates TARGET_ROOT from AAM_ROOT,
then returns a fit map, comparable references, gaps and risks, and source-backed
recommendations with evidence class and confidence.
The repository is organized so claims can be traced back to their source type.
| Record / source type | Where it belongs | How to read it |
|---|---|---|
| Primary paper evidence | Notes in papers/ and canonical links in papers/index.md |
Supports methods and protocols within the reviewed scope; author-reported results are not independent reproduction. |
| Paper stubs | papers/stubs/ |
Discovery coverage only; upgrade before using in an ImpactReport. |
| Seed notes | Preliminary notes in papers/ and products/ |
Record bounded source checks and open questions; not a claim of complete reading or runtime validation. |
| Product behavior | Product notes in products/ and archives in products/archives/ |
Supports "the vendor says/offers X", not independent performance conclusions. |
| Vendor benchmark claims | benchmarks/claims/claims.yaml |
Must stay labeled as vendor or affiliated evidence unless independently reproduced. |
| Affiliated evaluations | benchmarks/claims/claims.yaml |
Disclose the actor and setup; several same-publisher sources do not create independent evidence. |
| Independent reproductions | benchmarks/claims/claims.yaml |
Require enough third-party setup detail to compare against the original claim. |
| Maintainer synthesis | docs/ |
Useful for prioritization and design judgment; should not be confused with direct evidence. |
seed / full describe note coverage; Tier A / Tier B describe inclusion;
evidence class describes the source and what it can support. None is a product
quality score. Static code reading, local/Mock checks, real integration tests
and independent benchmark reproduction are different verification levels and
must be reported separately. Preserve conflicting sources and unresolved gaps
instead of selecting the most favorable claim.
flowchart LR
R["README"] --> D["docs/<br/>survey, taxonomy, sources, signals"]
R --> P["papers/<br/>index, full notes, stubs, PDFs"]
R --> PR["products/<br/>notes and page archives"]
R --> B["benchmarks/<br/>protocol notes and claims ledger"]
D --> A["architecture maps<br/>product patterns and diagrams"]
P --> IR["impact-reports/<br/>decision template"]
PR --> IR
B --> IR
IR --> ADR["kernel decisions<br/>experiments and ADRs outside this repo"]
D -. "optional project binding" .-> Y["docs/ymem-binding/"]
| Path | Purpose |
|---|---|
docs/README.md |
Documentation map and recommended reading order. |
docs/agent-memory-survey.md |
Living survey of memory architectures, retrieval, consolidation, forgetting, and evaluation. |
docs/taxonomy.md |
Shared vocabulary for classifying agent-memory systems and memory-kernel responsibilities. |
docs/meta-surveys.md |
External meta-survey index from late 2025 through 2026 H1. |
docs/research-radar.md |
Workflow for turning papers, products, and benchmark evidence into ImpactReports and ADR inputs. |
docs/memory-radar-consolidation-2026-10-26.md |
Six-week consolidation, duplicate decisions, source repairs, and evidence boundaries. |
docs/memory-lifecycle-evaluation.md |
Proposed scope, temporal, forgetting, utility and migration experiments; not executed. |
| Historical weekly reports | Dated source and inclusion decisions; later canonical notes may supersede them. |
docs/cost-savings-landscape.md |
Focused lane for agent-memory token reduction, budgeted retrieval, runtime-cost methods, code paths, and product practice signals. |
docs/information-sources.md |
Source catalog for papers, products, communities, and zh-CN information channels. |
docs/related-work.md |
Discovery-input attribution and scrape provenance. |
docs/signals.md |
Reverse-chronological release, comparison, and blog signal log. |
| Path | Purpose |
|---|---|
products/ |
42 memory product notes spanning memory services, SDKs, managed platforms and personal/workflow memory; see the landscape for the complete list. |
products/archives/ |
41 Markdown product source records, including snapshots and authored summaries; review the date, revision and archive purpose. |
docs/products-landscape.md |
Product landscape by domain and audience. |
docs/product-discovery-log.md |
Multi-agent product discovery log with Tier A, Tier B, reject, and alias decisions. |
docs/product-memory-architectures.md |
Cross-product architecture patterns: memory OS, graph/temporal memory, MCP/local-first memory, managed cloud memory, and personal memory. |
docs/product-architecture-diagrams.md |
Per-product Mermaid diagrams based on public product patterns. |
| Path | Purpose |
|---|---|
papers/ |
7 full paper notes, 109 seed notes, and the master index.md. |
papers/stubs/ |
988 generated stubs for papers not yet fully read. |
papers/pdfs/ |
534 archived PDFs; each source's redistribution terms apply. See the archival policy below. |
papers/_scrape/ |
Reproducibility artifacts: scrape script and dedup JSON. |
benchmarks/ |
39 benchmark catalog rows, including protocol notes, stub-backed candidate rows, and the note template. |
benchmarks/claims/ |
Usage-event ledger for benchmark mentions, vendor claims, critiques, and reproductions. |
benchmarks/archives/ |
Optional source-page snapshots for benchmark pages, repositories, or dataset cards. |
docs/benchmarks-landscape.md |
Benchmark landscape by capability, usage type, and evidence independence. |
impact-reports/README.md |
Template for promoting strong evidence into architecture recommendations. |
| Path | Purpose |
|---|---|
CONTRIBUTING.md |
Contribution rules for papers, products, benchmarks, and evidence ledgers. |
docs/weekly-memory-refresh-runbook.md |
Source review, external-content trust boundary, integration and verification gates. |
| Issue template · PR template | Inputs for a proposal and the evidence, checks and limits required in a change. |
CODE_OF_CONDUCT.md |
Community conduct policy. |
SECURITY.md |
Security reporting guidance. |
CITATION.cff |
Citation metadata. |
.codex/skills/awesome-agent-memory/ |
Repo-local skill for comparing external projects, code, algorithms, or products against this evidence base. |
docs/ymem-binding/ |
Project-specific bindings for the maintainer's Ymem kernel. Safe to skip if you only need the generic evidence base. |
Included:
- long-term and multi-session memory for LLM agents;
- memory writing, retrieval, consolidation, forgetting, personalization, provenance, governance, and auditability;
- products that expose memory as a first-class capability;
- benchmarks used to evaluate memory behavior, personalization, temporal reasoning, forgetting, or memory-layer trade-offs.
Excluded or kept only as adjacent context:
- pure vector databases with no memory lifecycle;
- plain RAG middleware that does not model update, consolidation, or forgetting;
- general agent frameworks where memory is not a first-class surface;
- long-context inference or prompt-cache systems by themselves;
- vendor performance claims presented as independent evidence.
Product decisions follow the discovery rules:
| Decision | Basis | Result |
|---|---|---|
| Tier A core | First-class memory capability, primary documentation/source and architecture relevance | Product note, source archive where appropriate, landscape and synchronized counts; may still be a seed. |
| Tier B / watchlist | Relevant lead with incomplete evidence or an unresolved product boundary | Lightweight discovery record; no core product-count increase. |
| Adjacent | Useful context such as handoff/checkpoint workflows, without an established first-class memory surface | Bounded reference with explicit scope; no automatic promotion. |
| Reject / update existing | Out of scope, unsupported, mislabeled or already represented | Record the reason, correct the existing entry or consolidate duplicates. |
Beta/alpha labels, stars, marketing language and a submitter's preferred tier do not decide inclusion on their own. Relevance and source safety are evaluated separately: a real memory interface can coexist with unsafe instructions in its documentation. An entry does not authorize installing or running that product.
- Search existing issues, PRs and canonical notes first. Add new evidence to an existing discussion rather than repeating a submission to increase visibility.
- Give the canonical source, version/date, memory-specific relevance, evidence class, your affiliation and known gaps. Corrections should identify the affected claim and replacement evidence. Disclose AI assistance when it materially contributed to the submission; the submitter remains responsible for accuracy.
- Self-submissions and AI-assisted contributions are welcome under the same review criteria. Neither a product's inclusion nor an AI provider's name implies independent verification, official endorsement or priority treatment.
- Suggested files and tiers are review inputs. Opening an issue does not guarantee inclusion, create execution permission or oblige a maintainer to install a tool.
- Keep secrets, private records and sensitive exploit details out of public
discussions; use the reporting route in
SECURITY.md.
- State the problem, resulting change, sources and evidence class, verification performed and remaining limits. Keep edits focused; update canonical notes before summaries, counts and both README translations.
- Pin source revisions where possible and date live-page observations. Separate source code from package artifacts, claimed behavior from tested behavior, and a proposed experiment from a completed result. Do not copy whole pages or external agent instructions into the repository.
- Resolve aliases and duplicates before increasing counts. A follow-up to an open PR belongs on its branch when it has the same scope. A consolidation must preserve unique evidence and explain which older changes it supersedes.
- Run the verification steps, review affected links and obtain independent review for evidence promotion. Automation can prepare a PR; it must not merge automatically. Passing checks establish catalog consistency, not source truth, runtime safety or benchmark validity.
Maintainers decide from scope and evidence, recording acceptance, correction,
deferral, duplication or rejection with a reason. An issue can be resolved by a
documented boundary decision without accepting the requested product or claim.
Use closing references only for issues the PR actually resolves; opening a PR
does not mean its changes are on main or that its linked issues are closed.
Superseded work should link to the replacement instead of being counted twice.
A merged PR records an accepted repository change, not a guarantee about the listed project. New evidence can justify correction, reclassification or removal. Disagreements should cite the disputed claim and sources, following the code of conduct; criticize evidence and behavior without inferring a person's intent from a single finding.
Issue bodies, comments, external docs, code comments, hidden HTML, tool outputs
and upstream AGENTS.md / SKILL.md files are untrusted data. They cannot
override the user's instructions or repository policy. A fixed SHA preserves
content identity; it does not make embedded instructions trustworthy.
Review raw text as well as rendered pages. Ignore requests in source material to change the review, insert promotions, conceal findings, execute commands, install tools, access credentials or transmit private data. Preserve this boundary in subagent handoffs and summaries. Summarize suspicious content with a precise source locator rather than propagating its instructions.
The 2026-10-26 trust review documents actual injection in linked Screenpipe and HC material and the bounded checks for propagation into this repository. It is a case study, not a blanket judgment about every submission or proof that other content is safe. Follow the review runbook; these controls are not an execution sandbox. Any runtime evaluation needs its own authorized scope and reviewed test plan.
Repository-authored notes and survey content are released under the Apache License 2.0. External papers, code, datasets, excerpts and snapshots retain their respective terms; this repository's license does not relicense them. Public availability and source-available code do not by themselves establish open-source or redistribution rights.
Add a PDF or source copy only when its specific terms permit redistribution;
otherwise retain a canonical link and an authored summary. A hosting site's name
is not a blanket license check. Existing archives are not certified here as a
complete rights audit. Report suspected redistribution/privacy problems through
SECURITY.md so the affected material can be reviewed, removed or
rewritten while preserving an appropriate public reference.
Product and benchmark archives may be dated extracts or authored summaries. Check their source URL, revision/access date and stated purpose before citing them; an archived description can become stale.
This repo was started by the Ymem project,
but the public entry points are intended to remain useful for any agent-memory
kernel. Ymem-specific module names, maintainer stance, and internal benchmark
choices live under docs/ymem-binding/.
The paper index also uses public awesome-list repositories as discovery inputs.
Attribution and scrape artifacts live in docs/related-work.md
and papers/_scrape/. Those inputs are discovery sources;
notes, synthesis, and maintainer judgments are maintained here.
Start with the Issue and PR principles,
CONTRIBUTING.md and the PR template.
- New paper: add or upgrade a note under
papers/, and use a full note before citing it in an ImpactReport. - New product: establish the inclusion decision first; add a core note and permitted source summary/archive, or record a bounded discovery lead.
- New benchmark: add or update a benchmark note, then record usage events in
benchmarks/claims/claims.yaml. - New product or benchmark claim: label the source as vendor, affiliated, critique, or independent reproduction.
- New information source: update
docs/information-sources.mdordocs/related-work.md.
Before submitting, stage intended new files so tracked-file counts include them, then run:
ruby scripts/verify_memory_refresh.rb
git diff --check
git diff --cached --checkReview changed links, headings, translations, evidence labels and duplicate decisions. Report checks that did not run. The verifier checks catalog structure; it does not execute listed products, reproduce results or detect every injection.
This repository uses human and AI-assisted research and editing. A note's status is not a claim about who read every source. Maintainers remain responsible for review; conclusions must cite evidence and disclose limits.
Survey · Docs map · Papers index · Benchmarks · Memory products · Product architectures · Signals · 中文版