Skip to content

Commit 01ea3ff

Browse files
committed
docs(readme): replace ratio with absolute cost-at-scale framing
$0.0090 per memory-grounded answer = $9 per 1,000 RAG calls; ~$45 per 1,000 conversations averaging 5 RAG calls. EmergenceMem median latency comparison stated as absolute ms (-2,092 ms at median). No 'X× faster' phrasing.
1 parent bd44032 commit 01ea3ff

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,9 @@ Honest, apples-to-apples comparison: same `gpt-4o` reader, same dataset, same Ph
6464
| EmergenceMem Simple Fast (in our harness) | 80.6% | [77.0%, 84.0%] | $0.0586 | 3,703 ms | [adapter](https://github.com/framersai/agentos-bench/blob/master/vendors/emergence-simple-fast/) |
6565
| Zep self / independent reproduction | 71.2% / 63.8% | not published | not published || [self](https://blog.getzep.com/state-of-the-art-agent-memory/) / [arXiv](https://arxiv.org/abs/2512.13564) |
6666

67-
**+1.4 pp at point estimate over Mastra OM gpt-4o at the matched reader.** Mastra publishes no CI; their 84.23% sits inside our 95% CI [82.4%, 88.6%], so the gap is at the threshold of statistical significance. EmergenceMem Internal's 86.0% (no CI) also sits inside our CI; we are statistically tied with both. **1.6× faster median latency** vs EmergenceMem (3,558 ms vs 5,650 ms; the only vendor that publishes a comparable latency number).
67+
**+1.4 pp at point estimate over Mastra OM gpt-4o at the matched reader.** Mastra publishes no CI; their 84.23% sits inside our 95% CI [82.4%, 88.6%], so the gap is at the threshold of statistical significance. EmergenceMem Internal's 86.0% (no CI) also sits inside our CI; we are statistically tied with both. AgentOS p50 latency 3,558 ms vs EmergenceMem's published median 5,650 ms (-2,092 ms at the median; the only vendor that publishes a comparable latency number).
68+
69+
**Cost at scale**: $0.0090 per memory-grounded answer = $9 per 1,000 RAG calls. A chatbot averaging 5 RAG calls per conversation across 1,000 conversations costs ~$45.
6870

6971
### LongMemEval-M Phase B (1.5M tokens, 500 sessions)
7072

0 commit comments

Comments
 (0)