[MM-02] Add Maka-native memory benchmark datasets and deterministic graders

[bug-superman]

MM-02: Add Maka-native memory benchmark datasets and deterministic graders

Parent

#771

Checkpoint

MC-0 Measurement foundation

What to build

Define deterministic continuity and durable-memory lifecycle datasets with stable loaders, hashes, graders, and failure classifications.

Acceptance criteria

• Continuity dataset covers distant facts, exact values, large tool results, tool adjacency, compact/resume/fork, and overflow recovery.
• Lifecycle dataset covers remember, evidence promotion, one-off rejection, conflict, dedupe, scope, privacy, deletion, and stale handling.
• Dataset hashes are stable across machines and fixture ordering.
• Graders separate task failure, infrastructure failure, privacy violation, and artifact failure.
• Golden answers and negative cases produce deterministic scores.

Required tests

• Schema validation
• hash determinism
• grader golden fixtures
• malformed fixture handling
• privacy hard-gate classification

Benchmark

Run graders against synthetic perfect, partial, leaking, and malformed outputs only; paid models are not required.

Blocked by

• [MM-00] Define versioned memory benchmark manifest and artifacts #779 (MM-00)

Rollout and rollback

Dataset packages are additive and versioned; never mutate a frozen dataset version.

[bug-superman]

Implemented in commit b4058377 and integrated into Draft PR #820 as 3af7a9d0.

Validation:

• targeted dataset/grader suite: 11 passed, 0 failed
• @maka/headless: 835 passed, 0 failed, 1 skipped
• full workspace npm test: passed
• full workspace typecheck: passed
• Standards review: PASS
• Spec review: PASS

The PR remains Draft and is not being merged yet; MC-0 continues with MM-03.

[Astro-Han]

Superseded by #1615 (automatic long-term memory lifecycle, SQLite-based; accepted by maintainers 2026-07-30, PR ① #1770 merged). This MM-02 work item never landed outside draft PR #820 and is replaced by the #1615 design and its LongMemEval/MSC evaluation plan.