Skip to content

Refactor benchmark and support LongMemEval#20

Merged
starboyate merged 10 commits intomainfrom
feat/memind-benchmark
Apr 4, 2026
Merged

Refactor benchmark and support LongMemEval#20
starboyate merged 10 commits intomainfrom
feat/memind-benchmark

Conversation

@starboyate
Copy link
Copy Markdown
Collaborator

Summary

  • consolidate benchmark logic into memind-evaluation and remove the legacy memind-benchmark module
  • add dataset profile/config support for LoCoMo and LongMemEval, including query building, evaluator wiring, and batch/checkpoint improvements
  • harden vector and JDBC persistence paths and add regression coverage for LongMemEval conversion and insight flush behavior

Test Plan

  • mvn test

@starboyate starboyate linked an issue Apr 4, 2026 that may be closed by this pull request
@starboyate starboyate merged commit ca8e52c into main Apr 4, 2026
2 checks passed
@starboyate starboyate deleted the feat/memind-benchmark branch April 4, 2026 06:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature]: add LongMemEval benchmark support

1 participant