Skip to content

Streaming consolidation for large hot-tier backlogs #11

@salishforge

Description

@salishforge

consolidate() loads all pending hot-tier rows into memory at once (up to CONSOLIDATION_BATCH_SIZE). For agents with 10K+ events this causes high memory usage. Use cursor-based pagination to process 50 rows at a time with per-batch transactions. See BACKLOG.md #6.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestperformancePerformance improvements

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions