Skip to content

SPR-304: Handling 1M+ DDL changes in a single txn #822

@garthgoodson

Description

@garthgoodson
field value
url https://linear.app/springtail/issue/SPR-304/handling-1m-ddl-changes-in-a-single-txn
author @
date Fri Oct 25 09:00:53 PDT 2024
state Backlog
project
priority No priority
assignee
labels Bug Ingest
related
parent
children
PRs
attachments

Right now if we had a large number of DDL changes in a single transaction (e.g., over 1 million), then the approach of RedisDDL of placing all of the changes into a single Redis value would fail.

It's an extreme corner case, and it's unlikely that such a large change set would not end up triggering a re-sync, which would side-step this entire process, but it's still possible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    IngestAKA GCbugSomething isn't working

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions