Skip to content

WAL recovery and replication speed up.#3799

Merged
andrejtonev merged 13 commits intomasterfrom
faster_edge_replication
Feb 24, 2026
Merged

WAL recovery and replication speed up.#3799
andrejtonev merged 13 commits intomasterfrom
faster_edge_replication

Conversation

@andrejtonev
Copy link
Copy Markdown
Contributor

@andrejtonev andrejtonev commented Feb 16, 2026

WAL recovery/replication uses an edge cache that speeds up edge lookup for set property deltas.
Cache is sufficient only in case the edge was created and its property set in the same transaction.
Introduced new edge info tracker in the transaction scope to cover the case where property was set in a different transaction.
WAL recovery of edges with properties 5x speedup.
Replication of such edges 20x speedup.
Bugfix: Vector index snapshot using raw label id.
closes #3794

@andrejtonev andrejtonev self-assigned this Feb 16, 2026
@andrejtonev andrejtonev added Capability - high-availability Docs - changelog only Docs - changelog only Code improvements CI -build=jepsen -test=core Run jepsen build and core tests on push CI -build=debug -test=integration Run debug build and integration tests on push CI -build=release -test=e2e Run release build and e2e tests on push CI -build=coverage -test=clang_tidy labels Feb 16, 2026
@andrejtonev andrejtonev changed the title New delta for setting up edge set property on replica WAL recovery and replication speed up. Feb 20, 2026
@andrejtonev andrejtonev marked this pull request as ready for review February 20, 2026 11:09
@andrejtonev andrejtonev requested a review from as51340 February 20, 2026 11:09
@andrejtonev
Copy link
Copy Markdown
Contributor Author

andrejtonev commented Feb 20, 2026

Git commit description, explain the changes you made here


Leave above in PR description, copy the below into a comment


Tracking

  • [Link to Epic/Issue]

Standard development

CI Testing Labels

  • Select the appropriate CI test labels (CI -build=build-name -test=test-suite)

Documentation checklist

  • Add the documentation label
  • Add the bug / feature label
  • Add the milestone for which this feature is intended
    • If not known, set for a later milestone
  • Write a release note, including added/changed clauses
    • EdgeSetProperty WAL delta has been expanded. This speeds up edge recovery and replication. Nothing to do, this is all automatic and back-compatible. #3799
  • [ Documentation PR link memgraph/documentation#XXXX ]
    • Is back linked to this development PR

@andrejtonev andrejtonev added CI -build=coverage -test=core Run coverage build and core tests on push CI -build=debug -test=core Run debug build and core tests on push CI -build=release -test=stress Run release build and stress tests on push CI -build=release -test=benchmark Run release build and benchmark on push labels Feb 20, 2026
@andrejtonev andrejtonev changed the base branch from master to durability_v33 February 23, 2026 11:28
@andrejtonev andrejtonev force-pushed the faster_edge_replication branch from 2147ee5 to d8158f1 Compare February 23, 2026 11:45
Base automatically changed from durability_v33 to master February 23, 2026 15:25
@andrejtonev andrejtonev force-pushed the faster_edge_replication branch from d8158f1 to c77abaa Compare February 24, 2026 08:23
@sonarqubecloud
Copy link
Copy Markdown

@andrejtonev andrejtonev added this pull request to the merge queue Feb 24, 2026
Merged via the queue into master with commit c193810 Feb 24, 2026
40 checks passed
@andrejtonev andrejtonev deleted the faster_edge_replication branch February 24, 2026 12:17
@andrejtonev andrejtonev added this to the mg-v3.8.2 milestone Mar 9, 2026
@mattkjames7 mattkjames7 modified the milestones: mg-v3.8.2, mg-v3.9.0 Mar 9, 2026
@gitbuda gitbuda mentioned this pull request Mar 11, 2026
68 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Capability - high-availability CI -build=coverage -test=clang_tidy CI -build=coverage -test=core Run coverage build and core tests on push CI -build=debug -test=core Run debug build and core tests on push CI -build=debug -test=integration Run debug build and integration tests on push CI -build=jepsen -test=core Run jepsen build and core tests on push CI -build=release -test=benchmark Run release build and benchmark on push CI -build=release -test=e2e Run release build and e2e tests on push CI -build=release -test=stress Run release build and stress tests on push Code improvements Docs - changelog only Docs - changelog only

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Memgraph under SYNC/STRICT_SYNC too slow for replication of edges

3 participants