Skip to content

More Vector Set test hardening#1665

Merged
vazois merged 3 commits intomainfrom
users/kmontrose/vectorSetTestHardening
Apr 2, 2026
Merged

More Vector Set test hardening#1665
vazois merged 3 commits intomainfrom
users/kmontrose/vectorSetTestHardening

Conversation

@kevin-montrose
Copy link
Copy Markdown
Contributor

@kevin-montrose kevin-montrose commented Apr 2, 2026

Looking into some recent failures, and getting some (rare) local reproductions, these failures seem linked to WaitForReplicaAofSync.

My current theory is that the asynchronous replay of VADD and the background cleanup after DEL|UNLINK confuses this test function. Not all tests trigger it, but MigrateVectorSetWhileModifyingAsync seem pretty prone, so removing these calls which don't appear* strictly necessary.

  • Waiting on a CI run (result: 2 failures)

Some null refs still happen after this change... looking at possible use-after-Dispose cases, also in replication.

Found a fixed a bug in AofProcessor.Dispose not shutting down VectorManager replication tasks.

  • Waiting for CI run (result: pass)
  • Stressing locally (result: occasionally seeing WaitForMigrationCleanup timeout, but Vector Set's don't appear to be at fault)

Doing a bit more digging into WaitForMigrationCleanup failures...

*These tests grew from existing cluster tests, so the "wait" calls were not added with any rigor.

…icely with Vector Sets asynchronous replication / cleanup
Copilot AI review requested due to automatic review settings April 2, 2026 17:11
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR aims to reduce flakiness in Vector Set cluster tests by removing WaitForReplicaAofSync calls that appear to be unreliable when VADD replay and post-DEL|UNLINK cleanup are asynchronous.

Changes:

  • Removed WaitForReplicaAofSync waits from MigrateVectorSetWhileModifyingAsync after slot migration and before post-write validation.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@badrishc badrishc requested a review from vazois April 2, 2026 17:16
@vazois vazois merged commit 819a8f6 into main Apr 2, 2026
27 checks passed
@vazois vazois deleted the users/kmontrose/vectorSetTestHardening branch April 2, 2026 22:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants