Skip to content

Conversation

@armenzg
Copy link
Member

@armenzg armenzg commented Nov 21, 2025

Instead of deleting 10k groups let's remove 30k per project.

There's also some other minor code removal.

Instead of deleting 10k groups let's remove 30k per project.

There's also some other minor code removal.
@armenzg armenzg self-assigned this Nov 21, 2025
@armenzg armenzg requested review from wedamija and yuvmen November 21, 2025 20:35
@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label Nov 21, 2025
debug_output("Running bulk deletes in DELETES_BY_PROJECT")

# Count total projects for progress tracking
total_projects = project_deletion_query.count()
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We don't use any of this.

)

for chunk in q.iterator(chunk_size=100):
for chunk in q.iterator(chunk_size=100, batch_size=30000):
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The default is 10k:

self, chunk_size: int = 100, batch_size: int = 10000

Let's try doing 3x and see if things improve.

Copy link
Member

@wedamija wedamija left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doesn't hurt to try, let's just make sure to set it back if it doesn't help

@armenzg armenzg merged commit 7a2d7f0 into master Nov 24, 2025
68 checks passed
@armenzg armenzg deleted the 11_21/more_groups branch November 24, 2025 12:25
armenzg added a commit that referenced this pull request Nov 25, 2025
This partially reverts #103851 since it did not make a difference.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants