Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(upload-files): use a new ThreadPoolExecutor for every batch (DEV-2973) #650

Merged
merged 4 commits into from Nov 20, 2023
Merged

fix(upload-files): use a new ThreadPoolExecutor for every batch (DEV-2973) #650

merged 4 commits into from Nov 20, 2023

Conversation

jnussbaum
Copy link
Collaborator

No description provided.

@linear Linear
Copy link

linear bot commented Nov 20, 2023

DEV-2973 upload-files: MacPro OS becomes unresponsive

When uploading 102'000 files with upload-files, the Mac OS suddenly becomes very slow after 94'000 files (=7 days). The upload speed was almost constant during the 7 days, but then suddenly, there are big gaps in the logs, and only every few hours, some few files are uploaded.

@jnussbaum jnussbaum self-assigned this Nov 20, 2023
@jnussbaum jnussbaum merged commit 431a755 into main Nov 20, 2023
9 checks passed
@jnussbaum jnussbaum deleted the wip/DEV-2973-fix-resource-leak branch November 20, 2023 15:38
@daschbot daschbot mentioned this pull request Nov 20, 2023
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@BalduinLandolt BalduinLandolt BalduinLandolt approved these changes

Assignees

@jnussbaum jnussbaum

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@jnussbaum @BalduinLandolt