Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelize processing. #5

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Parallelize processing. #5

wants to merge 1 commit into from

Conversation

carschno
Copy link
Contributor

No description provided.

@carschno carschno self-assigned this Jul 28, 2023
@carschno
Copy link
Contributor Author

This does not seem to increase processing speed.
On my local machine with 10 CPU cores, speed decreased from ~6 files per second to ~1.5 files per second when using 10 parallel workers.

The bottleneck might be I/O rather than CPU, so parallelization would be redundant altogether.

@sonarcloud
Copy link

sonarcloud bot commented Jul 28, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

20.0% 20.0% Coverage
0.0% 0.0% Duplication

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@carschno carschno

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
1 participant
@carschno