Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallel execution of RemoteDataSource does not work due to httplib Client lock #31

Closed
josephbirkner opened this issue Sep 6, 2023 · 0 comments · Fixed by #30
Closed

Parallel execution of RemoteDataSource does not work due to httplib Client lock #31

josephbirkner opened this issue Sep 6, 2023 · 0 comments · Fixed by #30
Assignees
@josephbirkner
Labels
bug Something isn't working
Milestone
0.2.0

Comments

@josephbirkner
Copy link
Contributor

Currently, all workers for a RemoteDataSource share the same httplib Client. However, it is not possible to run parallel requests through one socket, so the parallelization is effectively disabled.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@josephbirkner josephbirkner

Labels
bug Something isn't working
Projects
None yet
Milestone
0.2.0
Development

Successfully merging a pull request may close this issue.

Fix parallel request processing for RemoteDataSource ndsev/mapget
1 participant
@josephbirkner