New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upload packages in parallel #5856
Conversation
I have added a mutex to avoid problems while loading hooks. This PR is failing, not because of the PR itself but because of the I have opened #5957, which must be fixed first before this PR can be merged. |
I have merged develop and pushed. Then testing a little bit:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good!
Make sure to do a last round of manual testing (py27, py36, a couple of platforms) to check everything is good, and can be merged.
Create a UX issue to improve:
- the text of the downloaded messages, something that is useful as a log of what exactly has been uploaded
- In platforms like CI or cmake.conan, the output is a few lines of blank text, which reads weird. Try if that output can be improved too.
@czoido create the issue and merge. |
Changelog: Feature: New argument of
conan upload
command--parallel
to upload packages using multithreading.Docs: conan-io/docs#1250
ThreadPool
to parallelize upload across recipes and packages upload.--parallel
option is present, the upload will use 8 threads to upload and use only one thread in the case it is missing.Closes #3452
develop
branch, documenting this one.Note: By default this PR will skip the slower tests and will use a limited set of python versions. Check here how to increase the testing level by writing some tags in the current PR body text.