New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parallel downloading #49
Conversation
@@ -194,13 +194,13 @@ public void outputFailedPlugins() { | |||
* @param plugins list of plugins to download | |||
*/ | |||
public void downloadPlugins(List<Plugin> plugins) { | |||
for (Plugin plugin : plugins) { | |||
plugins.parallelStream().forEach(plugin -> { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you run it on your setup and see if it helps 馃槃
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That was the plan! I am just abusing Jenkins CI to get the jar 馃槄
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Holy crap 馃檶
real 1m 6.93s
user 0m 8.98s
sys 0m 1.86s
I think we can optimize it even more if we play with custom thread pool and just doing it on all available cores (+hyper threading)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
but reading up on optimizing I would say NOPE 馃槄
Okay after fixing #50 the full download takes
Still a huge improvement but I think we can do better! |
I'd say let's merge this at least and then we can worry about improving the download even more! |
Hopefully, this should speed up downloads 馃槄
time diff I did on our plugins.txt:
.jar after:
.jar before:
.sh: