-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature suggestion: parallel rar/par and upload queue #54
Comments
Hi Tensai, 1.: pros:
2.: cons:
So basically I find it too risky. And anyway, if you're having a queue, what's the hurry, just launch it and come back the next morning. |
Hi Matthieu many thanks for our response. Unfortunately I am not as proficiency in C++/QT as you obviously are and honestly have no time to dig into it. Still hope you might consider doing so. Regards, Tensai |
Well I didn't have any feedback from "professional" posters... Monitor the disk space is an hassle, especially with multi-OS support. I'm waiting for some translations to release the v4.8. I'll check if I can find a way to include it "easily". |
Well, now you have ;-) At least indirect because I am not actually one of them myself but I certainly can say I do represent some of them.
This is absolutely reasonable and would be sufficient to achive the same overall performance. |
ok I'm having a look. |
@Mamitomama I'm not sure I get what you want to do... Why stop the upload and/or only prepare the packing without uploading? what's the goal. I've implemented a simple version where I'm packing the next post in queue while uploading the current one. It seems to work. I believe it is enough as packing is in general much faster than posting. So you end up waiting only the first time for the packing then it is uploading in continue the whole queue \o/ Would you guys be able to beta test? I'm still missing a little part to handle new incoming file but it should be ready in a few hours. What OS are you on? Linux command line? do you compile from the sources? PS: @Mamitomama are you on the same community of @Tensai75 ? |
the beta is pushed. Open the config file to add PREPARE_PACKING:
|
Hi Matthieu
Have you ever thought of separating the rar/par process and and the upload process into separate queues so they can be done in parallel?
Especially when monitoring a folder with a lot of jobs, this could drastically improve the overall performance. E.g. while uploading the first job (after it has been initially rared and pared), the next job(s) could already be rared and pared in parallel and then put into the upload queue.
Programmatically this can be done easily and I used this approach in a private upload tool I wrote myself in node.js using nyuu as the actual upload program.
Would love to hear your thoughts about this.
Regards, Tensai
The text was updated successfully, but these errors were encountered: