Join GitHub today
Writing output to $HOME/tool/temp puts load on Tool Labs NFS server #127
It would be nicer to write temporary files to the actual
Ideally the web interface would use some queuing mechanism to limit the number of parallel conversion jobs that are used to avoid work spikes that overload I/O and processing power on the shared job grid. This could be accomplished using the Redis server as a queue and a small number of dedicated jobs that polled Redis for work to do. I'd actually suggest starting with just a single worker and monitoring the queue depth for a week or two to determine if wait times actually warrant using more than a single worker.
Hi! Thank you for coming here. Sadly I have not a lot of free time currently so not time to implement a clean Redis queue.
I'll try to work on a change to use /tmp as much as possible in the next few days.
@samwilson Do you know if you could give some time to this tool as part of Community Tech team?