Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
LocalThreadExecutor can use more threads for output plugins #232
Some input plugins don't support parallel processing. Or input plugins can't run using multiple threads under certain situation (e.g. data source is a big single file).
In those cases, we want to use more threads than number of input threads.
A difficulty of implementation is dispatching of pages to output plugins. It must be deterministic. For example, use round-robin per input task: