Parallel option limits?

[devinus]

I'm attempting to use { parallel: 5 }, but that makes my pipeline only consume 5 lines rather than consumer 5 at a time. Is there something I'm missing?

[devinus]

I believe this is because I'm returning an error in the transform, i.e. callback(new Error()). Should this stop the streaming?

[devinus]

Also, if I use callback(null, true); it will only read 20 out of 200 lines.

[wdavidw]

yes, throwing/passing an error will stop calling new callbacks if i remember well

[wdavidw]

... this might be wrong, some people have reported bugs that i couldnt reproduce. send me sample a sample reproducing the pb and i will look at it.

[wdavidw]

You were probably not consuming the stream. See the new "consume" option if you still have issue and open a new issue with a sample or test case reproducing your issue. closing for now.