Use zeromq to move objects between processes if available?

[kendonB]

Work would get going much faster using zeromq.

[HenrikBengtsson]

Yes, ZeroMQ is neat. The clustermq package is a great example of how to do distributed/parallelized processing using it. It sounds like a 'future.clustermq' backend package could meet your needs - is that correct? There's an open Issue #204 for this.

PS. To clarify what you can expect from the 'future' package itself and why I think this needs to go into future-backend package, note that the built-in parallel backends (multicore and multisession/cluster) of the 'future' package are just wrappers of the ones provided by the 'parallel' package. So, in order to add features those built-in backends, we need them to go into the parallel package. The point of the future package is to provide a lightweight API with minimal dependencies.

[kendonB]

Ah I see. I would be surprised if R-core would alter the parallel package in such a way but the future.clustermq package should work. Will close and like #204