scanLeft and parallel prefix scan as pure lazy transformations

[erikerlandson]

An issue for scanLeft and parallell scan for RDDs, as pure lazy transformations:

Implementing an RDD scanLeft Transform With Cascade RDDs
http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/

Implementing Parallel Prefix Scan as a Spark RDD Transform
http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/

[ryan-williams]

This is really cool Erik, thanks, will look into it shortly!

…

On Thu, Feb 9, 2017, 3:28 PM Erik Erlandson ***@***.***> wrote: An issue for scanLeft and parallell scan for RDDs, as pure lazy transformations: Implementing an RDD scanLeft Transform With Cascade RDDs http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/ Implementing Parallel Prefix Scan as a Spark RDD Transform http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/ — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#39>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAcYlZ2BlZAs8733Ik3AtUqqmX6wFwO6ks5ra3bQgaJpZM4L8oIC> .

[erikerlandson]

Hi @ryan-williams - had a chance to take a look at this?

[ryan-williams]

Hi @erikerlandson, unfortunately I've not; I'd still like to but in the meantime if you want to send a PR that is more than welcome.