D5.1: Turn the Python prototypes for tree exploration into production code, integrate to Sage . #107

Closed
minrk opened this Issue Sep 8, 2015 · 3 comments

Comments

Projects
None yet
4 participants
@minrk
Contributor

minrk commented Sep 8, 2015

MapReduce is a classical programming model for distributed computations where one maps a function on a large data set and use a reduce function to summarize all the produced information. A use case that occurs often e.g. in combinatorics is to have a data sets that is described by a recursion tree, and is too big to be expanded in memory. Instances include counting the number of elements in the data set, or collecting some statistics on them.

A prototype distributed implementation of this programming model had been written in 2010-2014 for SageMath, using multiple processes on a single machine and work-stealing for load balancing. In this deliverable, we have turned this prototype into production code and integrated it into the SageMath distribution.

See Trac Ticket 13580 for the source code and the discussion about the integration into Sage, as well as this snapshot of the documentation.

This work was presented at the journée du groupe de travail LaMHA at Université Pierre et Marie Curie on November the 26th of 2016. The slides give an overview of the motivations, algorithm, and implementation.

@minrk minrk added this to the D5.1 milestone Sep 8, 2015

@nthiery nthiery referenced this issue Sep 11, 2015

Closed

First informal review #156

3 of 3 tasks complete

@hivert hivert assigned hivert and unassigned ClementPernet Dec 14, 2015

@hivert

This comment has been minimized.

Show comment
Hide comment
@hivert

hivert Dec 14, 2015

Contributor

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" is now needs review on Sage trac.

Contributor

hivert commented Dec 14, 2015

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" is now needs review on Sage trac.

@hivert

This comment has been minimized.

Show comment
Hide comment
@hivert

hivert Apr 9, 2016

Contributor

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" was just integrated to Sage. I'm closing this issue.

Contributor

hivert commented Apr 9, 2016

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" was just integrated to Sage. I'm closing this issue.

@hivert hivert closed this Apr 9, 2016

@nthiery

This comment has been minimized.

Show comment
Hide comment
@nthiery

nthiery Apr 9, 2016

Contributor

Yippee!

Contributor

nthiery commented Apr 9, 2016

Yippee!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment