Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

D5.1: Turn the Python prototypes for tree exploration into production code, integrate to Sage . #107

Closed
minrk opened this issue Sep 8, 2015 · 3 comments

Comments

@minrk
Copy link
Contributor

@minrk minrk commented Sep 8, 2015

MapReduce is a classical programming model for distributed computations where one maps a function on a large data set and use a reduce function to summarize all the produced information. A use case that occurs often e.g. in combinatorics is to have a data sets that is described by a recursion tree, and is too big to be expanded in memory. Instances include counting the number of elements in the data set, or collecting some statistics on them.

A prototype distributed implementation of this programming model had been written in 2010-2014 for SageMath, using multiple processes on a single machine and work-stealing for load balancing. In this deliverable, we have turned this prototype into production code and integrated it into the SageMath distribution.

See Trac Ticket 13580 for the source code and the discussion about the integration into Sage, as well as this snapshot of the documentation.

This work was presented at the journée du groupe de travail LaMHA at Université Pierre et Marie Curie on November the 26th of 2016. The slides give an overview of the motivations, algorithm, and implementation.

@minrk minrk added this to the D5.1 milestone Sep 8, 2015
@nthiery nthiery mentioned this issue Sep 11, 2015
3 of 3 tasks complete
@hivert hivert assigned hivert and unassigned ClementPernet Dec 14, 2015
@hivert
Copy link
Contributor

@hivert hivert commented Dec 14, 2015

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" is now needs review on Sage trac.

@hivert
Copy link
Contributor

@hivert hivert commented Apr 9, 2016

Ticket #13580 "Distributed/Paralell computations using RecursivelyEnumeratedSet and Map-Reduce" was just integrated to Sage. I'm closing this issue.

@hivert hivert closed this Apr 9, 2016
@nthiery
Copy link
Contributor

@nthiery nthiery commented Apr 9, 2016

Yippee!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
4 participants
You can’t perform that action at this time.