Home

Welcome to the hadception wiki!

This is the source repo for the Hadoop Nested Map-Reduce Framework (hadoop + inception = hadception)

What the framework does:

• allows any mapper or reducer to start a new job running remote code that the user provides
• provides nested interlinked jobs to be executed as part of one job
• enables multiple inputs to be run with different remote user written code based on each particular input

September 2012 -> Framework going into remodelling and improving internal and management ideas.

To Do:

• integrate with Hadoop Skeletons projects

• remodel internal state machine

• upgrade pipelines

• parallelise computation

• bypass stages of pipelining not necessary when nesting.

• try to add support for scripting languages.