Add access to filepath in MultiMapper #62

Open
mshevelev opened this Issue Nov 19, 2012 · 0 comments

Comments

Projects
None yet
1 participant
@mshevelev

Currently MultiMapper has no access to filepaths of the input lines. This is because current implementation of MultiMapper.call*key functions use filepaths to distribute input lines between (sub)mappers and then implicitly removes filepath from key/key.body.

mshevelev pushed a commit to mshevelev/dumbo that referenced this issue Nov 19, 2012

Mikhail Shevelev
Fix #62 Added path as key[0] for MultiMapper
Note: for all mapper added into MultiMapper input key is a tuple
with key[0] equal to pathname. This works regardless of "addpath" option.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment