Add access to filepath in MultiMapper #62

mshevelev opened this Issue Nov 19, 2012 · 0 comments


None yet
1 participant

Currently MultiMapper has no access to filepaths of the input lines. This is because current implementation of*key functions use filepaths to distribute input lines between (sub)mappers and then implicitly removes filepath from key/key.body.

mshevelev pushed a commit to mshevelev/dumbo that referenced this issue Nov 19, 2012

Mikhail Shevelev
Fix #62 Added path as key[0] for MultiMapper
Note: for all mapper added into MultiMapper input key is a tuple
with key[0] equal to pathname. This works regardless of "addpath" option.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment