Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crash if mapper or reducer does not yield anything #66

Open
a4tunado opened this issue Dec 20, 2012 · 1 comment
Open

Crash if mapper or reducer does not yield anything #66

a4tunado opened this issue Dec 20, 2012 · 1 comment

Comments

@a4tunado
Copy link

Some jobs do not produce any output for ex. uploading input data to external storage or something like this. Dumbo expected that each reducer or mapper yields some data otherwise it leads to crash.

@a4tunado a4tunado reopened this Dec 20, 2012
a4tunado added a commit to a4tunado/dumbo that referenced this issue Dec 20, 2012
@ediskandarov
Copy link

You can create empty generator like this

def reducer(data):
    for key, values in data:
        # do something

    return
    yield

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants