multiprocessing.Pool.map hangs if pickling argument raises an exception

[nadeemvawda]

BPO	19425
Nosy	@tim-one, @pitrou

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2013-10-28.23:52:12.113>
created_at = <Date 2013-10-28.20:53:20.012>
labels = ['type-bug', 'library']
title = 'multiprocessing.Pool.map hangs if pickling argument raises an exception'
updated_at = <Date 2013-10-28.23:52:12.112>
user = 'https://bugs.python.org/nadeemvawda'

bugs.python.org fields:

activity = <Date 2013-10-28.23:52:12.112>
actor = 'sbt'
assignee = 'none'
closed = True
closed_date = <Date 2013-10-28.23:52:12.113>
closer = 'sbt'
components = ['Library (Lib)']
creation = <Date 2013-10-28.20:53:20.012>
creator = 'nadeem.vawda'
dependencies = []
files = []
hgrepos = []
issue_num = 19425
keywords = []
message_count = 2.0
messages = ['201580', '201589']
nosy_count = 7.0
nosy_names = ['tim.peters', 'pitrou', 'nadeem.vawda', 'jnoller', 'python-dev', 'sbt', 'cantor']
pr_nums = []
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue19425'
versions = ['Python 3.3', 'Python 3.4']

[nadeemvawda]

[Split off from bpo-19395]

The following code hangs after hitting a TypeError trying to pickle one
of the TextIOWrapper objects:

    import multiprocessing

    def read(f): return f.read()

    files = [open(path) for path in 3 * ['/dev/null']]
    pool = multiprocessing.Pool()
    results = pool.map(read, files)
    print(results)

This issue is present in 3.2, 3.3 and 3.4, but not in 2.7.

[python-dev]

New changeset 6aa42fc0c2f6 by Richard Oudkerk in branch '2.7':
Issue bpo-19425 -- a pickling error should not cause pool to hang.
http://hg.python.org/cpython/rev/6aa42fc0c2f6

New changeset a2230a8420a5 by Richard Oudkerk in branch '3.3':
Issue bpo-19425 -- a pickling error should not cause pool to hang.
http://hg.python.org/cpython/rev/a2230a8420a5