"in" expression falls back to __iter__ before __getitem__

[afoglia]

BPO	6324
Nosy	@birkenfeld, @rhettinger, @terryjreedy

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = 'https://github.com/birkenfeld'
closed_at = <Date 2009-10-22.15:00:19.545>
created_at = <Date 2009-06-22.19:27:52.681>
labels = ['docs']
title = '"in" expression falls back to __iter__ before __getitem__'
updated_at = <Date 2009-10-22.15:00:19.543>
user = 'https://bugs.python.org/afoglia'

bugs.python.org fields:

activity = <Date 2009-10-22.15:00:19.543>
actor = 'georg.brandl'
assignee = 'georg.brandl'
closed = True
closed_date = <Date 2009-10-22.15:00:19.545>
closer = 'georg.brandl'
components = ['Documentation']
creation = <Date 2009-06-22.19:27:52.681>
creator = 'afoglia'
dependencies = []
files = []
hgrepos = []
issue_num = 6324
keywords = []
message_count = 6.0
messages = ['89607', '89743', '89744', '89745', '94335', '94347']
nosy_count = 4.0
nosy_names = ['georg.brandl', 'rhettinger', 'terry.reedy', 'afoglia']
pr_nums = []
priority = 'normal'
resolution = 'fixed'
stage = None
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue6324'
versions = ['Python 3.1', 'Python 2.7', 'Python 3.2']

[afoglia]

I was debugging a class where I defined __getitem__ and __iter__, but
not __contains__. The documentation describing this case (at the end of
section 5.9) is old and hasn't been updated for the iterator protocol.

It should read something like:

"For user-defined classes which do not define __contains__() and do
define __iter__() or __getitem__(), x in y is true if and only if there
is a value z reachable from iter(y) before iter(y) throws a
StopIteration exception. (If any other exception is raised, it is as if
in raised that exception)."

Or something better worded.

(I'm using Python 2.5, but I really doubt things have changes in 2.6 or
2.7. I don't know enough about 3.0 to know either way.)

[terryjreedy]

In 3.1, Section 5.9 has
"
For user-defined classes which define the __contains__() method, x in y
is true if and only if y.__contains__(x) is true.

For user-defined classes which do not define __contains__() and do
define __getitem__(), x in y is true if and only if there is a
non-negative integer index i such that x == y[i], and all lower integer
indices do not raise IndexError exception. (If any other exception is
raised, it is as if in raised that exception).
"
However, discussion of how user-defined classes emulate builtins is
mostly in 3.3. Special method names. I think some of the above should be
moved, with or without revision, (or copied) to 3.3.5. Emulating
container types.

The current entry there says only
"
object.__contains__(self, item)
Called to implement membership test operators. Should return true if
item is in self, false otherwise. For mapping objects, this should
consider the keys of the mapping rather than the values or the key-item
pairs.
"
which seems to me inadequate, as it does not discuss the alternative, as
many other entries in 3.3 do.

Regardless of that, I verified that in 3.1, __iter__ is called in
preference to __getitem__:

class C():
    def __iter__(s):
        print('in iter')
        return iter([])
    def __getitem(s,i):
        print('in getitem')

print(1 in C())

prints
in iter
False

so some change is needed.

[terryjreedy]

Side note: 2.5, including, I believe, the docs, is frozen except for
security fixes. If you find 2.5 doc issues, please check the current 2.x
development version, currently http://docs.python.org/dev/ to see if
they have been fixed or not.

[rhettinger]

3.0 is no longer supported either

[afoglia]

I've added Python 2.7 to the list of versions. The development docs
have the same issue.

Let me try another stab at what the docs should say. Following the
suggestion to add it to 3.3.5, perhaps it should be:

"
object.__contains__(self, item)
Called to implement membership test operators. Should return true if
item is in self, false otherwise. For mapping objects, this should
consider the keys of the mapping rather than the values or the key-item
pairs.

If \_\_contains__ is not provided but \_\_iter__ is provided, the

membership test "x in y" is true if and only if there is a value z
reachable by iterating iter(y) before iter(y) throws a StopIteration
exception. (If any other exception is raised, it is as if
in raised that exception).

If neither \_\_contains__ nor \_\_iter__ are provided but \_\_getitem__ is

provided, the membership test "x in y" is true if and only if there is a
non-negative integer index i such that x == y[i], and all lower integer
indices do not raise IndexError exception. (If any other exception is
raised, it is as if in raised that exception).
"

I worry that this is becoming more a description of "in" rather than
__contains__.

Either way, the last sentence in paragraph 6 of section 5.9 should refer
not just to 3.3.1 (Basic Customization) but also 3.3.5 (Emulating
Container Types). The latter is where __contains__, __iter__ and
__getitem__ are defined. Perhaps the new wording should be, "You can
control comparison behavior of objects of non-built-in types by defining
rich comparison methods like __gt__(), described in section Basic
customization, and the membership test method __contains__(), described
in section Emulating container types."

[birkenfeld]

Thanks, fixed in r75606.