-
-
Notifications
You must be signed in to change notification settings - Fork 31.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Strange @typing.no_type_check
behavior for class variables
#90729
Comments
I was working on improving coverage and test quality of Let's dive into this! ## Everything is correct We will start with a basic example, that illustrates that everything works fine:
Ok, let's move on. Adding
|
def no_type_check(arg): | |
"""Decorator to indicate that annotations are not type hints. | |
The argument must be a class or function; if it is a class, it | |
applies recursively to all methods and classes defined in that class | |
(but not to methods defined in its superclasses or subclasses). | |
This mutates the function(s) or class(es) in place. | |
""" | |
if isinstance(arg, type): | |
arg_attrs = arg.__dict__.copy() | |
for attr, val in arg.__dict__.items(): | |
if val in arg.__bases__ + (arg,): | |
arg_attrs.pop(attr) | |
for obj in arg_attrs.values(): | |
if isinstance(obj, types.FunctionType): | |
obj.__no_type_check__ = True | |
if isinstance(obj, type): | |
no_type_check(obj) | |
try: | |
arg.__no_type_check__ = True | |
except TypeError: # built-in classes | |
pass | |
return arg |
As you can see above, we traverse all __dict__
values of the given class
and for some reason recurse into all nested types.
I think that the original goal was to handle cases like:
@no_type_check
class Outer:
class Inner: ...
And now it also affects regular assignments.
So, what can we do?
- Nothing, it works correctly (I disagree)
- Do not cover nested classes at all with
@no_type_check
, only cover methods - Only cover types that are defined in this class, like my
Inner
class example - Something else?
I think that (2)
is more inline with the currect implementation, so my vote is for it.
I would like to implement this when we will have the final agreement :)
...Option 3). Deprecate @no_type_check? Maybe we should gather some stats on how many people are using @no_type_check? My feeling is that it's never achieved widespread adoption, so maybe it's just not that useful a thing to have in the stdlib. Anyway, the behaviour you've pointed out is nuts, so I agree that something needs to change here! |
Let's not jump into deprecating it. I think (2) makes the most sense. If we can get that working reliably (using __qualname__ I assume), it would be my preference; otherwise we should do (1). This problem can also affect function objects, right? |
@no_type_check (introduced by PEP-484) is intended for static checkers, to signal to them that they shouldn't check the given function or class. I don't think PEP-484 specifies its runtime effect -- arguably get_type_hints() could just ignore it. Or raise an exception when called on such a class. We could even argue that @no_type_check shouldn't have a runtime effect. But before we change anything we should be guided by:
|
## 1. What is documented? The docs makes this even more weird!
https://docs.python.org/3/library/typing.html#typing.no_type_check Docs do not mention modifing nested classes at all! So, it looks like the ## 2. What does it do now? It modifies nested types, even ones used in assignments. ## 3. How is that used by runtime type inspectors? I've made a little research:
So, it always tries to coerce types. Docs: https://pydantic-docs.helpmanual.io/usage/types/ They also use it inside their own code-base: https://github.com/samuelcolvin/pydantic/search?q=no_type_check Probably for
Attrs: https://github.com/python-attrs/attrs/search?q=get_type_hints
So, as far as I understand, they only have So, to conclude, some project might still rely on current behavior that nested types are also implicitly marked as The noticable thing is that this never came up before in ~6 years while this logic exists: https://github.com/python/cpython/blame/8fb36494501aad5b0c1d34311c9743c60bb9926c/Lib/typing.py#L1969-L1970 It helps to prove my point: probably, no one uses it. ## 3. How is that used by runtime type inspectors? With all the information I gathered, I've changed my opinion :) This is what docs say. This will also solve the original problem. So, do others have any objections / comments / feedback? :) |
I agree with Jelle, let's go with (2). It feels strange to have a decorator modify types that it doesn't own. |
I fully withdraw my suggestion of deprecating the decorator; it's evidently used more than I realised. I don't have any strong opinion on whether (1) or (2) would be a better solution. |
Ken Jin, Jelle, can you please share your ideas why |
|
I agree that Jelle's proposal (Nikita's #2) looks best *if* we can implement it. How do we ensure that class A:
...
@no_type_check
class B:
AA = A
class C:
...
... suppresses annotations in B and C but not in A? |
I think we could do it by looking at __qualname__. |
Okay, somebody can submit a PR! |
Thanks for the fix Nikita! |
typing.no_type_check
to skip foreign objects #31042Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
bugs.python.org fields:
The text was updated successfully, but these errors were encountered: