pytest.skip in conftest/__init__ files doesn't work as expected

[MishaVyb]

Problem description

Pytest has special mechanism to skip modules described here.

But when applying this to conftest.py (or __init__.py), this call skip entire package, not only that module. And this happened even with allow_module_level=False. For example:

# content of tests/test_package_A/confest.py
import sys
import pytest

if sys.version_info < (3, 11):
    pytest.skip("Python>=3.11 is required. ", allow_module_level=False)

Pytest and operating system versions

pytest 8.2.1
MacOS Monterey 12.3.1 (21E258)

Expecting behaviour

1- Do not allow using pytest.skip(allow_module_level=False) in conftest.py (or __init__.py). The same, as It's not allowed for test modules. So, expected error message might be the same:

Using pytest.skip outside of a test will skip the entire module. If that's your intention, pass allow_module_level=True

2- And even more, I would suggest that another flag should be set explicitly to skip entire directory/package. For example:

pytest.skip("Python>=3.11 is required. ", allow_package_level=True)   # package level flag specified here

[RonnyPfannschmidt]

I'd opt for entirely deprecatingly module level skip instead, import time ought to only allow declarative mechanisms

[MishaVyb]

I'd opt for entirely deprecatingly module level skip instead, import time ought to only allow declarative mechanisms

Probably, I'd agree with you. Anyway we should report an error in that case, instead of skipping everything silently

[MishaVyb]

Is anyone interesting in it to open a PR? If no other who wish to, I would like to do it. It doesn't look difficult

But we need to consider, what behaviour should be in that case? Some verbose error message similar to this?

Using pytest.skip at top level of conftest.py/init.py files is not allowed