[pytest] not working in PyCharm _jb_pytest_runner.py: error: unrecognized arguments: --asyncio-mode=strict (and add dev/requirements.txt)

[seunggabi]

Apache Airflow version

main (development)

What happened

Error

ERROR: usage: _jb_pytest_runner.py [options] [file_or_dir] [file_or_dir] [...]
_jb_pytest_runner.py: error: unrecognized arguments: --asyncio-mode=strict

I fronted this error message.
So, I excluded this code.
It's works now.

Can I exclude --asyncio-mode=strict opt?

What you think should happen instead

No response

How to reproduce

as-is

# pyproject.toml

[tool.pytest.ini_options]
# * Disable `flaky` plugin for pytest. This plugin conflicts with `rerunfailures` because provide same marker.
# * Disable `nose` builtin plugin for pytest. This feature deprecated in 7.2 and will be removed in pytest>=8
# * And we focus on use native pytest capabilities rather than adopt another frameworks.
addopts = "-rasl --verbosity=2 -p no:flaky -p no:nose --asyncio-mode=strict"

to-be

# pyproject.toml

[tool.pytest.ini_options]
# * Disable `flaky` plugin for pytest. This plugin conflicts with `rerunfailures` because provide same marker.
# * Disable `nose` builtin plugin for pytest. This feature deprecated in 7.2 and will be removed in pytest>=8
# * And we focus on use native pytest capabilities rather than adopt another frameworks.
# addopts = "-rasl --verbosity=2 -p no:flaky -p no:nose --asyncio-mode=strict"

Operating System

MacOSX

Versions of Apache Airflow Providers

No response

Deployment

Other

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[potiuk]

You missed the fact that you need to install [dev] extra with airflow in your venv. There is pytest-asyncio dependency there that you should have.

Please avoid in the future opening such issues as "airflow" issue. Open discussions if you try to do something and it does not work and you have question about it.

[dabla]

Thanks for your reply, installing that dependency on my setup solved this issue as well on my side. The problem is that when I try to run the tests locally on my machine I receive a pickling error:

Launching pytest with arguments test_file.py::TestOpenMaybeZipped --no-header --no-summary -q in C:\Users\USERNAME\workspace\github\airflow\tests\utils

WARNING:root:OSError while attempting to symlink the latest log directory
C:\Users\USERNAME\AppData\Roaming\Python\Python310\site-packages\flask_appbuilder\models\sqla\__init__.py:105 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
C:\Users\USERNAME\AppData\Roaming\Python\Python310\site-packages\marshmallow_sqlalchemy\convert.py:17 DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
C:\Users\USERNAME\AppData\Roaming\Python\Python310\site-packages\marshmallow_sqlalchemy\convert.py:17 DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
ImportError while loading conftest 'C:\Users\USERNAME\workspace\github\airflow\tests\conftest.py'.
..\conftest.py:55: in <module>
    from tests.test_utils.db import clear_all  # noqa: E402
..\test_utils\db.py:21: in <module>
    from airflow.jobs.job import Job
..\..\airflow\jobs\job.py:35: in <module>
    from airflow.serialization.pydantic.job import JobPydantic
..\..\airflow\serialization\pydantic\job.py:36: in <module>
    class JobPydantic(BaseModelPydantic):
pydantic\main.py:222: in pydantic.main.ModelMetaclass.__new__
    ???
pydantic\fields.py:506: in pydantic.fields.ModelField.infer
    ???
pydantic\fields.py:436: in pydantic.fields.ModelField.__init__
    ???
pydantic\fields.py:546: in pydantic.fields.ModelField.prepare
    ???
pydantic\fields.py:570: in pydantic.fields.ModelField._set_default_and_type
    ???
pydantic\fields.py:439: in pydantic.fields.ModelField.get_default
    ???
pydantic\utils.py:695: in pydantic.utils.smart_deepcopy
    ???
C:\Program Files\Python310\lib\copy.py:172: in deepcopy
    y = _reconstruct(x, memo, *rv)
C:\Program Files\Python310\lib\copy.py:271: in _reconstruct
    state = deepcopy(state, memo)
C:\Program Files\Python310\lib\copy.py:146: in deepcopy
    y = copier(x, memo)
C:\Program Files\Python310\lib\copy.py:231: in _deepcopy_dict
    y[deepcopy(key, memo)] = deepcopy(value, memo)
C:\Program Files\Python310\lib\copy.py:161: in deepcopy
    rv = reductor(4)
E   TypeError: cannot pickle '_thread.RLock' object

When suppressing the TypeError while importing the the db test_utils in conftest as a workaround then the tests get executed but of course I get the same error as above for each executed test:

with suppress(TypeError):
    from tests.test_utils.db import clear_all  # noqa: E402

[potiuk]

Airflow test cannot be run natively on windows. The only execution environment that works on Windows is WSL2. See the requirements.

[dabla]

Thanks for the fast answer that indeed explains the issue forgot about that!