Remove debug mode for pytest config

[lazebnyi]

What:

This pull request suggests removing the debug mode from the pyproject.toml configuration file for tests. Developers can manually adjust the log level when they need to debug a test.

How:

• Removed the debug log level from the pyproject.toml configuration file for tests.
• Force log level for smart open to ERROR

Justification:

When working with source files, we utilize the open() method from the smart open library to open files - here. However, this method also logs local variables before opening the file - here and here. Simultaneously, we employ the pyproject.toml configuration file with the debug log level enabled to execute our unit/coverage/integration tests - here. As a result, all the arguments passed to the open() method will be displayed in the output.

Related Issues:

Fixes #27128

Checklist:

• Removed debug mode from pyproject.toml for tests
• Ran unit tests to ensure there are no regressions

[lazebnyi]

/test connector=connectors/source-file

🕑 connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/5212650269
✅ connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/5212650269
Python tests coverage:

Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/utils.py         13      1    92%
source_file/source.py        83      7    92%
source_file/client.py       335     56    83%
---------------------------------------------
TOTAL                       433     64    85%
Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/client.py       335     56    83%
source_file/utils.py         13      8    38%
source_file/source.py        83     62    25%
---------------------------------------------
TOTAL                       433    126    71%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
======================== 35 passed, 4 skipped in 52.65s ========================

[alafanechere]

Can we also force the log level of the smart-open logger and set it to error? I'm affraid that this problem can occur again on source-file if a context different than test also enables the debug log level?

[lazebnyi]

Can we also force the log level of the smart-open logger and set it to error? I'm affraid that this problem can occur again on source-file if a context different than test also enables the debug log level?

Done.

[lazebnyi]

/test connector=connectors/source-file

🕑 connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/5213350606
✅ connectors/source-file https://github.com/airbytehq/airbyte/actions/runs/5213350606
Python tests coverage:

Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/utils.py         13      1    92%
source_file/source.py        83      7    92%
source_file/client.py       337     56    83%
---------------------------------------------
TOTAL                       435     64    85%
Name                      Stmts   Miss  Cover
---------------------------------------------
source_file/__init__.py       2      0   100%
source_file/client.py       337     56    83%
source_file/utils.py         13      8    38%
source_file/source.py        83     62    25%
---------------------------------------------
TOTAL                       435    126    71%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: Incremental syncs are not supported on this connector.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:598: The previous and actual discovered catalogs are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:695: This tests currently leads to too much failures. We need to fix the connectors at scale first.
======================== 35 passed, 4 skipped in 53.72s ========================