Usage of py.test and test coverage

[andy-maier]

This issue lists all unit test cases with their pytest migration status and with their missing lines of test coverage in the module the test scripts are targeting to test.

Test scripts that don't exist yet:

• test_mock_dmtf_cim_schema.py

Test scripts that have partially moved to pytest:

• test_cim_obj.py (First part in PR Issue #1201 Migrated test_cim_obj from unittest to pytest, part 1 #1243, 89 missing lines)
• test_tupletree.py (3 missing lines)

Test scripts that have not moved to pytest at all yet:

• test_mof_compiler.py (286 missing lines)
• test_cim_http.py (195 missing lines - hard to test)
• test_recorder.py (127 missing lines)
• test_indicationlistener.py (114 missing lines)
• test_cim_xml.py (15 missing lines)
• test_statistics.py (7 missing lines)

Test scripts that are completely using pytest:

• test_subscriptionmanager.py (PR fixes #1250 #1279 add subscription mgr test #1261)
• testclient/test_conftest.py (PR Fixes #426 Migrated test_client yaml execution to pytest #1219, 247 missing lines in cim_operations.py)
• test_cim_operations.py (247 missing lines, mostly recorder - also tested by test_client.py)
• test_itermethods.py (tests iter methods, 247 missing lines in cim_operations.py)
• test_wbemconnection_mock.py (127 missing lines)
• test_wbemserverclass.py (60 missing lines)
• test_tupleparse.py (58 missing lines)
• test_cim_types.py (27 missing lines)
• test_nocasedict.py (PR Issue #1201 Converted test_nocasedict.py from unittest to pytest and changed test_function decorator #1237, 3 missing lines)
• test_valuemapping.py (2 missing lines)
• test_logging.py (PR Convert test_logging to use only pytest #1249, 1 missing lines)
• test_exceptions.py (1 missing lines)
• test_wbemcli.py(PR Fixes #1270: Implement pytest version of test_wbemcli.py #1399, issue # 1270, Merged. This item change from no moved to using pytest 9 Oct 2018 by KS)

[KSchopmeyer]

There is a log capture for pytest-logcapture. It might even be a bit more flexible in that it does not require complete compare. Another one is pytest-catchlog forked from the first. It appears thatcatchlog has been integrated into pytest core https://github.com/eisensheng/pytest-catchlog

[andy-maier]

We decided to move the remainder of testcases to the next release, and close this one for 0.13.0. A new issue will be created for the next release.

[andy-maier]

Issue #1414 has been created for the remaining migrations.