MFTF: Lack of information on API failure (eg. <createEntity>)

[lbajsarowicz]

Preconditions

1. Test that is calling Magento API (eg. AdminVerifyCustomerAddressStateContainValuesOnceTest)

Steps to reproduce

1. Create required Customer Attribute
2. Try to run execute any test that creates Customer

Expected result

1. Test fails with information about error during API Call.

Actual result

1. 
2. 

[lbajsarowicz]

My findings: MFTF uses incorrectly the PHPUnit hooks. When _before hook fails, the failure is not being reported. Even then - _after hook is being called.

I'll design the architectural change to address the issue and avoid using hooks, just to let perform rollback of created nodes.

[jilu1]

@lbajsarowicz Thank you for reporting this issue!
Have you tested in MFTF release 2.5.4? I think we have a bug fix for a similar issue.

[lbajsarowicz]

I tried with the latest 2.4-develop setup of Magento and latest develop branch of MFTF.

[lbajsarowicz]

I've made the first step - Save Request object even if API call failed.

[soumyau]

Created JIRA ticket to process this PR: https://jira.corp.magento.com/browse/MQE-2065

[jilu1]

This feature has been implemented and delivered