Exchange Online Functional Testing

[schrolla]

💡 Summary

As part of Glacier release, to ensure that the tool's update is accurate, detailed functional testing has been planned. Each policy will be functionally tested to check that all pass/fail scenarios have been correctly processed by the tool using existing automated functional test plans.

This issue functionally tests each policy of Exchange Online product of ScubaGear tool. The main objective is to test Exchange Online policies and ensure that ScubaGear tool is providing the correct result for each possible configuration option.

Motivation and context

This functional testing ensures that ScubaGear results of pass/fail are accurate based on the latest version of the code.

Implementation notes

For each Exchange Online policy do the following:

• Configure the automated testing and run against each tenant type for which a variant test plan is present. Run the automated test plans (e.g. regular, g5, etc.) and note the results.
• For each test failure, investigate and note the cause of the failure and log any new issues needed to resolve

For details on how to use and execute the functional tests, please see #592 or reach out to the dev team via other channels.

Acceptance criteria

• All existing test plan variants for the product have been successfully run
• Test plan results have been reviewed and any issues resolved or reported as new issues

[buidav]

No issues with EXO. Have warning from outdated chrome driver but that doesn't affect the tests.

E5

G5

GCC HIGH

G3

[buidav]

Closing as completed. No issues found.