[Modules] Fix/Add purge during removal of machine learning workspace

[MariusStorhaug]

Fixes #3596

Description

• ML Removal
  • The ML Removal uses a REST API call that returns HTTP 202 (Accepted) which kicks of a deletion job and returns to the caller. This seems to leave the workspace with a chance of being removed during resource group deletion, causing the resource to not be purged while deleted, aka just soft-deleted. To handle this I added a wait'n'check loop that runs for upto 1 hour (240 checks x 15s break).
• Out of original scope:
  • Resource locks
    • Resource Locks are now handled before a resource is attempted to be removed/purged.
      • During some of my testing for fixing the ML workspace deletion, I found that when the deployment failed the locks were not detected. Reason unknown, but it never showed up on the list so I added this to detect such cases and remove them regardless.
    • Resource Lock removal code has a new home, a helper script Invoke-ResourceLockRemoval.
      • Does a wait'n'check (10 x 10) for regular resource lock deletion, increasing the chance of a successful deletion.
    • New script to get resource locks, as the default Remove-AzResourceLock does not handle LockId.
  • Script cleanup
    • Parameter casing updated in whole script
    • Remove unused parameters
    • Align wording in logs
    • Remove DevOpsLabs section as new default flow does lock removal before each special case is handled.

Before log:

This PR

Reran a deployment, where I went in to add some 'rogue' locks, result is as follows:

Can be seen on the pipeline linked below on the enc tests.

Pipeline references

Pipeline

Type of Change

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Update to documentation

Checklist

• I'm sure there are no other open Pull Requests for the same update/change
• My corresponding pipelines / checks run clean and green without any errors or warnings
• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation (readme)
• I did format my code

[MariusStorhaug]

The temp commit is to fix the privateEndpoint API version issues. This is just to show the functionality of the removal script changes and will be reverted as it is part of #3585.

[MariusStorhaug]

Still waiting: https://github.com/MariusStorhaug/ResourceModules/actions/workflows/ms.machinelearningservices.workspaces.yml

[MariusStorhaug]

Pipelines are not green, but failing for other reasons. Feel free to merge.