[web app] Test failure

[qwordy]

az feedback auto-generates most of the information requested below, as of CLI version 2.0.62

Describe the bug

FAILED src\azure-cli\azure\cli\command_modules\appservice\tests\latest\test_webapp_commands.py::WebappImplictIdentityTest::test_webapp_assign_user_identity
FAILED src\azure-cli\azure\cli\command_modules\appservice\tests\latest\test_webapp_commands.py::WebappImplictIdentityTest::test_webapp_remove_identity
FAILED src\azure-cli\azure\cli\command_modules\appservice\tests\latest\test_webapp_commands.py::WebappWindowsContainerBasicE2ETest::test_webapp_create_with_msi

These three test cases cannot pass.
Open this issue to track it.

Error

knack.util.CLIError: Name clitest.rg3hdo26ksbqcrbem7cwwqll4z2p5pyv26gwhroglddmnbyz5v4prss6snz4laex5aq is not valid.

To Reproduce

Expected behavior

Environment summary

Additional context

[ghost]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @antcp, @AzureAppServiceCLI.

[yungezz]

hi @panchagnula could you pls help to look at the issue? Currently Azure CLI CI blocked by the test failure. one example failure: https://dev.azure.com/azure-sdk/public/_build/results?buildId=479772&view=logs&j=771f6cdf-8d98-5d9b-2fb9-d3a6e9554788&t=0a182f1d-9946-580d-467e-4d4ebd6af32d&l=6534

[panchagnula]

@cxznmhdcxz looks like the new tests you added are failing in CLI? can you take a look please and fix the test or add a new recording? Thanks!

[cxznmhdcxz]

Three test methods that raises:

1. test_webapp_assign_user_identity
2. test_webapp_remove_identity
3. test_webapp_create_with_msi

For the first and second one, I could reproduce the same error in live mode (different random name though of course), and could pass live/record mode after a small fix: @ResourceGroupPreparer(name_prefix="cli", random_name_length=6)

However for the third one, I could pass either live/record mode.
Still looking into it. But any information or step to reproduce a same error would be appreciated.

[panchagnula]

@calvinsID can you check if on the latest Dev you are able to repro these tests failing as well?

[calvinsID]

I got the same results as @cxznmhdcxz.

1. test_webapp_assign_user_identity passes live with change: @ResourceGroupPreparer(name_prefix="clitest", random_name_length=24)
2. test_webapp_remove_identity passes live with the change: @ResourceGroupPreparer(name_prefix="clitest", random_name_length=24)
3. test_webapp_create_with_msi - unable to repro error, it passes live for me

[colbylwilliams]

I started seeing this error in our extension's CI when attempting to deploy an ARM template since the last release (2.10.1).

[btardif]

This is fixed