Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM #22403

vivlingaiah · 2023-07-25T01:10:06Z

Description

-Get-AzVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM

Looks like this is a regression. This used to work

Issue script & Debug output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

PS C:\> Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivVMSS -InstanceId 0
Get-AzVmssVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivV ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVmssVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmssVMRunCommand

Environment data

PS C:\> $PSVersionTable

Name                           Value
----                           -----
PSVersion                      5.1.22000.2003
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22000.2003
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1

Module versions

10.0.1

Error output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

PS C:\> Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivVMSS -InstanceId 0
Get-AzVmssVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivV ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVmssVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmssVMRunCommand

ghost · 2023-07-25T01:26:28Z

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Drewm3, @TravisCragg-MSFT, @nikhilpatel909, @sandeepraichura, @hilaryw29, @GabstaMSFT.

Issue Details

Description

-Get-AzVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM

Looks like this is a regression. This used to work

Issue script & Debug output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

Environment data

PS C:\> $PSVersionTable

Name                           Value
----                           -----
PSVersion                      5.1.22000.2003
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22000.2003
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1

Module versions

10.0.1

Error output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

Author:	vivlingaiah
Assignees:	-
Labels:	`Compute - VM`, `Service Attention`, `bug`
Milestone:	-

ghost · 2023-07-27T01:45:40Z

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @TravisCragg-MSFT, @sandeepraichura.

Issue Details

Description

-Get-AzVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM

Looks like this is a regression. This used to work

Issue script & Debug output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

PS C:\> Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivVMSS -InstanceId 0
Get-AzVmssVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivV ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVmssVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmssVMRunCommand

Environment data

PS C:\> $PSVersionTable

Name                           Value
----                           -----
PSVersion                      5.1.22000.2003
PSEdition                      Desktop
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0...}
BuildVersion                   10.0.22000.2003
CLRVersion                     4.0.30319.42000
WSManStackVersion              3.0
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1

Module versions

10.0.1

Error output

PS C:\> Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
Get-AzVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVMRunCommand -ResourceGroupName VivRG0 -VMName VivL
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand

PS C:\> Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivVMSS -InstanceId 0
Get-AzVmssVMRunCommand : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type
'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'.
At line:1 char:1
+ Get-AzVmssVMRunCommand -ResourceGroupName VivRG0 -VMScaleSetName VivV ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : CloseError: (:) [Get-AzVmssVMRunCommand], InvalidCastException
    + FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmssVMRunCommand

Author:	vivlingaiah
Assignees:	-
Labels:	`Compute - VM`, `Compute - VMSS`, `Service Attention`, `bug`
Milestone:	-

Chris-Sanford · 2023-07-27T17:24:59Z

Terminating existing PowerShell sessions and starting a new PowerShell process seems to be an effective workaround for this bug. Tested in the latest PowerShell Core and Az Module versions.

TravisCragg-MSFT · 2023-07-27T19:12:58Z

assigning to @nikhilpatel909

grizzlytheodore · 2023-07-31T19:01:59Z

Hello from Compute PS team. We will address bug for September release. Thank you for submitting this bug item.

nikhilpatel909 · 2023-10-26T19:12:38Z

@grizzlytheodore was this bug fixed?

GabstaMSFT · 2024-03-14T19:43:55Z

@grizzlytheodore checking if issue is now resolved for you?

grizzlytheodore · 2024-03-18T21:47:50Z

@nikhilpatel909 @GabstaMSFT hello. this bug was resolved so I will close this issue

RobertMochnacky · 2024-04-03T07:58:04Z

Good morning,

I'm still experiencing the same issue to get the list of VM AzVMRunCommands without specifying RunCommandName parameter when the code runs as part of the powershell function in a function app. It works on occasional basis but not able to identify a pattern when it works and when not. The most of the time it fails with the following message:

Code:

param($Timer)

Set-AzContext -SubscriptionId $env:APPSETTING_SubscriptionId
$timeout = 30
$VMs = Get-AzVM -Status | Where-Object {$_.Tags['solution'] -eq 'SolutionName' -and $_.PowerState -eq "VM running"} # Get All Running VMs in the selected subscription which match solution:SolutionName Tag
Start-Sleep 5

if ($VMs -eq $null) {
    Write-Error "No VMs have been found. Please check whether the proper tag solution:SolutionName is present on the workload(s)"
    exit
}
foreach ($VM in $VMs) {
    Write-Information "Loading existing AzVMRunCommands for $($VM.Name)..."
    $existingCMDs = Get-AzVMRunCommand -ResourceGroupName $($VM.ResourceGroupName) -VMName $($VM.Name)
    if ($?) {
        Write-Information "Existing AzVMRunCommands for $($VM.Name) loaded sucessfuly."
    }
    else {
        Write-Error "Loading AzVMRunCommands for $($VM.Name) failed. Error: $Error[0].Exception.Message"
        exit
    }
}

===========================================================================================================================================================================

Output:

ERROR: Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type 'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'. Exception : Type : System.InvalidCastException TargetSite : Name : ChkCast_Helper DeclaringType : System.Runtime.CompilerServices.CastHelpers, System.Private.CoreLib, Version=6.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e MemberType : Method Module : System.Private.CoreLib.dll Message : Unable to cast object of type 'Microsoft.Azure.Management.Compute.Models.PSVirtualMachineRunCommand' to type 'Microsoft.Azure.Commands.Compute.Automation.Models.PSVirtualMachineRunCommandList'. Source : System.Private.CoreLib HResult : -2147467262 StackTrace : at lambda_method6013(Closure , VirtualMachineRunCommand , PSVirtualMachineRunCommandList , ResolutionContext ) at AutoMapper.Mapper.AutoMapper.IMapper.Map[TSource,TDestination](TSource source) at Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand.<ExecuteCmdlet>b__16_0() at Microsoft.Azure.Commands.Compute.ComputeClientBaseCmdlet.ExecuteClientAction(Action action) at Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand.ExecuteCmdlet() at Microsoft.WindowsAzure.Commands.Utilities.Common.CmdletExtensions.<>c__31.b__3_0(T c) at Microsoft.WindowsAzure.Commands.Utilities.Common.CmdletExtensions.ExecuteSynchronouslyOrAsJob[T](T cmdlet, Action`1 executor) at Microsoft.WindowsAzure.Commands.Utilities.Common.CmdletExtensions.ExecuteSynchronouslyOrAsJob[T](T cmdlet) at Microsoft.WindowsAzure.Commands.Utilities.Common.AzurePSCmdlet.ProcessRecord() CategoryInfo : CloseError: (:) [Get-AzVMRunCommand], InvalidCastException FullyQualifiedErrorId : Microsoft.Azure.Commands.Compute.Automation.GetAzureVmRunCommand InvocationInfo : MyCommand : Get-AzVMRunCommand ScriptLineNumber : 18 OffsetInLine : 21 HistoryId : 1 ScriptName : C:\home\site\wwwroot\AzVmRunCommand_Cleanup\run.ps1 Line : $existingCMDs = Get-AzVMRunCommand -ResourceGroupName $($VM.ResourceGroupName) -VMName $($VM.Name) PositionMessage : At C:\home\site\wwwroot\AzVmRunCommand_Cleanup\run.ps1:18 char:21 + … stingCMDs = Get-AzVMRunCommand -ResourceGroupName $($VM.Resource … + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ PSScriptRoot : C:\home\site\wwwroot\AzVmRunCommand_Cleanup PSCommandPath : C:\home\site\wwwroot\AzVmRunCommand_Cleanup\run.ps1 InvocationName : Get-AzVMRunCommand CommandOrigin : Internal ScriptStackTrace : at , C:\home\site\wwwroot\AzVmRunCommand_Cleanup\run.ps1: line 18 PipelineIterationInfo :

`

Settings:

Function app settings:
PowerShell Core Version: 7.2
Platform: 32bit
Runtime version: ~4

Hosts.json:
{
"version": "2.0",
"managedDependency": {
"Enabled": true
},
"extensionBundle": {
"id": "Microsoft.Azure.Functions.ExtensionBundle",
"version": "[4.*, 5.0.0)"
}
}

requirements.psd1:
'Az' = '10.*'

Thank you in advance.

grizzlytheodore · 2024-04-03T15:50:46Z

I am able to retrieve a list of RunCommands:

grizzlytheodore · 2024-04-03T15:51:38Z

@RobertMochnacky, could you make sure you are running the latest version by running "update-module az" ?
then you will need to start a new powershell session to use the latest package

RobertMochnacky · 2024-04-05T08:25:13Z

Hello guys,
The command works well in the powershell session but the problem I reported occurs as part of the Powershell Function in a Function app.
I have also changed the module definition in the function app from 10.* to 11.* but still got the error mentioned earlier now and then.

grizzlytheodore · 2024-04-05T15:12:25Z

@nikhilpatel909 could we get the above issue routed to ps functions?

RobertMochnacky · 2024-04-11T07:09:38Z

Addition based on the recent findings:
I have two PowerShell Functions:

The function to find all VMs with as specific tag and Set the AzVMRunCommand for each VM, It waits 2 minutes or until the provisioning status of the Set-AzVMRunCommand is "Succeeded" then Remove AzVMRunCommand. This is schedule to run every 5 minutes. Each AzRUnCommand has its own name with start time tag in it. It sometimes happens that the removal of the command does not succeed and the AzVMRunCommand stays there. In order to avoid hitting the maximum nr. of AzVMRunCommand per VM (25) there is another function...
The function finds the AzVMRunCommands for each VM and checks the timestamp in the AzVMRunCommand name. If it is older than 30 minutes, the run command gets deleted by the function.

The problem I've described in the previous posts only happens when the 1st and 2nd function is in the same Function App. As soon as I move the 2nd Function to a separate function app it works all the time.

vivlingaiah added Compute bug This issue requires a change to an existing behavior in the product in order to be resolved. needs-triage This is a new issue that needs to be triaged to the appropriate team. labels Jul 25, 2023

ghost removed the needs-triage This is a new issue that needs to be triaged to the appropriate team. label Jul 25, 2023

wyunchi-ms added Compute - VM Service Attention This issue is responsible by Azure service team. and removed Compute labels Jul 25, 2023

vivlingaiah changed the title ~~Get-AzVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM~~ Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM Jul 25, 2023

wyunchi-ms added the Compute - VMSS label Jul 27, 2023

TravisCragg-MSFT assigned nikhilpatel909 Jul 27, 2023

grizzlytheodore mentioned this issue Aug 1, 2023

fix Get-AzVmRunCommand bug #22460

Merged

1 task

nikhilpatel909 assigned grizzlytheodore and unassigned nikhilpatel909 Aug 3, 2023

TravisCragg-MSFT assigned GabstaMSFT and grizzlytheodore and unassigned grizzlytheodore Mar 14, 2024

grizzlytheodore closed this as completed Mar 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM #22403

Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM #22403

vivlingaiah commented Jul 25, 2023 •

edited

ghost commented Jul 25, 2023

Description

Issue script & Debug output

Environment data

Module versions

Error output

ghost commented Jul 27, 2023

Description

Issue script & Debug output

Environment data

Module versions

Error output

Chris-Sanford commented Jul 27, 2023

TravisCragg-MSFT commented Jul 27, 2023

grizzlytheodore commented Jul 31, 2023

nikhilpatel909 commented Oct 26, 2023

GabstaMSFT commented Mar 14, 2024

grizzlytheodore commented Mar 18, 2024

RobertMochnacky commented Apr 3, 2024 •

edited

grizzlytheodore commented Apr 3, 2024

grizzlytheodore commented Apr 3, 2024

RobertMochnacky commented Apr 5, 2024

grizzlytheodore commented Apr 5, 2024

RobertMochnacky commented Apr 11, 2024

Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM #22403

Get-AzVMRunCommand and Get-AzVmssVMRunCommand without -RunCommandName parameter fails to return list of RunCommands on VM #22403

Comments

vivlingaiah commented Jul 25, 2023 • edited

Description

Issue script & Debug output

Environment data

Module versions

Error output

ghost commented Jul 25, 2023

Description

Issue script & Debug output

Environment data

Module versions

Error output

ghost commented Jul 27, 2023

Description

Issue script & Debug output

Environment data

Module versions

Error output

Chris-Sanford commented Jul 27, 2023

TravisCragg-MSFT commented Jul 27, 2023

grizzlytheodore commented Jul 31, 2023

nikhilpatel909 commented Oct 26, 2023

GabstaMSFT commented Mar 14, 2024

grizzlytheodore commented Mar 18, 2024

RobertMochnacky commented Apr 3, 2024 • edited

Code:

Output:

`

grizzlytheodore commented Apr 3, 2024

grizzlytheodore commented Apr 3, 2024

RobertMochnacky commented Apr 5, 2024

grizzlytheodore commented Apr 5, 2024

RobertMochnacky commented Apr 11, 2024

vivlingaiah commented Jul 25, 2023 •

edited

RobertMochnacky commented Apr 3, 2024 •

edited