Import-Module AWS.Tools.Common very slow on EC2 (>20 sec, sometimes 1 minute)

[boernsen-development]

On all of our EC2 machines, we notice very slow import times of AWS.Tools.Common. We don't even know the reason and can only speculate as we don't know what's happening behind the scenes.

We don't face this issue with other modules.

Does anybody have ideas how we could solve that?

I suspected some web requests happening with timeouts as the machines have limited web access. Would that be possible? An Invoke-WebRequest on that same EC2 takes a similar amount of time before it times out.

Console output and measurements (all done in a freshly opened console):

PS C:\Windows\System32> $PSVersionTable

Name                           Value
----                           -----
PSVersion                      7.5.4
PSEdition                      Core
GitCommitId                    7.5.4
OS                             Microsoft Windows 10.0.20348
Platform                       Win32NT
PSCompatibleVersions           {1.0, 2.0, 3.0, 4.0…}
PSRemotingProtocolVersion      2.3
SerializationVersion           1.1.0.1
WSManStackVersion              3.0

PS C:\Windows\System32> Get-Module -Name AWS* -ListAvailable | Format-Table -Property Name,Version,Path -AutoSize -Wrap

Name                     Version Path
----                     ------- ----
AWS.Tools.Common         5.0.103 C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWS.Tools.Common.psd1
AWS.Tools.EC2            4.1.691 C:\Program Files\PowerShell\Modules\AWS.Tools.EC2\4.1.691\AWS.Tools.EC2.psd1
AWS.Tools.RDS            4.1.691 C:\Program Files\PowerShell\Modules\AWS.Tools.RDS\4.1.691\AWS.Tools.RDS.psd1
AWS.Tools.S3             4.1.691 C:\Program Files\PowerShell\Modules\AWS.Tools.S3\4.1.691\AWS.Tools.S3.psd1
AWS.Tools.SecretsManager 5.0.103 C:\Program Files\PowerShell\Modules\AWS.Tools.SecretsManager\5.0.103\AWS.Tools.SecretsManager.psd1

PS C:\Windows\System32> Measure-Command { Import-Module -Name PowerShellGet }

Days              : 0
Hours             : 0
Minutes           : 0
Seconds           : 1
Milliseconds      : 218
Ticks             : 12187312
TotalDays         : 1.41056851851852E-05
TotalHours        : 0.000338536444444444
TotalMinutes      : 0.0203121866666667
TotalSeconds      : 1.2187312
TotalMilliseconds : 1218.7312

PS C:\Windows\System32> Measure-Command { Import-Module -Name AWS.Tools.Common -Verbose }
VERBOSE: Loading module from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWS.Tools.Common.psd1'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWSSDK.Core.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWSSDK.SecurityToken.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\aws-crt.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\aws-crt-auth.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\aws-crt-http.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\aws-crt-checksums.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWSSDK.Extensions.CrtIntegration.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWSSDK.Extensions.CborProtocol.dll'.
VERBOSE: Loading 'Assembly' from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\System.Formats.Cbor.dll'.
VERBOSE: Populating RepositorySourceLocation property for module AWS.Tools.Common.
VERBOSE: Loading module from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\ImportGuard.ps1'.
VERBOSE: Dot-sourcing the script file 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\ImportGuard.ps1'.
WARNING: You have mismatched versions of the AWS.Tools modules. You can run 'Install-Module AWS.Tools.Installer ; Update-AWSToolsModule' to synchronize the versions of all installed AWS.Tools modules.
VERBOSE: Loading module from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWS.Tools.Common.Completers.psm1'.
VERBOSE: Exporting function '_awsArgumentCompleterRegistration'.
VERBOSE: Importing function '_awsArgumentCompleterRegistration'.
VERBOSE: Loading module from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWS.Tools.Common.Aliases.psm1'.
VERBOSE: Importing alias 'Clear-AWSCredentials'.
VERBOSE: Importing alias 'Clear-AWSDefaults'.
VERBOSE: Importing alias 'Get-AWSCredentials'.
VERBOSE: Importing alias 'Initialize-AWSDefaults'.
VERBOSE: Importing alias 'New-AWSCredentials'.
VERBOSE: Importing alias 'Set-AWSCredentials'.
VERBOSE: Loading module from path 'C:\Program Files\PowerShell\Modules\AWS.Tools.Common\5.0.103\AWS.Tools.Common.dll'.
VERBOSE: Exporting cmdlet 'Invoke-AWSLogin'.
VERBOSE: Exporting cmdlet 'Invoke-AWSLogout'.
VERBOSE: Exporting cmdlet 'Initialize-AWSDefaultConfiguration'.
VERBOSE: Exporting cmdlet 'Clear-AWSDefaultConfiguration'.
VERBOSE: Exporting cmdlet 'Get-AWSPowerShellVersion'.
VERBOSE: Exporting cmdlet 'Set-AWSSensitiveDataConfiguration'.
VERBOSE: Exporting cmdlet 'Get-AWSSensitiveDataConfiguration'.
VERBOSE: Exporting cmdlet 'Set-AWSAutoIterationMode'.
VERBOSE: Exporting cmdlet 'Get-AWSAutoIterationMode'.
VERBOSE: Exporting cmdlet 'New-AWSCredential'.
VERBOSE: Exporting cmdlet 'Set-AWSCredential'.
VERBOSE: Exporting cmdlet 'Clear-AWSCredential'.
VERBOSE: Exporting cmdlet 'Get-AWSCredential'.
VERBOSE: Exporting cmdlet 'Set-AWSSamlEndpoint'.
VERBOSE: Exporting cmdlet 'Set-AWSSamlRoleProfile'.
VERBOSE: Exporting cmdlet 'Get-AWSService'.
VERBOSE: Exporting cmdlet 'Get-AWSCmdletName'.
VERBOSE: Exporting cmdlet 'Add-AWSLoggingListener'.
VERBOSE: Exporting cmdlet 'Remove-AWSLoggingListener'.
VERBOSE: Exporting cmdlet 'Set-AWSResponseLogging'.
VERBOSE: Exporting cmdlet 'Enable-AWSMetricsLogging'.
VERBOSE: Exporting cmdlet 'Disable-AWSMetricsLogging'.
VERBOSE: Exporting cmdlet 'Set-AWSProxy'.
VERBOSE: Exporting cmdlet 'Clear-AWSProxy'.
VERBOSE: Exporting cmdlet 'Get-AWSPublicIpAddressRange'.
VERBOSE: Exporting cmdlet 'Set-DefaultAWSRegion'.
VERBOSE: Exporting cmdlet 'Clear-DefaultAWSRegion'.
VERBOSE: Exporting cmdlet 'Get-DefaultAWSRegion'.
VERBOSE: Exporting cmdlet 'Get-AWSRegion'.
VERBOSE: Exporting cmdlet 'Remove-AWSCredentialProfile'.
VERBOSE: Exporting cmdlet 'Invoke-AWSSSOLogin'.
VERBOSE: Exporting cmdlet 'Initialize-AWSSSOConfiguration'.
VERBOSE: Exporting cmdlet 'Set-AWSSSOSessionConfiguration'.
VERBOSE: Exporting cmdlet 'Invoke-AWSSSOLogout'.
VERBOSE: Exporting alias 'Clear-AWSCredentials'.
VERBOSE: Exporting alias 'Clear-AWSDefaults'.
VERBOSE: Exporting alias 'Get-AWSCredentials'.
VERBOSE: Exporting alias 'Initialize-AWSDefaults'.
VERBOSE: Exporting alias 'New-AWSCredentials'.
VERBOSE: Exporting alias 'Set-AWSCredentials'.
VERBOSE: Importing cmdlet 'Add-AWSLoggingListener'.
VERBOSE: Importing cmdlet 'Clear-AWSCredential'.
VERBOSE: Importing cmdlet 'Clear-AWSDefaultConfiguration'.
VERBOSE: Importing cmdlet 'Clear-AWSProxy'.
VERBOSE: Importing cmdlet 'Clear-DefaultAWSRegion'.
VERBOSE: Importing cmdlet 'Disable-AWSMetricsLogging'.
VERBOSE: Importing cmdlet 'Enable-AWSMetricsLogging'.
VERBOSE: Importing cmdlet 'Get-AWSAutoIterationMode'.
VERBOSE: Importing cmdlet 'Get-AWSCmdletName'.
VERBOSE: Importing cmdlet 'Get-AWSCredential'.
VERBOSE: Importing cmdlet 'Get-AWSPowerShellVersion'.
VERBOSE: Importing cmdlet 'Get-AWSPublicIpAddressRange'.
VERBOSE: Importing cmdlet 'Get-AWSRegion'.
VERBOSE: Importing cmdlet 'Get-AWSSensitiveDataConfiguration'.
VERBOSE: Importing cmdlet 'Get-AWSService'.
VERBOSE: Importing cmdlet 'Get-DefaultAWSRegion'.
VERBOSE: Importing cmdlet 'Initialize-AWSDefaultConfiguration'.
VERBOSE: Importing cmdlet 'Initialize-AWSSSOConfiguration'.
VERBOSE: Importing cmdlet 'Invoke-AWSLogin'.
VERBOSE: Importing cmdlet 'Invoke-AWSLogout'.
VERBOSE: Importing cmdlet 'Invoke-AWSSSOLogin'.
VERBOSE: Importing cmdlet 'Invoke-AWSSSOLogout'.
VERBOSE: Importing cmdlet 'New-AWSCredential'.
VERBOSE: Importing cmdlet 'Remove-AWSCredentialProfile'.
VERBOSE: Importing cmdlet 'Remove-AWSLoggingListener'.
VERBOSE: Importing cmdlet 'Set-AWSAutoIterationMode'.
VERBOSE: Importing cmdlet 'Set-AWSCredential'.
VERBOSE: Importing cmdlet 'Set-AWSProxy'.
VERBOSE: Importing cmdlet 'Set-AWSResponseLogging'.
VERBOSE: Importing cmdlet 'Set-AWSSamlEndpoint'.
VERBOSE: Importing cmdlet 'Set-AWSSamlRoleProfile'.
VERBOSE: Importing cmdlet 'Set-AWSSensitiveDataConfiguration'.
VERBOSE: Importing cmdlet 'Set-AWSSSOSessionConfiguration'.
VERBOSE: Importing cmdlet 'Set-DefaultAWSRegion'.
VERBOSE: Importing alias 'Clear-AWSCredentials'.
VERBOSE: Importing alias 'Clear-AWSDefaults'.
VERBOSE: Importing alias 'Get-AWSCredentials'.
VERBOSE: Importing alias 'Initialize-AWSDefaults'.
VERBOSE: Importing alias 'New-AWSCredentials'.
VERBOSE: Importing alias 'Set-AWSCredentials'.

Days              : 0
Hours             : 0
Minutes           : 0
Seconds           : 22
Milliseconds      : 373
Ticks             : 223739822
TotalDays         : 0.000258958127314815
TotalHours        : 0.00621499505555556
TotalMinutes      : 0.372899703333333
TotalSeconds      : 22.3739822
TotalMilliseconds : 22373.9822

PS C:\Windows\System32> Measure-Command { try { Invoke-WebRequest -Uri "www.google.com" } catch {} }

Days              : 0
Hours             : 0
Minutes           : 0
Seconds           : 21
Milliseconds      : 103
Ticks             : 211035416
TotalDays         : 0.000244253953703704
TotalHours        : 0.00586209488888889
TotalMinutes      : 0.351725693333333
TotalSeconds      : 21.1035416
TotalMilliseconds : 21103.5416

[boernsen-development]

My suspicion is kind of confirmed. By monitoring the resource monitor for TCP connections while applying the import, I saw a few addresses. When I blocked some of them via Windows' firewall, the import suddenly took less than a second.

However, blocking some random IPs I got from a general resource monitor seems like a bad idea as I don't even know whether they actually get contacted by the import.

I will open an issue.

[boernsen-development]

#410