aws amplify list-apps returns InvalidSignatureException

[pstaylor-patrick]

Confirm by changing [ ] to [x] below to ensure that it's a bug:

• I've gone through the User Guide and the API reference
• I've searched for previous similar issues and didn't find any solution

Describe the bug
I'm experiencing an AWS Amplify outage in the aws cli, the amplify cli, and the aws console. I started to see this behavior yesterday afternoon (Wed Mar 30, 2022 around 2 pm Central).

As far as the aws cli is concerned, this is what I see when running aws amplify list-apps:

An error occurred (InvalidSignatureException) when calling the ListApps operation: Signature expired: 20220331T093848Z is now earlier than 20220331T094912Z (20220331T095412Z - 5 min.)

And this is what I see when running amplify init to realign my local files with the preexisting server-side resources:

Could not initialize 'kngdmprod': The difference between the request time and the current time is too large.

And this is what I see in the AWS Amplify Console:

List apps call failed
Network Failure

SDK version number
aws-cli/2.4.7 Python/3.8.8 Darwin/21.4.0 exe/x86_64 prompt/off
amplify-cli v7.6.26

Platform/OS/Hardware/Device
2020 MacBook Pro (Apple M1) running macOS Monterey v12.3 and Node v16.13.1

To Reproduce (observed behavior)
You can either:

1. aws amplify list-apps
2. amplify init
3. https://us-east-1.console.aws.amazon.com/amplify/home?region=us-east-1#/

Expected behavior
I expect to see and have access to my amplify apps.

Logs/output

2022-03-31 04:48:28,773 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.4.7 Python/3.8.8 Darwin/21.4.0 exe/x86_64
2022-03-31 04:48:28,773 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['amplify', 'list-apps', '--debug']
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_s3 at 0x7f8ff976f940>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_ddb at 0x7f8ff95ccf70>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.configure.configure.ConfigureCommand'>>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x7f8ff956f700>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x7f8ff9577700>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function alias_opsworks_cm at 0x7f8ff97823a0>
2022-03-31 04:48:28,783 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_history_commands at 0x7f8ff9613d30>
2022-03-31 04:48:28,784 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.devcommands.CLIDevCommand'>>
2022-03-31 04:48:28,784 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_waiters at 0x7f8ff977b5e0>
2022-03-31 04:48:28,784 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/awscli/data/cli.json
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_types at 0x7f8ff96c8820>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function no_sign_request at 0x7f8ff96c93a0>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_verify_ssl at 0x7f8ff96c9310>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_read_timeout at 0x7f8ff96c94c0>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_connect_timeout at 0x7f8ff96c9430>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <built-in method update of dict object at 0x7f8fd8042f40>
2022-03-31 04:48:28,786 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.4.7 Python/3.8.8 Darwin/21.4.0 exe/x86_64 prompt/off
2022-03-31 04:48:28,786 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['amplify', 'list-apps', '--debug']
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_timestamp_parser at 0x7f8ff976ff70>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function register_uri_param_handler at 0x7f8ff9313e50>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_binary_formatter at 0x7f8ff97d94c0>
2022-03-31 04:48:28,786 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function no_pager_handler at 0x7f8ff9311310>
2022-03-31 04:48:28,787 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_assume_role_provider_cache at 0x7f8ff9393820>
2022-03-31 04:48:28,788 - MainThread - botocore.utils - DEBUG - IMDS ENDPOINT: http://169.254.169.254/
2022-03-31 04:48:28,794 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function attach_history_handler at 0x7f8ff9613c10>
2022-03-31 04:48:28,794 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_json_file_cache at 0x7f8ff95c6e50>
2022-03-31 04:48:28,804 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/awscli/botocore/data/amplify/2017-07-25/service-2.json
2022-03-31 04:48:28,809 - MainThread - botocore.hooks - DEBUG - Event building-command-table.amplify: calling handler <function add_waiters at 0x7f8ff977b5e0>
2022-03-31 04:48:28,819 - MainThread - awscli.clidriver - DEBUG - OrderedDict([('next-token', <awscli.arguments.CLIArgument object at 0x7f8fe83344f0>), ('max-results', <awscli.arguments.CLIArgument object at 0x7f8fe8334520>)])
2022-03-31 04:48:28,819 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.amplify.list-apps: calling handler <function add_streaming_output_arg at 0x7f8ff9776550>
2022-03-31 04:48:28,819 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.amplify.list-apps: calling handler <function add_cli_input_json at 0x7f8ff93990d0>
2022-03-31 04:48:28,820 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.amplify.list-apps: calling handler <function add_cli_input_yaml at 0x7f8ff93993a0>
2022-03-31 04:48:28,820 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.amplify.list-apps: calling handler <function unify_paging_params at 0x7f8ff95ce5e0>
2022-03-31 04:48:28,830 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/awscli/botocore/data/amplify/2017-07-25/paginators-1.json
2022-03-31 04:48:28,830 - MainThread - awscli.customizations.paginate - DEBUG - Modifying paging parameters for operation: ListApps
2022-03-31 04:48:28,830 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.amplify.list-apps: calling handler <function add_generate_skeleton at 0x7f8ff96b9dc0>
2022-03-31 04:48:28,830 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.amplify.list-apps: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputJSONArgument object at 0x7f8fe83343d0>>
2022-03-31 04:48:28,830 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.amplify.list-apps: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x7f8fe83345e0>>
2022-03-31 04:48:28,830 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.amplify.list-apps: calling handler <bound method GenerateCliSkeletonArgument.override_required_args of <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x7f8fe8334a00>>
2022-03-31 04:48:28,831 - MainThread - botocore.hooks - DEBUG - Event operation-args-parsed.amplify.list-apps: calling handler functools.partial(<function check_should_enable_pagination at 0x7f8ff95ce700>, ['next-token', 'max-results'], {}, OrderedDict([('next-token', <awscli.arguments.CLIArgument object at 0x7f8fe83344f0>), ('max-results', <awscli.arguments.CLIArgument object at 0x7f8fe8334520>), ('cli-input-json', <awscli.customizations.cliinput.CliInputJSONArgument object at 0x7f8fe83343d0>), ('cli-input-yaml', <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x7f8fe83345e0>), ('starting-token', <awscli.customizations.paginate.PageArgument object at 0x7f8fe8334820>), ('page-size', <awscli.customizations.paginate.PageArgument object at 0x7f8fe8334880>), ('max-items', <awscli.customizations.paginate.PageArgument object at 0x7f8fe8334730>), ('generate-cli-skeleton', <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x7f8fe8334a00>)]))
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.next-token: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.max-results: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.cli-input-json: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.cli-input-yaml: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.starting-token: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.page-size: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.max-items: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.amplify.list-apps.generate-cli-skeleton: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f8fd8080220>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event calling-command.amplify.list-apps: calling handler <bound method CliInputArgument.add_to_call_parameters of <awscli.customizations.cliinput.CliInputJSONArgument object at 0x7f8fe83343d0>>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event calling-command.amplify.list-apps: calling handler <bound method CliInputArgument.add_to_call_parameters of <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x7f8fe83345e0>>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event calling-command.amplify.list-apps: calling handler <bound method GenerateCliSkeletonArgument.generate_skeleton of <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x7f8fe8334a00>>
2022-03-31 04:48:28,832 - MainThread - botocore.hooks - DEBUG - Event calling-command.amplify.list-apps: calling handler functools.partial(<function check_should_enable_pagination_call_parameters at 0x7f8ff95ceaf0>, ['nextToken', 'maxResults'])
2022-03-31 04:48:28,832 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: env
2022-03-31 04:48:28,832 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: assume-role
2022-03-31 04:48:28,832 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: assume-role-with-web-identity
2022-03-31 04:48:28,832 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: sso
2022-03-31 04:48:28,832 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: shared-credentials-file
2022-03-31 04:48:28,833 - MainThread - botocore.credentials - INFO - Found credentials in shared credentials file: ~/.aws/credentials
2022-03-31 04:48:28,833 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/awscli/botocore/data/endpoints.json
2022-03-31 04:48:28,842 - MainThread - botocore.hooks - DEBUG - Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f8ff8be84c0>
2022-03-31 04:48:28,843 - MainThread - botocore.hooks - DEBUG - Event creating-client-class.amplify: calling handler <function add_generate_presigned_url at 0x7f8ff8b9b9d0>
2022-03-31 04:48:28,846 - MainThread - botocore.endpoint - DEBUG - Setting amplify timeout as (60, 60)
2022-03-31 04:48:28,847 - MainThread - botocore.hooks - DEBUG - Event provide-client-params.amplify.ListApps: calling handler <function base64_decode_input_blobs at 0x7f8ff97d9c10>
2022-03-31 04:48:28,847 - MainThread - botocore.hooks - DEBUG - Event before-parameter-build.amplify.ListApps: calling handler <function generate_idempotent_uuid at 0x7f8ff8c074c0>
2022-03-31 04:48:28,847 - MainThread - botocore.hooks - DEBUG - Event before-call.amplify.ListApps: calling handler <function inject_api_version_header_if_needed at 0x7f8ff8c0bd30>
2022-03-31 04:48:28,847 - MainThread - botocore.endpoint - DEBUG - Making request for OperationModel(name=ListApps) with params: {'url_path': '/apps', 'query_string': {}, 'method': 'GET', 'headers': {'User-Agent': 'aws-cli/2.4.7 Python/3.8.8 Darwin/21.4.0 exe/x86_64 prompt/off command/amplify.list-apps'}, 'body': b'', 'url': 'https://amplify.us-east-1.amazonaws.com/apps', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f8ff9c0da60>, 'has_streaming_input': False, 'auth_type': None}}
2022-03-31 04:48:28,848 - MainThread - botocore.hooks - DEBUG - Event request-created.amplify.ListApps: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f8ff9c0db20>>
2022-03-31 04:48:28,848 - MainThread - botocore.hooks - DEBUG - Event choose-signer.amplify.ListApps: calling handler <function set_operation_specific_signer at 0x7f8ff8c073a0>
2022-03-31 04:48:28,848 - MainThread - botocore.auth - DEBUG - Calculating signature using v4 auth.
2022-03-31 04:48:28,848 - MainThread - botocore.auth - DEBUG - CanonicalRequest:
GET
/apps

host:amplify.us-east-1.amazonaws.com
x-amz-date:20220331T094828Z

host;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2022-03-31 04:48:28,848 - MainThread - botocore.auth - DEBUG - StringToSign:
AWS4-HMAC-SHA256
20220331T094828Z
20220331/us-east-1/amplify/aws4_request
42dba3b545bf0ad6b80c313f2c8b638d01807e40b4d9cd549a3c790b7566e9a8
2022-03-31 04:48:28,848 - MainThread - botocore.auth - DEBUG - Signature:
4a757995942b6909436c334ee766fed3e41620de0d083ab6a61466ebad727f58
2022-03-31 04:48:28,848 - MainThread - botocore.endpoint - DEBUG - Sending http request: <AWSPreparedRequest stream_output=False, method=GET, url=https://amplify.us-east-1.amazonaws.com/apps, headers={'User-Agent': b'aws-cli/2.4.7 Python/3.8.8 Darwin/21.4.0 exe/x86_64 prompt/off command/amplify.list-apps', 'X-Amz-Date': b'20220331T094828Z', 'Authorization': b'AWS4-HMAC-SHA256 Credential=AKIAZQBKDHSGQFA2BETY/20220331/us-east-1/amplify/aws4_request, SignedHeaders=host;x-amz-date, Signature=4a757995942b6909436c334ee766fed3e41620de0d083ab6a61466ebad727f58'}>
2022-03-31 04:48:28,849 - MainThread - botocore.httpsession - DEBUG - Certificate path: /usr/local/aws-cli/awscli/botocore/cacert.pem
2022-03-31 04:48:28,849 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): amplify.us-east-1.amazonaws.com:443
2022-03-31 04:48:29,018 - MainThread - urllib3.connectionpool - DEBUG - https://amplify.us-east-1.amazonaws.com:443 "GET /apps HTTP/1.1" 403 114
2022-03-31 04:48:29,018 - MainThread - botocore.parsers - DEBUG - Response headers: {'Content-Type': 'application/json', 'Content-Length': '114', 'Connection': 'keep-alive', 'Date': 'Thu, 31 Mar 2022 10:03:52 GMT', 'x-amzn-RequestId': '16565be6-62a0-40c2-94ab-3a07f7f4c343', 'x-amzn-ErrorType': 'InvalidSignatureException', 'x-amz-apigw-id': 'P2BlUFn7IAMFgFA=', 'X-Amzn-Trace-Id': 'Root=1-62457c88-118625cf092a51d318c5ce6b', 'X-Cache': 'Error from cloudfront', 'Via': '1.1 8b047a56cedc9f5e8593136caff4a83e.cloudfront.net (CloudFront)', 'X-Amz-Cf-Pop': 'ATL52-C1', 'X-Amz-Cf-Id': 'ENUyfDfA6qzHOq0c6E1OKdRnJg1ia8PqaIG5c2WDsvqiRRgFSpU6-g=='}
2022-03-31 04:48:29,018 - MainThread - botocore.parsers - DEBUG - Response body:
b'{"message":"Signature expired: 20220331T094828Z is now earlier than 20220331T095852Z (20220331T100352Z - 5 min.)"}'
2022-03-31 04:48:29,020 - MainThread - botocore.hooks - DEBUG - Event needs-retry.amplify.ListApps: calling handler <bound method RetryHandler.needs_retry of <botocore.retries.standard.RetryHandler object at 0x7f8ff9c4f5b0>>
2022-03-31 04:48:29,020 - MainThread - botocore.retries.standard - DEBUG - Not retrying request.
2022-03-31 04:48:29,020 - MainThread - botocore.hooks - DEBUG - Event after-call.amplify.ListApps: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x7f8ff9c4f130>>
2022-03-31 04:48:29,020 - MainThread - awscli.clidriver - DEBUG - Exception caught in main()
Traceback (most recent call last):
  File "awscli/clidriver.py", line 459, in main
  File "awscli/clidriver.py", line 594, in __call__
  File "awscli/clidriver.py", line 770, in __call__
  File "awscli/clidriver.py", line 903, in invoke
  File "awscli/clidriver.py", line 925, in _display_response
  File "awscli/formatter.py", line 82, in __call__
  File "awscli/botocore/paginate.py", line 449, in build_full_result
  File "awscli/botocore/paginate.py", line 255, in __iter__
  File "awscli/botocore/paginate.py", line 332, in _make_request
  File "awscli/botocore/client.py", line 281, in _api_call
  File "awscli/botocore/client.py", line 609, in _make_api_call
botocore.exceptions.ClientError: An error occurred (InvalidSignatureException) when calling the ListApps operation: Signature expired: 20220331T094828Z is now earlier than 20220331T095852Z (20220331T100352Z - 5 min.)

An error occurred (InvalidSignatureException) when calling the ListApps operation: Signature expired: 20220331T094828Z is now earlier than 20220331T095852Z (20220331T100352Z - 5 min.)
ptaylor@kngdm-ptaylor-macbook-pro dialogos-app % 

[pstaylor-patrick]

cross-posted at aws-amplify/amplify-cli#10103

[pstaylor-patrick]

✅ I just resolved this issue on my own.

⏱ I discovered that my laptop time was off by more than 10 minutes.

👀 I realized this after comparing to the time on my MacBook with the times on my iPhone, wristwatch, and desk clock.

🤷‍♂️ I don't know how the laptop time originally drifted from reality, but all of the related AWS issues were immediately resolved after I reset my time clock.

🔧 I just went into the macOS System Preferences app and toggled the automatic time detection off and back on again to reset the time.

[tim-finnigan]

Thanks @pstaylor-patrick for letting us know! Glad you were able to fix the issue.

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.