-
Notifications
You must be signed in to change notification settings - Fork 2.2k
chore: enable retry for e2e tests #14519
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
e0a8f78
54e9d65
5541b11
fe76a90
1118c3b
7cd55d5
0673205
3cf1d81
bd9b62a
463405b
3055969
f05ddb9
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -629,13 +629,15 @@ tests: | |
category: auth | ||
sample_name: [custom-auth] | ||
spec: custom-auth | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
- test_name: integ_next_auth_sign_in_with_sms_mfa | ||
desc: 'Resumable sign in with SMS MFA flow' | ||
framework: next | ||
category: auth | ||
sample_name: [mfa] | ||
spec: sign-in-resumable-mfa | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: resum-signin | ||
|
@@ -844,20 +846,23 @@ tests: | |
category: storage | ||
sample_name: [storage-gen2] | ||
spec: storage-gen2 | ||
retry_count: 10 | ||
browser: *minimal_browser_list | ||
- test_name: integ_react_storage_internal | ||
desc: 'React Storage Gen2 Internal APIs' | ||
framework: react | ||
category: storage | ||
sample_name: [storage-gen2-internal] | ||
spec: storage-gen2-internal | ||
retry_count: 10 | ||
browser: *minimal_browser_list | ||
- test_name: integ_next_storage | ||
desc: 'Next Storage Auth' | ||
framework: next | ||
category: storage | ||
sample_name: [storage-auth] | ||
spec: storage-client-server | ||
retry_count: 10 | ||
browser: [chrome] # firefox issues with secure cookies in cypress, manual testing works fine | ||
|
||
# INAPPMESSAGING | ||
|
@@ -920,6 +925,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: mfa-req-email | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: mfa-req-email | ||
|
@@ -929,6 +935,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: mfa-req-phone | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: mfa-req-phone | ||
|
@@ -938,6 +945,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: mfa-opt-email | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: mfa-opt-email | ||
|
@@ -947,6 +955,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: mfa-opt-phone | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: mfa-opt-phone | ||
|
@@ -956,6 +965,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: mfa-setup | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: mfa-setup | ||
|
@@ -965,6 +975,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: passwordless/auto-sign-in | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: pwl-autosignin | ||
|
@@ -992,6 +1003,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: passwordless/sign-up | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: pwl-signup | ||
|
@@ -1001,6 +1013,7 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: passwordless/miscellaneous | ||
retry_count: 15 | ||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: pwl-misc | ||
|
@@ -1021,6 +1034,8 @@ tests: | |
category: auth | ||
sample_name: [mfa] | ||
spec: refresh-token-auth | ||
retry_count: 15 | ||
timeout_minutes: 90 | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Do we know how that interacts with https://github.com/aws-amplify/amplify-js-samples-staging/pull/1091/files? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. In GitHub Actions, the timeout-minutes setting defines the maximum number of minutes a job or a step is allowed to run before GitHub automatically cancels it. That includes multiple times of retries within the step. While the timeout in https://github.com/aws-amplify/amplify-js-samples-staging/pull/1091/files should be the timeout when running individual test. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The timeout from my PR is for Cypress commands. The timeout here is for the whole E2E test as defined in the workflow file. |
||
browser: *minimal_browser_list | ||
env: | ||
NEXT_PUBLIC_BACKEND_CONFIG: misc-tokenref |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do we have issues, where installing project dependencies fails or times out? and a reinstall fixes it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, we occasionally have 5xx during install. See https://github.com/aws-amplify/amplify-js/actions/runs/17037734366/job/48294300286