Skip to content

fix(e2e): improve GitHub report diagnostics - #671

Open
kieran-osgood-shopify wants to merge 1 commit into
mainfrom
e2e-reporting/improve-diagnostics
Open

fix(e2e): improve GitHub report diagnostics#671
kieran-osgood-shopify wants to merge 1 commit into
mainfrom
e2e-reporting/improve-diagnostics

Conversation

@kieran-osgood-shopify

@kieran-osgood-shopify kieran-osgood-shopify commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

Pulled out from the now closed #562
Improves the output of the btirise comment after e2e runs by listing the tags the test suite ran against - we moved away from running by suites (with flags like --smoke --guest) and using maestro tags https://app.graphite.com/github/pr/Shopify/checkout-kit/557/Replace-the-E2E-suite-cross-product-with-Maestro-tags-in-CI

What?

  • Show selected Maestro tags in the E2E results table and missing-run labels.
  • Show the error class and message when a run fails before producing test cases.
  • Name failure sections by target instead of the redundant application identifier.
Before After
image image

@github-actions github-actions Bot added the #gsd:50662 Rebase Checkout Kit on UCP label Aug 18, 2026

Copy link
Copy Markdown
Contributor Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@kieran-osgood-shopify
kieran-osgood-shopify marked this pull request as ready for review August 18, 2026 10:22
@kieran-osgood-shopify
kieran-osgood-shopify requested a review from a team as a code owner August 18, 2026 10:22
@kieran-osgood-shopify
kieran-osgood-shopify force-pushed the e2e-reporting/improve-diagnostics branch from 6cf88a6 to f5f5b07 Compare August 18, 2026 10:28
@bitrise

bitrise Bot commented Aug 18, 2026

Copy link
Copy Markdown

Install this build

Open Tophat, select your target device, then click Install. Links open on the Mac running Tophat.

SDK Install
React Native Install with Tophat
Swift Install with Tophat
Kotlin Install with Tophat

Checkout Kit E2E results

Status Tags Target Platform OS version tag Device
launch, checkout react-native ios latest iPhone 15
iOS 27 Beta
launch, checkout react-native android latest Google Pixel 9
Android 17.0
launch, checkout kotlin android latest Google Pixel 9
Android 17.0
launch, checkout swift ios latest iPhone 15
iOS 27 Beta

@kieran-osgood-shopify kieran-osgood-shopify changed the title fix(e2e): improve GitHub report diagnostics [WIP] fix(e2e): improve GitHub report diagnostics Aug 19, 2026
@kieran-osgood-shopify kieran-osgood-shopify changed the title [WIP] fix(e2e): improve GitHub report diagnostics fix(e2e): improve GitHub report diagnostics Aug 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

#gsd:50662 Rebase Checkout Kit on UCP

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant