Skip to content

chore(ci): remove functional test HTML reports#18239

Merged
Trinaa merged 1 commit intomainfrom
fxa-10807
Jan 17, 2025
Merged

chore(ci): remove functional test HTML reports#18239
Trinaa merged 1 commit intomainfrom
fxa-10807

Conversation

@Trinaa
Copy link
Copy Markdown
Contributor

@Trinaa Trinaa commented Jan 16, 2025

Because

  • the HTML reports aren't widely used
  • there are alternative means of viewing results and traces
  • creating the HTML reports costs time and money

This pull request

  • removes the creation of HTML reports from CI
  • uses an alternative in playwright.config for giving unique names to JUNIT XML reports when using CircleCI parallelism

Issue that this pull request solves

Closes: #FXA-10807

Checklist

Put an x in the boxes that apply

  • My commit is GPG signed.
  • If applicable, I have modified or added tests which pass locally.
  • I have added necessary documentation (if appropriate).
  • I have verified that my changes render correctly in RTL (if appropriate).

Screenshots (Optional)

Please attach the screenshots of the changes made in case of change in user interface.

Other information (Optional)

Any other information that is important to this pull request.

@Trinaa Trinaa force-pushed the fxa-10807 branch 2 times, most recently from 94dd9f7 to ebe27d7 Compare January 17, 2025 17:42
@Trinaa Trinaa marked this pull request as ready for review January 17, 2025 18:07
@Trinaa Trinaa requested a review from a team as a code owner January 17, 2025 18:07
Comment thread .circleci/config.yml
Comment on lines -335 to -336
JEST_JUNIT_OUTPUT_DIR: ./artifacts/tests
JEST_JUNIT_ADD_FILE_ATTRIBUTE: true
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure why these are here, they have no impact for Playwright.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure either...

Comment thread .circleci/config.yml
Comment on lines -734 to -736
# Deprecated - use workflows in conjunction with smoke-tests job instead!
# This job is manually triggered for now. see .circleci/README.md
production-smoke-tests:
Copy link
Copy Markdown
Contributor Author

@Trinaa Trinaa Jan 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need to keep this, it's not referenced anywhere in the workflows .

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That sounds reasonable, I see that the readme instructions for triggering manually were deleted.

Copy link
Copy Markdown
Contributor

@dschom dschom Jan 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They get triggered remotely by SRE when we release. I don't think we can remove these. I will double check though.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am fairly certain what is happening is SRE is calling the production_smoke_tests workflow, which uses the smoke-tests job, not the production-smoke-tests job here.


// If using the CircleCI parallelism feature, assure that the JUNIT XML report
// has a unique name
const JUNIT_OUTPUT_NAME = process.env.CIRCLE_NODE_INDEX
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Because:

* the HTML reports aren't widely used
* there are alternative means of viewing results and traces
* creating the HTML reports costs time and money

This commit:

* removes the creation of HTML reports from CI

Closes #FXA-10807
@Trinaa Trinaa merged commit a5ac1d4 into main Jan 17, 2025
@Trinaa Trinaa deleted the fxa-10807 branch January 17, 2025 20:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants