chore: hide reporter when protocol is enabled

[mschile]

Additional details

• Added a runtime server config item (hideCommandLog) that is enabled when the user has explicitly set CYPRESS_NO_COMMAND_LOG=1 or if protocol has been enabled.
• When taking a runner screenshot (also applies to failure screenshots) and the reporter is hidden, a screenshot of the AUT in the current viewport is now taken.
  • All other existing runner specific logic was left as-is (i.e. blackout option is still ignored)

Steps to test

• Run a test that takes a runner screenshot (cy.screenshot({ capture: 'runner' })) with protocol enabled.
  • Verify the reporter is not displayed while the tests are running (use --headed mode)
  • Verify the runner screenshot does not contain the reporter and only contains the AUT.
• Run a test that fails with screenshotOnRunFailure and protocol enabled.
  • Verify the failure screenshot does not contain the reporter and only contains the AUT.

How has the user experience changed?

The Reporter UI is now hidden when protocol is enabled.

it('test 1', () => {
  cy.visit('https://example.cypress.io/commands/actions')
  cy.screenshot({ capture: 'runner', blackout: ['.action-email'] })
})

before:

after:

PR Tasks

• Have tests been added/updated?
• Has a PR for user-facing changes been opened in cypress-documentation?
• Have API changes been updated in the type definitions?

[cypress]

31 flaky tests on run #50026 ↗︎

0

27942

1412

0

31

Details:

Merge branch 'release/13.0.0' into mschile/protocol/hide_command_log
Project: cypress	Commit: b276eabbb4
Status: Passed	Duration: 19:03 💡
Started: Aug 16, 2023 3:28 PM	Ended: Aug 16, 2023 3:47 PM

  e2e/origin/cookie_login.cy.ts • 1 flaky test • 5x-driver-electron

View Output Video

Test		Artifacts
cy.origin - cookie login > general behavior > works in a session		Output

  commands/net_stubbing.cy.ts • 1 flaky test • 5x-driver-electron

View Output Video

Test		Artifacts
network stubbing > intercepting request > can delay and throttle a StaticResponse		Output

  e2e/origin/commands/navigation.cy.ts • 1 flaky test • 5x-driver-electron

View Output Video

Test		Artifacts
cy.origin navigation > .go()		Output

  e2e/origin/commands/traversal.cy.ts • 1 flaky test • 5x-driver-electron

View Output Video

Test		Artifacts
cy.origin traversal > .children()		Output

  e2e/origin/commands/cookies.cy.ts • 1 flaky test • 5x-driver-electron

View Output Video

Test		Artifacts
cy.origin cookies > client side > .getCookie(), .getCookies(), and .setCookie()		Output

The first 5 flaky specs are shown, see all 18 specs in Cypress Cloud.

_{This comment has been generated by cypress-bot as a result of this project's GitHub integration settings.}

[jennifer-shehane]

@mschile Approving removal of protocolEnabled from public API. This config has no value to be exposed as part of our public APIs.

[cypress-bot]

Released in 13.0.0.

This comment thread has been locked. If you are still experiencing this issue after upgrading to
Cypress v13.0.0, please open a new issue.