Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run page_load_metrics tests in visual regresssion jobs #68570

Merged

Conversation

spalger
Copy link
Contributor

@spalger spalger commented Jun 8, 2020

In order to establish a baseline for every commit we must run the page_load_metrics "tests" on every commit to tracked branches. We do that by adding tasks to the visual baseline job, which has been repurposed a little bit to establish several different types of baseline (though we haven't renamed that job yet).

@spalger spalger added release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.8.1 v7.9.0 v8.0.0 labels Jun 9, 2020
@spalger spalger requested review from brianseeders and removed request for brianseeders June 9, 2020 03:58
@spalger spalger force-pushed the fix/page-load-metrics/run-in-baseline-job branch from 86534cf to 9772a6f Compare June 9, 2020 04:04
@@ -11,8 +11,7 @@ mkdir -p "$installDir"
tar -xzf "$linuxBuild" -C "$installDir" --strip=1

echo " -> running visual regression tests from kibana directory"
checks-reporter-with-killswitch "X-Pack visual regression tests" \
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When this job is actually run in a PR it fails because of the -- --, there's apparently too many or not enough escapes or something to pass through the -- just to the percy exec call, which requires it... Since the visual regression stuff isn't currently run in PRs I just removed the checks reporter here.

@spalger
Copy link
Contributor Author

spalger commented Jun 9, 2020

Successful build with Jenkinsfile replaced by .ci/Jenkinsfile_visual_baseline : https://kibana-ci.elastic.co/job/elastic+kibana+pipeline-pull-request/52620/

@spalger spalger marked this pull request as ready for review June 9, 2020 06:51
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@spalger spalger requested a review from brianseeders June 9, 2020 06:51
@kibanamachine
Copy link
Contributor

💚 Build Succeeded

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@spalger spalger merged commit 45c81ce into elastic:master Jun 9, 2020
@spalger spalger deleted the fix/page-load-metrics/run-in-baseline-job branch June 9, 2020 17:41
spalger added a commit to spalger/kibana that referenced this pull request Jun 9, 2020
Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit to spalger/kibana that referenced this pull request Jun 9, 2020
Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit that referenced this pull request Jun 9, 2020
…#68676)

Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit that referenced this pull request Jun 10, 2020
…#68675)

Co-authored-by: spalger <spalger@users.noreply.github.com>
gmmorris added a commit to gmmorris/kibana that referenced this pull request Jun 10, 2020
* master: (22 commits)
  Partial revert of "Sync Kerberos + Anonymous access tests with the latest `security/_authenticate` API (user roles now include roles of anonymous user)." (elastic#68624)
  adapt some snapshot test (elastic#68489)
  [APM] Service maps - Fix missing ML status for services with jobs but no anomalies (elastic#68486)
  [skip test] apis Kerberos security Kerberos authentication finishing SPNEGO should properly set cookie and authenticate user
  [SIEM][Exceptions] - ExceptionsViewer UI component part 2 (elastic#68294)
  Surface data streams in Index Management. (elastic#67806)
  Fix edit datasource not working following changes in elastic#67234 (elastic#68583)
  [Logs + Metrics UI] Clean up async plugin initialization (elastic#67654)
  APM Storybook fixes (elastic#68671)
  Upgrade EUI to v24.1.0 (elastic#68141)
  [ML] DF Analytics: Creation wizard part 2 (elastic#68462)
  [Uptime] Fix race on overview page query (elastic#67843)
  Prefer using npm_execpath when spawning Yarn (elastic#68673)
  [Security] [Cases] Attach timeline to existing case (elastic#68580)
  Use Search API in Vega (elastic#68257)
  [Component templates] Table view (elastic#68031)
  [Uptime] Added relative date info in cert status column (elastic#67612)
  [Endpoint] Re-enable Functional test case for Endpoint related pages (elastic#68445)
  run page_load_metrics tests in visual regresssion jobs (elastic#68570)
  Enable exhaustive-deps; correct any lint warnings (elastic#68453)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.8.1 v7.9.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants