Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: Firefox XPack UI Functional Tests.x-pack/test/functional/apps/code/history·ts - Code History browser history can go back while exploring code app in search page, change language filters can go back and forward #37859

Closed
kibanamachine opened this issue Jun 3, 2019 · 13 comments
Labels
failed-test A test failure on a tracked branch, potentially flaky-test

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jun 3, 2019

A test failed on a tracked branch


        TypeError: Cannot read property 'getVisibleText' of undefined
    at Context.getVisibleText (test/functional/apps/code/history.ts:159:15)
    at process._tickCallback (internal/process/next_tick.js:68:7)
      

First failure: Jenkins Build

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jun 3, 2019
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage

@spalger
Copy link
Contributor

spalger commented Jun 3, 2019

@elastic/code looks like this test is racing a little bit, the screenshot shows two facets selected, but since the test doesn't actually wait for anything specifically it's possible that it takes the UI a little too long to update and the find.allByCssSelector('.euiFacetButton--isSelected') selection only gets one item back.

Instead we should probably do something like:

const getSelectedFacets = async () => {
  const selectedButtons = await find.byCssSelector('.euiFacetButton--isSelected')
  return await Promise.all(selectedButtons.map(async btn => await btn.getVisibleText());
}

await retry.try(async () => {
  expect(await getSelectedFacets()).to.eql(['typescript'])
})

// click item

await retry.try(async () => {
  expect(await getSelectedFacets()).to.eql(['typescript', 'javascript'])
})

// go back in history

await retry.try(async () => {
  expect(await getSelectedFacets()).to.eql(['typescript'])
})

image

@mw-ding
Copy link
Contributor

mw-ding commented Jun 3, 2019

@spalger so this is specifically for Firefox? do you want me to skip this test for now and then @WangQianliang can take a look?

@mw-ding
Copy link
Contributor

mw-ding commented Jun 3, 2019

#37914 this looks related.

@dmlemeshko
Copy link
Member

dmlemeshko commented Jun 3, 2019

Several ideas about wait in tests:

  1. Refreshing page can take some time on CI (e.g. latency) and it probably makes sense to wait first for Kibana to be loaded
await browser.refresh();
await PageObjects.header.awaitKibanaChrome()
  1. I also notice a spinner coming up before results are loaded:

Kibana 2019-06-03 21-08-44

await testSubjects.waitForDeleted('.euiLoadingSpinner');`

Waiting for the spinner to not be in DOM (probably?) can be used as an indicator of results loading finish.

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@spalger
Copy link
Contributor

spalger commented Aug 16, 2019

Search is coming back with no results and there are no facets rendered.

image

spalger pushed a commit that referenced this issue Aug 16, 2019
spalger pushed a commit that referenced this issue Aug 16, 2019
(cherry picked from commit ae85553)
@spalger
Copy link
Contributor

spalger commented Aug 16, 2019

Skipped

master: ae85553
7.x/7.4: 74d79fd

jloleysens added a commit to jloleysens/kibana that referenced this issue Aug 19, 2019
…_update_json_spec

* 'master' of github.com:elastic/kibana: (35 commits)
  fix: 🐛 pass whole action context to isCompatible() method (elastic#43457)
  Deleted old kbn-top-nav directive (elastic#43168)
  [ML] Fixing cloning of single metric distinct count job (elastic#43435)
  Update @elastic/charts version 8.1.6 > 9.1.1 (elastic#43516)
  [Inspector Views] [Request View] - Migrate inspector_views to new platform (elastic#43191)
  [ML] Adding loading indicators to all wizard charts (elastic#43382)
  disable flaky test (elastic#43492)
  feature(code/frontend): cancel file blob and directory commits request if outdated (elastic#43348)
  fix(code/frontend): button group url should have previous query string (elastic#43428)
  [SIEM] Fixes index substring incorrectly matching configured indices and failing to install ML job (elastic#43409)
  [SIEM] Adds performance enhancements such by removing wasted renderers and adding incremental DOM rendering (elastic#43157)
  disable flaky test (elastic#37859)
  Added sass lint to Canvas (elastic#43410)
  [Maps] add indicator when layer is filtered by search bar (elastic#43283)
  Properly validate current user password during password change. (elastic#43447)
  Spaces - allow for hex color codes that include uppercase characters (elastic#43470)
  [Reporting] Add a bit more logging and a few more logging level promotions (elastic#43415)
  Partially convert index pattern server to typescript (elastic#43291)
  [Infra UI] Use sum for aggregating AWS metrics. (elastic#43293)
  [SIEM] Format bytes columns in timeline (elastic#43147)
  ...
@zfy0701 zfy0701 added this to In progress in Code test fix Aug 28, 2019
@WangQianliang WangQianliang moved this from In progress to Done in Code test fix Aug 30, 2019
@zfy0701 zfy0701 closed this as completed Aug 30, 2019
@kibanamachine kibanamachine reopened this Sep 4, 2019
Code test fix automation moved this from Done to In progress Sep 4, 2019
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

spalger pushed a commit that referenced this issue Sep 4, 2019
spalger pushed a commit that referenced this issue Sep 4, 2019
(cherry picked from commit 08f9435)
spalger pushed a commit that referenced this issue Sep 4, 2019
(cherry picked from commit 08f9435)
@spalger
Copy link
Contributor

spalger commented Sep 4, 2019

Skipped

master: 08f9435
7.x/7.5: c94ac5d
7.4: daddaa9

@mw-ding
Copy link
Contributor

mw-ding commented Sep 6, 2019

reenabled by #44547

@spalger spalger closed this as completed Oct 28, 2019
Code test fix automation moved this from In progress to Done Oct 28, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test
Projects
No open projects
Code test fix
  
Done
Development

No branches or pull requests

7 participants