Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Selenium tests are not all green on 5.1 #16479

Closed
williamdes opened this issue Nov 12, 2020 · 2 comments
Closed

Selenium tests are not all green on 5.1 #16479

williamdes opened this issue Nov 12, 2020 · 2 comments
Assignees
@williamdes
Labels
Bug A problem or regression with an existing feature
Projects
issues
Milestone
5.1.0

Comments

@williamdes
Copy link
Member

williamdes commented Nov 12, 2020 •
edited

Server configuration

  • phpMyAdmin version: 5.1-dev

Errors

https://travis-ci.org/github/phpmyadmin/phpmyadmin/jobs/743160860#L988
https://travis-ci.org/github/phpmyadmin/phpmyadmin/jobs/743056640#L988
https://travis-ci.org/github/phpmyadmin/phpmyadmin/jobs/742810364#L980

Seems like 58 errors is a constant number.

On GitHub actions, 10 is a constant number.
@williamdes williamdes added this to the 5.1.0 milestone Nov 12, 2020
@williamdes williamdes added the Bug A problem or regression with an existing feature label Nov 12, 2020
williamdes added a commit that referenced this issue Nov 12, 2020
@williamdes
#16479 - Allow selenium tests to fail until they are fixed
c68b076 
Signed-off-by: William Desportes <williamdes@wdes.fr>
@williamdes williamdes added this to Needs triage in issues via automation Jan 24, 2021
@williamdes williamdes moved this from Needs triage to High priority in issues Jan 24, 2021
williamdes added a commit to williamdes/phpmyadmintest that referenced this issue Feb 8, 2021
@williamdes
Allow Selenium tests to fail
4424865 
See: phpmyadmin#16479

Signed-off-by: William Desportes <williamdes@wdes.fr>
@williamdes williamdes mentioned this issue Feb 8, 2021
Merged
@williamdes
Copy link
Member Author

Now that we migrated to GitHub Actions it seems like 10 failing tests is a constant number.
And the tracking tests must be re-done by depending on a test that will click on fix the phpMyAdmin storage database

@williamdes williamdes moved this from High priority to Low priority in issues Feb 9, 2021
@williamdes
Copy link
Member Author

williamdes commented Feb 17, 2021 •
edited 

There were 10 errors:

1) PhpMyAdmin\Tests\Selenium\CreateDropDatabaseTest::testCreateDropDatabase
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/CreateDropDatabaseTest.php:36

2) PhpMyAdmin\Tests\Selenium\Database\EventsTest::testAddEvent
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/Database/EventsTest.php:51

3) PhpMyAdmin\Tests\Selenium\Database\StructureTest::testTruncateTable
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

4) PhpMyAdmin\Tests\Selenium\Database\TriggersTest::testAddTrigger
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

5) PhpMyAdmin\Tests\Selenium\Database\TriggersTest::testEditTriggers
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

6) PhpMyAdmin\Tests\Selenium\Database\TriggersTest::testDropTrigger
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/Database/TriggersTest.php:229

7) PhpMyAdmin\Tests\Selenium\ImportTest::testTableImport
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

8) PhpMyAdmin\Tests\Selenium\Table\InsertTest::testAddData
Facebook\WebDriver\Exception\TimeoutException: 

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/WebDriverWait.php:71
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:730
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/Table/InsertTest.php:80

9) PhpMyAdmin\Tests\Selenium\Table\OperationsTest::testCopyTable
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

10) PhpMyAdmin\Tests\Selenium\Table\OperationsTest::testTruncateTable
Facebook\WebDriver\Exception\ElementNotInteractableException: element not interactable
  (Session info: chrome=88.0.4324.96)

/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Exception/WebDriverException.php:95
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/HttpCommandExecutor.php:371
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebDriver.php:612
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteExecuteMethod.php:27
/home/runner/work/phpmyadmin/phpmyadmin/vendor/php-webdriver/webdriver/lib/Remote/RemoteWebElement.php:74
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:644
/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/TestBase.php:1129

--

There was 1 failure:

1) PhpMyAdmin\Tests\Selenium\Database\QueryByExampleTest::testQueryByExample
Failed asserting that two strings are equal.
--- Expected
+++ Actual
@@ @@
-'SELECT `test_table`.`id` AS `ID`, `test_table`.`val` AS `VAL`\n
-FROM `test_table`\n
+'FROM `test_table`\n
 WHERE ((`test_table`.`id` > 1) AND (`test_table`.`val` < 6))\n
 ORDER BY `test_table`.`val` ASC, `test_table`.`id` DESC'

/home/runner/work/phpmyadmin/phpmyadmin/test/selenium/Database/QueryByExampleTest.php:121

--

Ref: #16657

@williamdes williamdes mentioned this issue Feb 17, 2021
Closed
@williamdes williamdes self-assigned this Feb 17, 2021
@williamdes williamdes mentioned this issue Feb 17, 2021
Closed
issues automation moved this from Low priority to Closed Feb 17, 2021
williamdes added a commit that referenced this issue Feb 17, 2021
@williamdes
Add a ChangeLog entry for #16479, #16657, b9ee5c7
04c4eac 
Signed-off-by: William Desportes <williamdes@wdes.fr>
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Feb 18, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@williamdes williamdes

Labels
Bug A problem or regression with an existing feature
Projects
issues
  
Closed
Milestone
5.1.0
Development

No branches or pull requests
1 participant
@williamdes