[GTK] Add a new GTK layout tester bot to build.webkit.org that runs w…

…ith --skip-failing-tests switch

https://bugs.webkit.org/show_bug.cgi?id=227744

Reviewed by Jonathan Bedard.

On the EWS the layout tests run with this switch --skip-failing-tests
which changes the order in which tests are run (those expected to fail
are not scheduled). I think this may be causing different results on
other tests (like unexpected failures or unexpected flakies).
Having a bot in build.webkit.org running with this switch will help
to detect and garden those cases.

* CISupport/build-webkit-org/config.json:

Canonical link: https://commits.webkit.org/239600@main
git-svn-id: https://svn.webkit.org/repository/webkit/trunk@279844 268f45cc-cd09-0410-ab3c-d52691b4dbfc

Tools/CISupport/build-webkit-org/config.json

@@ -113,6 +113,7 @@
                     { "name": "gtk-linux-bot-16", "platform": "gtk" },
                     { "name": "gtk-linux-bot-17", "platform": "gtk" },
                     { "name": "gtk-linux-bot-18", "platform": "gtk" },
+                    { "name": "gtk-linux-bot-19", "platform": "gtk" },
 
                     { "name": "jsconly-linux-igalia-bot-1", "platform": "jsc-only" },
                     { "name": "jsconly-linux-igalia-bot-2", "platform": "jsc-only" },
@@ -352,7 +353,8 @@
                       "name": "GTK-Linux-64-bit-Release-Build", "factory": "BuildAndGenerateJSCBundleFactory", "builddir": "gtk-linux-64-release",
                       "platform": "gtk", "configuration": "release", "architectures": ["x86_64"],
                       "triggers": ["gtk-linux-64-release-tests", "gtk-linux-64-release-tests-js", "gtk-linux-64-release-tests-webdriver",
-                                   "gtk-linux-64-release-wayland-tests", "gtk-linux-64-release-perf-tests", "gtk-linux-64-release-gtk4-tests"],
+                                   "gtk-linux-64-release-wayland-tests", "gtk-linux-64-release-perf-tests", "gtk-linux-64-release-gtk4-tests",
+                                   "gtk-linux-64-release-skip-failing-tests"],
                       "workernames": ["gtk-linux-bot-2"]
                     },
                     {
@@ -432,6 +434,12 @@
                       "platform": "gtk", "configuration": "release", "architectures": ["x86_64"],
                       "workernames": ["gtk-linux-bot-18"]
                     },
+                    {
+                      "name": "GTK-Linux-64-bit-Release-Skip-Failing-Tests", "factory": "TestAllButJSCFactory", "builddir": "gtk-linux-64-release-skip-failing-tests",
+                      "platform": "gtk", "configuration": "release", "architectures": ["x86_64"],
+                      "additionalArguments": ["--skip-failing-tests"],
+                      "workernames": ["gtk-linux-bot-19"]
+                    },
                     {
                       "name": "WinCairo-64-bit-WKL-Release-Build", "factory": "BuildFactory", "builddir": "wincairo-wkl-release",
                       "platform": "wincairo", "configuration": "release", "architectures": ["x86_64"],
@@ -694,6 +702,9 @@
                     { "type": "Triggerable", "name": "gtk-linux-64-release-wayland-tests",
                       "builderNames": ["GTK-Linux-64-bit-Release-Wayland-Tests"]
                     },
+                    { "type": "Triggerable", "name": "gtk-linux-64-release-skip-failing-tests",
+                      "builderNames": ["GTK-Linux-64-bit-Release-Skip-Failing-Tests"]
+                    },
                     { "type": "Triggerable", "name": "wincairo-wkl-release-tests",
                       "builderNames": ["WinCairo-64-bit-WKL-Release-Tests"]
                     },

Tools/ChangeLog

@@ -1,3 +1,19 @@
+2021-07-12  Carlos Alberto Lopez Perez  <clopez@igalia.com>
+
+        [GTK] Add a new GTK layout tester bot to build.webkit.org that runs with --skip-failing-tests switch
+        https://bugs.webkit.org/show_bug.cgi?id=227744
+
+        Reviewed by Jonathan Bedard.
+
+        On the EWS the layout tests run with this switch --skip-failing-tests
+        which changes the order in which tests are run (those expected to fail
+        are not scheduled). I think this may be causing different results on
+        other tests (like unexpected failures or unexpected flakies).
+        Having a bot in build.webkit.org running with this switch will help
+        to detect and garden those cases.
+
+        * CISupport/build-webkit-org/config.json:
+
 2021-07-12  Jer Noble  <jer.noble@apple.com>
 
         [Cocoa] Incorrect deprecation declaration for -[WKWebView closeAllMediaPresentations:]