Flaky test: org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove #21785

ahus1 · 2023-07-18T13:46:28Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (firefox) / Pull Request #21661

java.lang.AssertionError: Expected SigningInPage but was Keycloak Account Management (https://localhost:8543/auth/realms/test/account/#/security/signingin&state=4e3aa195-6864-4112-a9fa-8a26a7e7870a&session_state=1646e5de-59bb-4107-9ebd-4f3883c4dba4&code=3cb81e7c-3b12-422b-836f-787063be9995.1646e5de-59bb-4107-9ebd-4f3883c4dba4.25f1fe5f-3a38-4895-aae5-c4e4c214a146)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor538.invoke(Unknown Source)
...

The text was updated successfully, but these errors were encountered:

ghost · 2023-07-21T12:21:02Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (firefox) / Pull Request #21870

java.lang.AssertionError: Expected SigningInPage but was Keycloak Account Management (https://localhost:8543/auth/realms/test/account/#/security/signingin&state=3121f861-0dae-4ae4-8fb9-a335ce9450fc&session_state=4558f39c-643b-40da-94e3-4d95895c581e&code=97a8b293-8d2e-4f11-87e1-d0b1370bbf7b.4558f39c-643b-40da-94e3-4d95895c581e.3f94415c-4718-49d4-bfab-a9ffde880098)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor538.invoke(Unknown Source)
...

rmartinc · 2023-07-25T07:47:05Z

@mabartos I have been looking the failures in firefox the last days too. And I think that the issue is very ,very weird. If you see a lot of failures come with the meesage:

JavaScript error: https://localhost:8543/auth/realms/test/account/#/security/signingin&state=9f1509b4-2422-431a-80c1-cb25263e0c7c&session_state=bf4fe30a-8ef8-403e-8356-2a7ca84eb728&kc_action_status=success&code=a69ef804-df78-4b55-a4d9-3f0dd1eadfad.bf4fe30a-8ef8-403e-8356-2a7ca84eb728.8f3b404e-0f6e-4b63-9ede-736c63a98643, line 136: ReferenceError: Keycloak is not defined

And I think it's the same for others. I can reproduce it in my laptop doing (it usually fails before the 10 runs):

for i in {1..10}; do
  echo "===========================================> ${i}"; 
  mvn clean test -Pauth-server-quarkus -Dtest=org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#notDisplayAvailableAuthenticatorsPasswordless -Dbrowser=firefox -Pwebauthn;
  if [ $? -ne 0 ]; then break; fi;
done

The corresponding JavaScript line 136 that fails is this one. So the problem is that the Keycloak class is not loaded by this script tag somehow.

I have done a lot of tests and IMHO it makes no sense at all (I tried to execute the init code in onload, in different places, and nothing works). Besides I cannot make it fail in the browser (with my fedora firefox). So I don't know if the failure is due to arquillian, selenium, firefox or a weird combination of everything.

I can just make it work (in my laptop) loading the keycloak.js via JS. Doing something like:

                let script = document.createElement("script");
                script.src = "${authUrl}js/keycloak.js";
                script.type = "module";
                script.addEventListener("load", initKeycloak)
                document.head.appendChild(script);

Don't know why, this works and I can execute the single test 20 runs without failure (usually it fails in less than 10). I'm going to send this change now to my branch to see if there is some other issue with the CI (maybe changing the index for account makes other test fail).

mabartos · 2023-07-25T09:14:29Z

@rmartinc Very interesting findings. Thanks for that.

@jonkoops Have you encountered some similar problems?

ghost · 2023-09-21T00:55:10Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #23407

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=4d27ff4f-18c8-4db1-85ff-c79001ff83e2&response_mode=fragment&response_type=code&scope=openid&nonce=ef3c48de-9575-4ac4-a0c6-e84c473db9f4&code_challenge=jJUzr4nOL5PrcXXVxd-nwSkSY4qx-3hjUPIpcnBV-mU&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor628.invoke(Unknown Source)
...

ghost · 2023-09-27T01:52:17Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome)

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=b5529ed1-5205-47cb-a34a-92fb72821e81&response_mode=fragment&response_type=code&scope=openid&nonce=b5b61386-ac67-4399-8659-70ede7c66546&code_challenge=CdRPqYR21qZKY-EGtpHAaQr6Kg3tHlGfokN80hmsMUo&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor628.invoke(Unknown Source)
...

ghost · 2023-11-13T11:26:27Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24680

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=7b33a937-95ea-487b-878d-350c143a2a73&response_mode=fragment&response_type=code&scope=openid&nonce=1e1c3d49-6755-47fa-976d-c88f11bc782b&code_challenge=m8qZOc0PMCOC7OGvJm0xNX6w4tFyL2bbxihpBW1WLW8&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-14T17:59:21Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24753

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=0be9edc8-ee66-47bf-8fb1-2d565f9bb7bd&response_mode=fragment&response_type=code&scope=openid&nonce=2506b9b5-25ce-4ae9-82e7-26020b4cbac0&code_challenge=gHpyOJ_DEnCblcyaZCjmZPg37TK16UbglN9uYZE0XXM&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-14T19:00:39Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24753

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=0be9edc8-ee66-47bf-8fb1-2d565f9bb7bd&response_mode=fragment&response_type=code&scope=openid&nonce=2506b9b5-25ce-4ae9-82e7-26020b4cbac0&code_challenge=gHpyOJ_DEnCblcyaZCjmZPg37TK16UbglN9uYZE0XXM&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-15T15:48:42Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24774

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=094c526d-69e4-4dc1-896a-6404e0c75471&response_mode=fragment&response_type=code&scope=openid&nonce=102fd323-2447-4d15-81d1-414d41779141&code_challenge=f6iF_ww1hfYtQMVOSL0JOKPrlxBlzmNalhetal7xXLg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-15T16:46:57Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24774

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=094c526d-69e4-4dc1-896a-6404e0c75471&response_mode=fragment&response_type=code&scope=openid&nonce=102fd323-2447-4d15-81d1-414d41779141&code_challenge=f6iF_ww1hfYtQMVOSL0JOKPrlxBlzmNalhetal7xXLg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-20T14:03:23Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24843

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=c5156324-7cf6-40ea-980a-17b535753430&response_mode=fragment&response_type=code&scope=openid&nonce=0470b419-22fa-449c-b040-45eaeeaa759a&code_challenge=YnphVH_LpHVjl0s6XJVqFEc5uvFms9WNjUE-UKLi3-o&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-21T13:20:02Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24473

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=260aa3be-bb42-4648-8c88-a53334cc4a32&response_mode=fragment&response_type=code&scope=openid&nonce=52b22ddf-242c-4d3b-b7f0-ef53b4844188&code_challenge=TOC8B-CNA6s0lBM6kvu4Aw6GqL2fAD2lv8lccnNb2UI&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-22T13:16:19Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24925

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=5f4b24b4-4d55-431f-8cff-a65e03711447&response_mode=fragment&response_type=code&scope=openid&nonce=08db6d05-62bb-4702-aa54-33fff9c90c28&code_challenge=KVuN-MMBlDOYBthr4vS876ZaUgkd_FT2V5od2dJ4ZtE&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=cdf68861-4253-45a5-8bd1-1e6c23eca7e2&response_mode=fragment&response_type=code&scope=openid&nonce=f55dac40-556b-4840-8687-9dd04c266516&code_challenge=Yai6B_GmpJTXM4X_UMB-WylWALJZYSmHdYgtNGQurLQ&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-23T09:35:45Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24913

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=6e323ce7-ab0b-4be6-9980-96b06eb60e9c&response_mode=fragment&response_type=code&scope=openid&nonce=626391d0-a1ef-461e-8d5f-f2cae51d7762&code_challenge=dMgUlHF_jrZZwZd5KxUR-aD-IvsqB87CGwQ0UxqJXdk&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:110)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-27T13:20:39Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #24736

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=5106436d-608a-4b88-841e-1092a79b97d2&response_mode=fragment&response_type=code&scope=openid&nonce=3e8b7070-2039-443b-8795-9572ca4b4c0f&code_challenge=cGDU29i2IFa5qiifnQok2b7dG349Af5EktYXHjWUm0I&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-28T19:26:21Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25044

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=e33b781f-4d17-44f3-8e14-90c1fa512d2b&response_mode=fragment&response_type=code&scope=openid&nonce=996be04b-0c4e-4f81-9dda-7b1e06459815&code_challenge=S--syGW3vD4PKDSYuKlkSlF-Y4NyPZVBPFI_HCUqaSY&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-29T08:26:01Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25102

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=bdf85b8f-fec8-4da2-8fb7-16c17dbed82e&response_mode=fragment&response_type=code&scope=openid&nonce=d5d54026-cc68-40df-a9fa-740049f8ad57&code_challenge=WVlaByc2ufeTJ58xy8spoVHkiMA4lKEHU2tF-MXd3ow&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-29T11:41:57Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25081

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=20a7a70c-f4c4-4f36-88f7-8f9b3797d073&response_mode=fragment&response_type=code&scope=openid&nonce=eef7e5d2-ee66-4120-8f03-36f71d92a6ab&code_challenge=wyqWsB6EE3iWn9mu80_1qWE9vAihqaXFlCXAwT9qXOc&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-11-29T12:16:17Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25102

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=bdf85b8f-fec8-4da2-8fb7-16c17dbed82e&response_mode=fragment&response_type=code&scope=openid&nonce=d5d54026-cc68-40df-a9fa-740049f8ad57&code_challenge=WVlaByc2ufeTJ58xy8spoVHkiMA4lKEHU2tF-MXd3ow&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-12-08T15:47:20Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25428

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=54e7a31f-1a84-4030-95c6-00efa360dfff&response_mode=fragment&response_type=code&scope=openid&nonce=acbc0d6f-9903-478e-8293-d7ada1be9f14&code_challenge=u_aQ-BZkTmLLU8lMwhANnJj8bZVtA944Epu6ZGDap_o&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-12-08T20:59:26Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25395

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=d65bf468-44f0-4662-b553-72ad84868391&response_mode=fragment&response_type=code&scope=openid&nonce=4530e3e4-4043-41fe-9452-c4fa473157e4&code_challenge=8ah-qWdnbcqS-PGhuvXmv0TBgfbR20mc0MWjJ9RAlRU&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-12-13T16:40:46Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25340

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=6c611bd0-70ac-4e7c-a8b6-62c316fd716f&response_mode=fragment&response_type=code&scope=openid&nonce=a152513b-92c2-4286-8b9b-e67f62153f4b&code_challenge=-gorSNUWaYuONJKUNt0DFFeySqYOII67mWqTxEX-Bpg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-12-18T11:55:46Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25600

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=5eb40f5e-36d4-4fb8-b647-d84af70246cd&response_mode=fragment&response_type=code&scope=openid&nonce=90f1d833-02a6-4be1-8e86-1360b96f3885&code_challenge=6zj0oiudChqCIQ-3Tps4hXaNs6b6txKVirjXBRgDKFU&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2023-12-19T19:03:49Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25709

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=fca5cc8d-76dc-406b-8a41-0b75c0d0899e&response_mode=fragment&response_type=code&scope=openid&nonce=8e75819c-f0a4-4f32-b003-0075597cce83&code_challenge=dwplNgj-fMrbvgdxLqSD8Ufgomq8ds6R4xByinHPATg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-08T16:58:10Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25919

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=db15fafb-db8c-4ec0-8eac-7f3c8d64ec33&response_mode=fragment&response_type=code&scope=openid&nonce=cf847760-e971-4e83-81b0-9023ddf9588e&code_challenge=H_es8eiVwk9lzK25DoHQfWK9FwHAJT9-mVyZU7WU_z8&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-10T12:03:14Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26070

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=d85e2456-aba1-4623-b05e-0b9f84a7e1aa&response_mode=fragment&response_type=code&scope=openid&nonce=ed3a2e8d-c73a-4584-894c-d670a1218c08&code_challenge=ECIvU8RgcfjpA7FoVTJnnnbs3tTxMNY1xJfq6HJgJ98&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-10T18:25:33Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26093

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=0a55c733-04f0-4385-9a29-3d4fbbcdf816&response_mode=fragment&response_type=code&scope=openid&nonce=87c4d40a-8705-429d-828a-a40a4629214d&code_challenge=HJ94nOivOO6EL0mZBw-al5sBCv_ZHL5G5ENqXrh0Y20&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-17T03:37:33Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26208

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=747a85ff-5b45-400f-8761-68dbc4fb2642&response_mode=fragment&response_type=code&scope=openid&nonce=bfaecfa1-ddfb-4f4f-bc10-96243963a609&code_challenge=XLaU868aaiudjVq8PzkSeBA-E8-nomIjqY2DU6aVCOg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor637.invoke(Unknown Source)
...

ghost · 2024-01-17T17:55:00Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26003

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=7b0fd778-5df8-4f04-8e58-b053b1db3fd3&response_mode=fragment&response_type=code&scope=openid&nonce=c9fb7dfb-ff8a-4e2f-8a76-913de183a6f6&code_challenge=ZbUTG62X3XMKGA4wb2Q3gHfabi-IO3uo76tD6jtlq7I&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-25T10:44:34Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26484

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=da5f84bd-299e-4227-a524-3f6cfc592d9a&response_mode=fragment&response_type=code&scope=openid&nonce=8abeb158-4d6c-4944-84a5-66736684387b&code_challenge=WZkxo7D_SeiYt1qDXhV5AF_x_UrN_JtRs0I2GnTM31o&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-25T13:48:42Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26415

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=783477f8-fd2d-4638-bb37-aea3e52a5d84&response_mode=fragment&response_type=code&scope=openid&nonce=4d1d92f7-2784-4599-8a64-1ffd56cbf45d&code_challenge=UPUzoQ_rX6rF8Flp0FM-EnmI82N8QyuMfs3yZIvudjo&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-29T10:19:47Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26551

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=df8172bb-6e1a-440d-9565-e1c0b6d2d602&response_mode=fragment&response_type=code&scope=openid&nonce=ce22a1dd-e35d-4f09-bd09-7c1f58c715cb&code_challenge=oRvbNGjUle9NmmVoleB4hMINdip4W6quMm-WSb2PLUk&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-01-29T13:06:43Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26497

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=5390bb88-435b-484a-ac6b-3dccdf99b9b9&response_mode=fragment&response_type=code&scope=openid&nonce=3a55d89d-a243-4b6e-bdc8-5470f20ba48e&code_challenge=7Znx6feQTSwAYOBwFx7BrF2uWDIRMWt9c9u1wxTqtT0&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

ghost · 2024-02-02T02:26:35Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26718

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=758c9839-a715-4184-8f9b-ee174281c6ce&response_mode=fragment&response_type=code&scope=openid&nonce=c78b61f7-992a-4a57-84ca-abc290febde7&code_challenge=P5a95pddq6hpdRVhd8RMiedv1E3GeT7GyGOtwXa5CYw&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-06T11:01:14Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25893

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=08b82d37-c57e-4a40-b01f-8f35796d1f41&response_mode=fragment&response_type=code&scope=openid&nonce=4afdcc13-80ad-4498-9ad7-830f9b3ed188&code_challenge=_Xh9pqavL4ETGM2VEGH3Qr5m5Y8QSfn8F8KTJuEtMaY&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-12T21:46:21Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #25826

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=6be490ec-6b2a-478d-8928-f866f1cead51&response_mode=fragment&response_type=code&scope=openid&nonce=b1c651d5-618e-4e3b-b91d-aeed99fad2cb&code_challenge=h_DNENS4MPFByQ8dS38GOb6DGx5bO2pTXHyYLMx4gEM&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor636.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-13T15:05:51Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26970

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=17179cd5-b3dd-42c0-bdde-fd5eb5ea5ab9&response_mode=fragment&response_type=code&scope=openid&nonce=d851fd87-7a6e-4381-bc01-9c18f233414a&code_challenge=5h9e-5rBzll9_6Dz-YgfRKhwenZqe5BdTYBN1TNvCgQ&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-13T19:41:41Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #26939

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=fc8d713e-122e-4d4e-8bef-e37ac1baf692&response_mode=fragment&response_type=code&scope=openid&nonce=4d5c31fe-aec8-4f0b-9e89-571defb446bf&code_challenge=UZIbuViUWmUpY0DUpvlmjRwylKbJjmhfsQ1kSeXK2q0&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-15T17:44:08Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27061

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=056cca4b-ad0b-468f-8a9a-14e0fcad8434&response_mode=fragment&response_type=code&scope=openid&nonce=0af9db97-8b1c-4577-85a1-9edd7813b6a4&code_challenge=Z8Rk4QEeJm1iH0xHM2x_mG0GjakEWQO6W_eTCx2CU3w&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-16T12:53:18Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27075

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=294e0aba-e589-44fd-84fb-08aedfc94132&response_mode=fragment&response_type=code&scope=openid&nonce=34b47241-58cc-47eb-88b3-1e856bcce25c&code_challenge=R-_FthQ3iqYJA7-MZNfSK8ocmC7p-0td7HnzmXnm6qI&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-19T01:21:08Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27107

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=71ebf987-3619-432b-9372-6a2308aeb88a&response_mode=fragment&response_type=code&scope=openid&nonce=bb4ca1a0-d6a0-4471-816e-ecf8aa5f7cec&code_challenge=9In9c-2lzYrIpUXwVydhsdqFUwvoZ9BPpxhjrqjJCTk&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor635.invoke(Unknown Source)
...

keycloak-github-bot · 2024-02-27T23:48:29Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27328

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=c48b8995-0fa0-41a2-8f66-91e4624b25d3&response_mode=fragment&response_type=code&scope=openid&nonce=1eca1559-482f-41e0-8791-3308f5e1569e&code_challenge=mTrLPFi37j8VteBho6XtkwBwOqZxpcn3lnhDXij9RIY&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor637.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-04T13:02:10Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27458

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=fac7fbb5-27d7-49b9-9e87-81fc2995b9ec&response_mode=fragment&response_type=code&scope=openid&nonce=4d0ccd84-3e2c-4389-8801-70db5c140ebe&code_challenge=c6M5RoG_v7_cMhHmzKv5u0sutj_BOGSo7bvKPckMfCo&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-04T13:19:38Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27486

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=d74b0de9-427e-4604-9f97-b975c120c72a&response_mode=fragment&response_type=code&scope=openid&nonce=eeed3828-3e9a-45ac-9e55-3b0eccae4099&code_challenge=uXEUNbVEXQPBAgj3gteDlBIg0kxkRRnw_hVI2QzxdbY&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-07T12:20:28Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27656

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=0c327732-4660-41c8-8a39-87bd694c8098&response_mode=fragment&response_type=code&scope=openid&nonce=f49cdc09-fb66-4ceb-8057-74065b9a4466&code_challenge=sXJ45O_ot7Xqau7PEj25OFbvPgjGlzyL3KgA7dYpBHY&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-12T08:48:26Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27795

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=e81ba675-2889-42c1-ad0f-ca08aa70365e&response_mode=fragment&response_type=code&scope=openid&nonce=9a87cb63-5b90-4620-8faf-8029fc8377f0&code_challenge=zQE3UO75W4rRpBTAvHVlKcLPmBOrjML7-bCCvaxPrOg&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-13T15:59:40Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #27865

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=371addb0-cbda-4fbb-bbb7-af6ecfb4c405&response_mode=fragment&response_type=code&scope=openid&nonce=a4c45790-6c92-4021-b846-6c9a22a81cf0&code_challenge=zn6Pbck-srSq8Jo9CKvT5jWXc3ePhreX0gLEBm1gZFk&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

keycloak-github-bot · 2024-03-22T14:14:51Z

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

Keycloak CI - WebAuthn IT (chrome) / Pull Request #28171

java.lang.AssertionError: Expected OIDCLogin but was  (https://localhost:8543/auth/realms/test/protocol/openid-connect/auth?client_id=account-console&redirect_uri=https%3A%2F%2Flocalhost%3A8543%2Fauth%2Frealms%2Ftest%2Faccount%2F%23%2Fsecurity%2Fsigningin&state=75ff0825-1bc6-443d-aa83-19e983cf64bb&response_mode=fragment&response_type=code&scope=openid&nonce=29443bf9-87cc-476b-b37a-fb16c4c4914d&code_challenge=7JGsrFn6YVGyMrhcGzwA50dcPbmvVyW0cNFW1JUEUoU&code_challenge_method=S256)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.assertTrue(Assert.java:42)
	at org.keycloak.testsuite.page.AbstractPage.assertCurrent(AbstractPage.java:109)
	at jdk.internal.reflect.GeneratedMethodAccessor639.invoke(Unknown Source)
...

mposolda · 2024-05-15T18:07:34Z

Closing as it seems the flakiness disappeared.

ahus1 added kind/bug Categorizes a PR related to a bug area/ci Indicates an issue on the CI flaky-test labels Jul 18, 2023

ghost added the team/continuous-testing label Jul 18, 2023

mabartos self-assigned this Jul 24, 2023

lhanusov unassigned mabartos Dec 11, 2023

stianst mentioned this issue Feb 20, 2024

Stabilize WebAuthn tests #27164

Closed

10 tasks

stianst added the action/priority-important label Mar 8, 2024

keycloak-github-bot bot added priority/important Must be worked on very soon and removed action/priority-important labels Mar 8, 2024

mposolda closed this as not planned Won't fix, can't repro, duplicate, stale May 15, 2024

Flaky test: org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove #21785

Flaky test: org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove #21785

Comments

ahus1 commented Jul 18, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jul 21, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

rmartinc commented Jul 25, 2023

mabartos commented Jul 25, 2023

ghost commented Sep 21, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Sep 27, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 13, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 14, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 14, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 15, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 15, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 20, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 21, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 22, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 23, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 27, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 28, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 29, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 29, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Nov 29, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Dec 8, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Dec 8, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Dec 13, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Dec 18, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Dec 19, 2023

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 8, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 10, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 10, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 17, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 17, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 25, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 25, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 29, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Jan 29, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

ghost commented Feb 2, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

keycloak-github-bot bot commented Feb 6, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

keycloak-github-bot bot commented Feb 12, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

keycloak-github-bot bot commented Feb 13, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

keycloak-github-bot bot commented Feb 13, 2024

org.keycloak.testsuite.webauthn.account.WebAuthnSigningInTest#availableAuthenticatorsAfterRemove

keycloak-github-bot bot commented Feb 15, 2024