Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flaky test: org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet #25714

Closed
ghost opened this issue Dec 20, 2023 · 91 comments · Fixed by #25724
Closed

Flaky test: org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet #25714

ghost opened this issue Dec 20, 2023 · 91 comments · Fixed by #25724
Assignees
@ahus1
Labels
area/ci Indicates an issue on the CI flaky-test kind/bug Categorizes a PR related to a bug release/22.0.9 release/23.0.5 release/24.0.0 team/continuous-testing

Comments

@ghost
Copy link

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2)

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...
@ghost ghost added area/ci Indicates an issue on the CI flaky-test kind/bug Categorizes a PR related to a bug team/continuous-testing labels Dec 20, 2023
@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25711

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #12043

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25716

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25471

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #12043

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Output more information when OfflineServletAdapterTest fails
8d7b0cc 
Relates to keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
@ahus1 ahus1 mentioned this issue Dec 20, 2023
Merged
@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25724

org.openqa.selenium.NoSuchElementException: 
Unable to locate element with ID: refreshToken
For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html
Build info: version: '3.14.0', revision: 'aacccce0', time: '2018-08-02T20:19:58.91Z'
System info: host: 'fv-az975-901', ip: '10.1.0.90', os.name: 'Linux', os.arch: 'amd64', os.version: '6.2.0-1018-azure', java.version: '17.0.9'
...

@ahus1 ahus1 self-assigned this Dec 20, 2023
ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Output more information when OfflineServletAdapterTest fails
a07b82e 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Output more information when OfflineServletAdapterTest fails
e36aba2 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25724

java.lang.AssertionError: 

Expected: a string containing "Restarted PublicKeyLocator"
     but: was "<?xml version="1.0" encoding="UTF-8"?>
<html>
...

ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Reset application after re-creating the realm for each test
4090faf 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25724

java.lang.AssertionError: 

Expected: a string containing "Restarted PublicKeyLocator"
     but: was "<?xml version="1.0" encoding="UTF-8"?>
<html>
...

ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Reset application after re-creating the realm for each test
7e0f9ec 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
@ghost
Copy link
Author

ghost commented Dec 20, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25598

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 20, 2023
@ahus1
Allow reset of the time offset for the secure portal app
5d3feda 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
ahus1 added a commit to ahus1/keycloak that referenced this issue Dec 21, 2023
@ahus1
Adding the servlet also to other places where this application issued
ed202dd 
Closes keycloak#25714

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
@ghost
Copy link
Author

ghost commented Dec 21, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25747

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 21, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25333

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 21, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25755

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 22, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2)

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 22, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25361

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Dec 22, 2023

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25716

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25988

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25852

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25918

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #23303

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25995

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25806

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25918

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 8, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25963

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 9, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25716

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 9, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #25978

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

@ghost
Copy link
Author

ghost commented Jan 9, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #26030

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

1 similar comment
@ghost
Copy link
Author

ghost commented Jan 9, 2024

org.keycloak.testsuite.adapter.servlet.OfflineServletsAdapterTest#testServlet

Keycloak CI - Base IT (2) / Pull Request #26030

java.lang.AssertionError: 

Expected: not null
     but: was null
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
...

mhajas pushed a commit that referenced this issue Jan 9, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging (#25724)
03372d2 
Closes #25714
Closes #14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
ahus1 added a commit to ahus1/keycloak that referenced this issue Jan 9, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging
8860b81 
Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

(cherry picked from commit 03372d2)
@ahus1 ahus1 mentioned this issue Jan 9, 2024
Merged
ahus1 added a commit to ahus1/keycloak that referenced this issue Jan 9, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging
24b1c89 
Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

(cherry picked from commit 03372d2)
@ahus1 ahus1 mentioned this issue Jan 9, 2024
Merged
mhajas pushed a commit that referenced this issue Jan 10, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging (#26045)
0a22304 
Closes #25714
Closes #14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

(cherry picked from commit 03372d2)
mhajas pushed a commit that referenced this issue Jan 11, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging (#26044)
c1157a3 
Closes #25714
Closes #14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

(cherry picked from commit 03372d2)
pedroigor pushed a commit to alice-wondered/keycloak that referenced this issue Jan 12, 2024
@ahus1 @pedroigor
Fix OfflineServletAdapterTest failures, and improve logging (keycloak…
22bab27 
…#25724)

Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
wistefan pushed a commit to wistefan/keycloak that referenced this issue Jan 17, 2024
@ahus1 @wistefan
Fix OfflineServletAdapterTest failures, and improve logging (keycloak…
5567a79 
…#25724)

Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

Signed-off-by: Stefan Wiedemann <wistefan@googlemail.com>
kamontat pushed a commit to kamontat/keycloak that referenced this issue Jan 20, 2024
@ahus1 @kamontat
Fix OfflineServletAdapterTest failures, and improve logging (keycloak…
8e2958a 
…#25724)

Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

Signed-off-by: Kamontat Chantrachirathumrong <14089557+kamontat@users.noreply.github.com>
ShefeeqPM pushed a commit to ShefeeqPM/keycloak that referenced this issue Jan 27, 2024
@ahus1 @ShefeeqPM
Fix OfflineServletAdapterTest failures, and improve logging (keycloak…
06ead3b 
…#25724)

Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>

Signed-off-by: ShefeeqPM <86718986+ShefeeqPM@users.noreply.github.com>
ahus1 added a commit to ahus1/keycloak that referenced this issue Mar 22, 2024
@ahus1
Fix OfflineServletAdapterTest failures, and improve logging (keycloak…
4863085 
…#25724)

Closes keycloak#25714
Closes keycloak#14448

Signed-off-by: Alexander Schwartz <aschwart@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ahus1 ahus1

Labels
area/ci Indicates an issue on the CI flaky-test kind/bug Categorizes a PR related to a bug release/22.0.9 release/23.0.5 release/24.0.0 team/continuous-testing
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix OfflineServletAdapterTest failures, and improve logging ahus1/keycloak
1 participant
@ahus1