Skip to content

Switch to gotestsum and start reporting test analytics - #260

Open
poljar wants to merge 3 commits into
mainfrom
poljar/junit-reports-and-gotestsum
Open

Switch to gotestsum and start reporting test analytics#260
poljar wants to merge 3 commits into
mainfrom
poljar/junit-reports-and-gotestsum

Conversation

@poljar

@poljar poljar commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

This PR has split out from #254 due to the conversation in #254 (comment).

@poljar
poljar force-pushed the poljar/junit-reports-and-gotestsum branch 2 times, most recently from 4abc6f4 to ee4f07d Compare August 3, 2026 19:02
Comment thread .github/workflows/tests.yaml Fixed
@poljar
poljar force-pushed the poljar/junit-reports-and-gotestsum branch 2 times, most recently from 34e7b13 to 4e43b86 Compare August 3, 2026 19:59
Comment thread .github/workflows/tests.yaml Fixed
@poljar
poljar force-pushed the poljar/junit-reports-and-gotestsum branch from 4e43b86 to 4c59c4e Compare August 3, 2026 20:01
@codecov-commenter

Copy link
Copy Markdown

❌ 2 Tests Failed:

Tests completed Failed Passed Skipped
97 2 95 6
View the top 2 failed test(s) by shortest run time
github.com/matrix-org/complement-crypto/tests::TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom/{js_hs1}|{rust_hs1}
Stack Traces | 3.46s run time
=== RUN   TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom/{js_hs1}|{rust_hs1}
    client.go:860: [CSAPI] POST .../client/v3/register => 200 OK (15.41294ms)
    client.go:860: [CSAPI] POST .../client/v3/register => 200 OK (13.6046ms)
    client.go:860: [CSAPI] POST .../client/v3/createRoom => 200 OK (85.659842ms)
    client.go:860: [CSAPI] POST .../client/v3/join/!utdScLhXjiwOvtCMQq:hs1 => 200 OK (31.163933ms)
Starting chrome via chromedp
�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] Executing: [.../usr/bin/chromium --enable-features=NetworkService,NetworkServiceInProcess --disable-default-apps --disable-features=site-per-process,Translate,BlinkGenPropertyTrees --disable-hang-monitor --disable-ipc-flooding-protection --disable-renderer-backgrounding --disable-background-timer-throttling --disable-client-side-phishing-detection --disable-extensions --metrics-recording-only --safebrowsing-disable-auto-update --password-store=basic --use-mock-keychain --headless --hide-scrollbars --mute-audio --disable-backgrounding-occluded-windows --disable-breakpad --disable-prompt-on-repost --disable-sync --force-color-profile=srgb --no-default-browser-check --disable-background-networking --disable-popup-blocking --enable-automation --disable-dev-shm-usage --no-first-run --user-data-dir=/tmp/chromedp-runner626894137 --remote-debugging-port=0 about:blank]
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.892624:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.893345:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.942955:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: 
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: DevTools listening on ws://127.0.0.1:.../devtools/browser/829bdf52-73e9-4d5c-b787-df8846456d52
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201517.984555:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201517.984625:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.984636:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.984654:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201517.994555:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201517.998291:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
�[39m�[34m2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201517.998428:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
2026-08-03T20:15:17Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201517.998498:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201518.104584:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201518.104674:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201518.105084:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.Properties.GetAll: object_path= .../UPower/devices/DisplayDevice: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
�[39m�[34m2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201518.129337:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
�[39m�[34m2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33779:0803/201518.131337:ERROR:dbus/bus.cc:405] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
�[39m�[34m2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33759:33759:0803/201518.142573:ERROR:dbus/object_proxy.cc:572] Failed to call method: org.freedesktop.DBus.NameHasOwner: object_path= ......................../org/freedesktop/DBus: unknown error type: 
�[39m�[34m2026-08-03T20:15:18Z [JSClient @user-37-alice:hs1,LUJSJHSECX] chrome: [33911:8:0803/201518.166290:ERROR:cc/raster/one_copy_raster_buffer_provider.cc:290] Creation of StagingBuffer's SharedImage failed.
�[39m[JSClient @user-37-alice:hs1,LUJSJHSECX] JS SDK wrapper listening on http://127.0.0.1:35579
    js.go:168: NewJSClient[@user-37-alice:hs1,LUJSJHSECX] created client storage=false
    membership_acls_test.go:167: [@user-37-alice:hs1](js) Login {BaseURL:http://127.0.0.1:32817 UserID:@user-37-alice:hs1 Password:complement-crypto-password SlidingSyncURL: DeviceID:LUJSJHSECX PersistentStorage:false ExtraOpts:map[] AccessToken:}
    rust.go:87: NewRustClient[@user-38-bob:hs1][TIKTJHMQPP] creating...
    rust.go:148: NewRustClient[@user-38-bob:hs1] created client storage=./rust_storage/user-38-bob_hs1_TIKTJHMQPP
    membership_acls_test.go:167: [@user-38-bob:hs1](rust) Login {BaseURL:http://127.0.0.1:32817 UserID:@user-38-bob:hs1 Password:complement-crypto-password SlidingSyncURL: DeviceID:TIKTJHMQPP PersistentStorage:false ExtraOpts:map[] AccessToken:}
    membership_acls_test.go:167: [@user-37-alice:hs1](js) StartSyncing starting to sync
    membership_acls_test.go:167: [@user-37-alice:hs1](js) StartSyncing now syncing
    membership_acls_test.go:167: [@user-38-bob:hs1](rust) StartSyncing starting to sync
    membership_acls_test.go:167: [@user-38-bob:hs1](rust) StartSyncing now syncing
    membership_acls_test.go:170: [@user-38-bob:hs1](rust) WaitUntilEventInRoom !utdScLhXjiwOvtCMQq:hs1
    membership_acls_test.go:170: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1]
    rust.go:813: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1] TimelineDiff len=1
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: <nil>
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: &{ID:$nmBGWZIuIEHhBDBRn9EqDs-XbWUu5sUJETtSqZIsiT8 Text: Sender:@user-38-bob:hs1 Target:@user-38-bob:hs1 Membership:join FailedToDecrypt:false}
    membership_acls_test.go:170: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1] set up
    membership_acls_test.go:171: [@user-37-alice:hs1](js) SendMessage !utdScLhXjiwOvtCMQq:hs1 => Alice and Bob in a room
    membership_acls_test.go:171: [@user-37-alice:hs1](js) SendMessage !utdScLhXjiwOvtCMQq:hs1 => $To9KJE2eTS0ICr2QLaM8OuN9rr146Eob7ERqYtK8IBk %!s(<nil>)
    membership_acls_test.go:172: bob (rust) waiting for event $To9KJE2eTS0ICr2QLaM8OuN9rr146Eob7ERqYtK8IBk
    rust.go:813: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1] TimelineDiff len=2
    rust.go:941: @user-38-bob:hs1: Wait[!utdScLhXjiwOvtCMQq:hs1]: event exists in the timeline
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: &{ID:$To9KJE2eTS0ICr2QLaM8OuN9rr146Eob7ERqYtK8IBk Text:Alice and Bob in a room Sender:@user-37-alice:hs1 Target: Membership: FailedToDecrypt:false}
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: <nil>
    membership_acls_test.go:176: [@user-37-alice:hs1](js) WaitUntilEventInRoom !utdScLhXjiwOvtCMQq:hs1
    client.go:860: [CSAPI] POST .../client/v3/rooms/!utdScLhXjiwOvtCMQq:hs1/leave => 200 OK (36.831517ms)
    membership_acls_test.go:182: [@user-37-alice:hs1](js) WaitUntilEventInRoom !utdScLhXjiwOvtCMQq:hs1
    membership_acls_test.go:183: [@user-37-alice:hs1](js) SendMessage !utdScLhXjiwOvtCMQq:hs1 => Only me on my lonesome
    rust.go:813: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1] TimelineDiff len=1
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: &{ID:$4EuICScNPqDSJR6QMsFDOYt2gICb-X8LQm9xmHq1uO4 Text: Sender:@user-38-bob:hs1 Target:@user-38-bob:hs1 Membership:leave FailedToDecrypt:false}
    membership_acls_test.go:183: [@user-37-alice:hs1](js) SendMessage !utdScLhXjiwOvtCMQq:hs1 => $95y7oLMclM4xtonDLwC-NDYOVMmbjxFhD6oxZr-Pfos %!s(<nil>)
    membership_acls_test.go:184: alice (js) waiting for event $95y7oLMclM4xtonDLwC-NDYOVMmbjxFhD6oxZr-Pfos
    client.go:860: [CSAPI] POST .../client/v3/join/!utdScLhXjiwOvtCMQq:hs1 => 200 OK (39.696705ms)
    membership_acls_test.go:189: [@user-38-bob:hs1](rust) WaitUntilEventInRoom !utdScLhXjiwOvtCMQq:hs1
    membership_acls_test.go:190: @user-38-bob:hs1: Wait[!utdScLhXjiwOvtCMQq:hs1]: event exists in the timeline
    rust.go:813: [@user-38-bob:hs1]AddTimelineListener[!utdScLhXjiwOvtCMQq:hs1] TimelineDiff len=3
    rust.go:875: Unhandled TimelineDiff change {}
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: &{ID:$9KD4O7MRglH_M-fqIU_rq1XVNci40zZA5rqWFaMGCyA Text: Sender:@user-38-bob:hs1 Target:@user-38-bob:hs1 Membership:join FailedToDecrypt:false}
    rust.go:881: [@user-38-bob:hs1]TimelineDiff change: <nil>
    membership_acls_test.go:195: [@user-38-bob:hs1](rust) Backpaginate 5 !utdScLhXjiwOvtCMQq:hs1
    membership_acls_test.go:195: [@user-38-bob:hs1](rust) Backpaginate 5 !utdScLhXjiwOvtCMQq:hs1 => %!s(<nil>)
    membership_acls_test.go:197: [@user-38-bob:hs1](rust) GetEvent(!utdScLhXjiwOvtCMQq:hs1, $95y7oLMclM4xtonDLwC-NDYOVMmbjxFhD6oxZr-Pfos)
    membership_acls_test.go:197: �[31mMustGetEvent: failed to GetEventTimelineItemByEventId($95y7oLMclM4xtonDLwC-NDYOVMmbjxFhD6oxZr-Pfos): ClientError: Generic: Msg=Item with given event ID not found, Details=0xc00109e620�[39m
    rust.go:522: @user-38-bob:hs1: Stopping sync service
    panic.go:615: [@user-38-bob:hs1](rust) Close
    panic.go:615: [@user-37-alice:hs1](js) Close
[JSClient @user-37-alice:hs1,LUJSJHSECX] Closing webserver for JS SDK wrapper at http://127.0.0.1:35579: http: Server closed
    --- FAIL: TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom/{js_hs1}|{rust_hs1} (3.46s)
github.com/matrix-org/complement-crypto/tests::TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom
Stack Traces | 6.97s run time
=== RUN   TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom
--- FAIL: TestOnRejoinBobCanSeeButNotDecryptHistoryInPublicRoom (6.97s)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants