Tests fail on FreeBSD abruptly

[yurivict]

2022-07-18 19:53:43.244 INFO  [482417] [rtc::impl::PeerConnection::changeSignalingState@1182] Changed signaling state to have-remote-offer
2022-07-18 19:53:43.244 DEBUG [482417] [rtc::impl::PeerConnection::processLocalDescription@878] Adding media to local description, mid="test", removed=false
Track 2: Received track with mid "added"
2022-07-18 19:53:43.244 DEBUG [482417] [rtc::impl::PeerConnection::processLocalDescription@908] Reciprocating media in local description, mid="added", removed=false
Description 2: 2022-07-18 19:53:43.244 INFO  [482417] [rtc::impl::PeerConnection::changeSignalingState@1182] Changed signaling state to stable
v=0
o=rtc 3536121905 0 IN IP4 127.0.0.1
s=-
t=0 0
a=group:BUNDLE test added
a=group:LS test added
a=msid-semantic:WMS *
a=setup:active
a=ice-ufrag:EFty
a=ice-pwd:gx5rssRxPjrQ/c1AivTmsE
a=ice-options:ice2,trickle
a=fingerprint:sha-256 95:5F:89:35:34:E6:41:45:2C:A6:9B:44:57:AC:E0:0B:F3:7B:F8:6F:C9:D0:F9:C0:5C:B7:ED:11:8A:1E:30:FE
m=video 9 UDP/TLS/RTP/SAVPF
c=IN IP4 0.0.0.0
a=mid:test
a=recvonly
a=rtcp-mux
a=candidate:1 1 UDP 2122317823 192.168.5.3 5123 typ host
a=end-of-candidates
m=video 9 UDP/TLS/RTP/SAVPF
c=IN IP4 0.0.0.0
a=mid:added
a=recvonly
a=rtcp-mux

2022-07-18 19:53:43.244 INFO  [389393] [rtc::impl::PeerConnection::changeSignalingState@1182] Changed signaling state to have-local-offer
2022-07-18 19:53:43.244 INFO  [482419] [rtc::impl::PeerConnection::changeSignalingState@1182] Changed signaling state to stable
2022-07-18 19:53:53.318 INFO  [389393] [rtc::impl::PeerConnection::changeState@1151] Changed state to closed
State 2: closed
2022-07-18 19:53:53.318 INFO  [389393] [rtc::impl::PeerConnection::changeState@1151] Changed state to closed
State 1: closed
2022-07-18 19:53:53.318 DEBUG [482418] [rtc::impl::DtlsTransport::stop@480] Stopping DTLS recv thread
WebRTC Track test failed: Renegotiated track is not open
2022-07-18 19:53:53.318 INFO  [482442] [rtc::impl::DtlsTransport::runRecvLoop@612] DTLS closed
2022-07-18 19:53:53.319 DEBUG [482418] [rtc::impl::DtlsTransport::stop@480] Stopping DTLS recv thread
2022-07-18 19:53:53.319 INFO  [482443] [rtc::impl::DtlsTransport::runRecvLoop@612] DTLS closed
*** Error code 255

There's no test summary report, just this error message.
It's impossible to tell how many tests succeed, and how many tests fail in total.

Version: 0.17.9
FreeBSD 13.1

[paullouisageneau]

Is it a random failure or does it happen consistently?

Indeed, for now test are simply run it order and when something fails it stops. I opened issue #683 to introduce a proper test framework.

[yurivict]

This is a spurious error.

[paullouisageneau]

OK, I think I've seen the issue happening once or twice with the CI, so it's probably not FreeBSD-specific. Thank you for reporting, I'll investigate.