msquicplatformtest crashing on Linux

[baentsch]

When building msquic using cmake like the below (for reproducibility in a Docker image) msquicplatformtest the result is many errors and a SIGSEGV. What am I doing wrong?

FROM ubuntu:focal

ENV TZ=Europe/Zurich
ENV DEBIAN_FRONTEND=noninteractive

WORKDIR /root
RUN apt update && apt install software-properties-common apt-utils -y

RUN apt-add-repository ppa:lttng/stable-2.12 -y && apt update && apt install build-essential cmake liblttng-ust-dev lttng-tools git ninja-build libssl-dev -y

RUN git clone https://github.com/microsoft/msquic && cd msquic && git submodule init && git submodule update --recursive

RUN cd /root/msquic && mkdir build && cd build && cmake -G 'Unix Makefiles' ..  && cmake --build .

RUN /root/msquic/build/bin/Release/msquicplatformtest

results in

[...]
Step 9/9 : RUN /root/msquic/build/bin/Release/msquicplatformtest
 ---> Running in 5f4ddabcf206
[==========] Running 72 tests from 7 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from CryptTest
[ RUN      ] CryptTest.WellKnownClientInitial
[       OK ] CryptTest.WellKnownClientInitial (0 ms)
[ RUN      ] CryptTest.WellKnownChaChaPoly
[       OK ] CryptTest.WellKnownChaChaPoly (0 ms)
[ RUN      ] CryptTest.HpMaskChaCha20
[       OK ] CryptTest.HpMaskChaCha20 (0 ms)
[ RUN      ] CryptTest.HpMaskAes256
[       OK ] CryptTest.HpMaskAes256 (0 ms)
[ RUN      ] CryptTest.HpMaskAes128
[       OK ] CryptTest.HpMaskAes128 (0 ms)
[----------] 5 tests from CryptTest (0 ms total)

[----------] 4 tests from DataPathTest
[ RUN      ] DataPathTest.Initialize
[       OK ] DataPathTest.Initialize (20 ms)
[ RUN      ] DataPathTest.InitializeInvalid
[       OK ] DataPathTest.InitializeInvalid (0 ms)
[ RUN      ] DataPathTest.UdpBind
[       OK ] DataPathTest.UdpBind (12 ms)
[ RUN      ] DataPathTest.UdpRebind
[       OK ] DataPathTest.UdpRebind (16 ms)
[----------] 4 tests from DataPathTest (48 ms total)

[----------] 1 test from PlatformTest
[ RUN      ] PlatformTest.QuicAddrParsing
[       OK ] PlatformTest.QuicAddrParsing (0 ms)
[----------] 1 test from PlatformTest (0 ms total)

[----------] 39 tests from TlsTest
/root/msquic/src/platform/unittest/TlsTest.cpp:166: Failure
Expected: (nullptr) != (PfxPath), actual: (nullptr) vs NULL
[ RUN      ] TlsTest.Initialize
/root/msquic/src/platform/unittest/TlsTest.cpp:755: Skipped

[  SKIPPED ] TlsTest.Initialize (0 ms)
[ RUN      ] TlsTest.Handshake
/root/msquic/src/platform/unittest/TlsTest.cpp:764: Skipped

[  SKIPPED ] TlsTest.Handshake (0 ms)
[ RUN      ] TlsTest.HandshakeCertFromFile
/root/msquic/src/platform/unittest/TlsTest.cpp:778: Skipped

[  SKIPPED ] TlsTest.HandshakeCertFromFile (0 ms)
[ RUN      ] TlsTest.HandshakeParamInfoDefault
/root/msquic/src/platform/unittest/TlsTest.cpp:790: Skipped

[  SKIPPED ] TlsTest.HandshakeParamInfoDefault (0 ms)
[ RUN      ] TlsTest.HandshakeParamInfoAES256GCM
/root/msquic/src/platform/unittest/TlsTest.cpp:837: Skipped

[  SKIPPED ] TlsTest.HandshakeParamInfoAES256GCM (0 ms)
[ RUN      ] TlsTest.HandshakeParamInfoAES128GCM
/root/msquic/src/platform/unittest/TlsTest.cpp:886: Skipped

[  SKIPPED ] TlsTest.HandshakeParamInfoAES128GCM (0 ms)
[ RUN      ] TlsTest.HandshakeParamInfoChaCha20
/root/msquic/src/platform/unittest/TlsTest.cpp:936: Skipped

[  SKIPPED ] TlsTest.HandshakeParamInfoChaCha20 (0 ms)
[ RUN      ] TlsTest.HandshakeParamNegotiatedAlpn
/root/msquic/src/platform/unittest/TlsTest.cpp:986: Skipped

[  SKIPPED ] TlsTest.HandshakeParamNegotiatedAlpn (0 ms)
[ RUN      ] TlsTest.HandshakeParallel
/root/msquic/src/platform/unittest/TlsTest.cpp:1021: Skipped

[  SKIPPED ] TlsTest.HandshakeParallel (0 ms)
[ RUN      ] TlsTest.HandshakeResumption
/root/msquic/src/platform/unittest/TlsTest.cpp:1049: Skipped

[  SKIPPED ] TlsTest.HandshakeResumption (0 ms)
[ RUN      ] TlsTest.HandshakeResumptionRejection
/root/msquic/src/platform/unittest/TlsTest.cpp:1073: Skipped

[  SKIPPED ] TlsTest.HandshakeResumptionRejection (0 ms)
[ RUN      ] TlsTest.HandshakeResumptionClientDisabled
/root/msquic/src/platform/unittest/TlsTest.cpp:1098: Skipped

[  SKIPPED ] TlsTest.HandshakeResumptionClientDisabled (0 ms)
[ RUN      ] TlsTest.HandshakeResumptionServerDisabled
/root/msquic/src/platform/unittest/TlsTest.cpp:1114: Skipped

[  SKIPPED ] TlsTest.HandshakeResumptionServerDisabled (0 ms)
[ RUN      ] TlsTest.HandshakeMultiAlpnServer
/root/msquic/src/platform/unittest/TlsTest.cpp:1143: Skipped

[  SKIPPED ] TlsTest.HandshakeMultiAlpnServer (0 ms)
[ RUN      ] TlsTest.HandshakeMultiAlpnClient
/root/msquic/src/platform/unittest/TlsTest.cpp:1153: Skipped

[  SKIPPED ] TlsTest.HandshakeMultiAlpnClient (0 ms)
[ RUN      ] TlsTest.HandshakeMultiAlpnBoth
/root/msquic/src/platform/unittest/TlsTest.cpp:1163: Skipped

[  SKIPPED ] TlsTest.HandshakeMultiAlpnBoth (0 ms)
[ RUN      ] TlsTest.HandshakeFragmented
/root/msquic/src/platform/unittest/TlsTest.cpp:1173: Skipped

[  SKIPPED ] TlsTest.HandshakeFragmented (0 ms)
[ RUN      ] TlsTest.HandshakeVeryFragmented
/root/msquic/src/platform/unittest/TlsTest.cpp:1183: Skipped

[  SKIPPED ] TlsTest.HandshakeVeryFragmented (0 ms)
[ RUN      ] TlsTest.HandshakesSerial
/root/msquic/src/platform/unittest/TlsTest.cpp:1193: Skipped

[  SKIPPED ] TlsTest.HandshakesSerial (0 ms)
[ RUN      ] TlsTest.HandshakesInterleaved
/root/msquic/src/platform/unittest/TlsTest.cpp:1211: Skipped

[  SKIPPED ] TlsTest.HandshakesInterleaved (0 ms)
[ RUN      ] TlsTest.CertificateError
/root/msquic/src/platform/unittest/TlsTest.cpp:1252: Skipped

[  SKIPPED ] TlsTest.CertificateError (0 ms)
[ RUN      ] TlsTest.DeferredCertificateValidationAllow
/root/msquic/src/platform/unittest/TlsTest.cpp:1275: Skipped

[  SKIPPED ] TlsTest.DeferredCertificateValidationAllow (0 ms)
[ RUN      ] TlsTest.DeferredCertificateValidationReject
/root/msquic/src/platform/unittest/TlsTest.cpp:1304: Skipped

[  SKIPPED ] TlsTest.DeferredCertificateValidationReject (0 ms)
[ RUN      ] TlsTest.CustomCertificateValidationAllow
/root/msquic/src/platform/unittest/TlsTest.cpp:1328: Skipped

[  SKIPPED ] TlsTest.CustomCertificateValidationAllow (0 ms)
[ RUN      ] TlsTest.CustomCertificateValidationReject
/root/msquic/src/platform/unittest/TlsTest.cpp:1351: Skipped

[  SKIPPED ] TlsTest.CustomCertificateValidationReject (0 ms)
[ RUN      ] TlsTest.CustomCertificateValidationServerIndicate
/root/msquic/src/platform/unittest/TlsTest.cpp:1376: Skipped

[  SKIPPED ] TlsTest.CustomCertificateValidationServerIndicate (0 ms)
[ RUN      ] TlsTest.ExtraCertificateValidation
/root/msquic/src/platform/unittest/TlsTest.cpp:1387: Skipped

[  SKIPPED ] TlsTest.ExtraCertificateValidation (0 ms)
[ RUN      ] TlsTest.PortableCertificateValidation
/root/msquic/src/platform/unittest/TlsTest.cpp:1413: Skipped

[  SKIPPED ] TlsTest.PortableCertificateValidation (0 ms)
[ RUN      ] TlsTest.LockPerfTest
/root/msquic/src/platform/unittest/TlsTest.cpp:1692: Skipped

[  SKIPPED ] TlsTest.LockPerfTest (0 ms)
[ RUN      ] TlsTest.ClientCertificateFailValidation
/root/msquic/src/platform/unittest/TlsTest.cpp:1721: Skipped

[  SKIPPED ] TlsTest.ClientCertificateFailValidation (0 ms)
[ RUN      ] TlsTest.ClientCertificateDeferValidation
/root/msquic/src/platform/unittest/TlsTest.cpp:1732: Skipped

[  SKIPPED ] TlsTest.ClientCertificateDeferValidation (0 ms)
[ RUN      ] TlsTest.CipherSuiteSuccess1
/root/msquic/src/platform/unittest/TlsTest.cpp:1747: Skipped

[  SKIPPED ] TlsTest.CipherSuiteSuccess1 (0 ms)
[ RUN      ] TlsTest.CipherSuiteSuccess2
/root/msquic/src/platform/unittest/TlsTest.cpp:1762: Skipped

[  SKIPPED ] TlsTest.CipherSuiteSuccess2 (0 ms)
[ RUN      ] TlsTest.CipherSuiteSuccess3
/root/msquic/src/platform/unittest/TlsTest.cpp:1778: Skipped

[  SKIPPED ] TlsTest.CipherSuiteSuccess3 (0 ms)
[ RUN      ] TlsTest.CipherSuiteMismatch
/root/msquic/src/platform/unittest/TlsTest.cpp:1796: Skipped

[  SKIPPED ] TlsTest.CipherSuiteMismatch (0 ms)
[ RUN      ] TlsTest.CipherSuiteInvalid
/root/msquic/src/platform/unittest/TlsTest.cpp:1819: Skipped

[  SKIPPED ] TlsTest.CipherSuiteInvalid (0 ms)
[ RUN      ] TlsTest.PlatformSpecificFlagsSchannel
/root/msquic/src/platform/unittest/TlsTest.cpp:1916: Skipped

[  SKIPPED ] TlsTest.PlatformSpecificFlagsSchannel (0 ms)
[ RUN      ] TlsTest.PlatformSpecificFlagsOpenSsl
/root/msquic/src/platform/unittest/TlsTest.cpp:2007: Skipped

[  SKIPPED ] TlsTest.PlatformSpecificFlagsOpenSsl (0 ms)
[ RUN      ] TlsTest.PortableCertFlags
/root/msquic/src/platform/unittest/TlsTest.cpp:2071: Skipped

[  SKIPPED ] TlsTest.PortableCertFlags (0 ms)
Segmentation fault (core dumped)

[nibanks]

After looking at the code, this seems to be because you're not invoking the tests via tests.ps1. The test code assumes a particular argument that the PowerShell script generates. The easiest way forward will be to install PowerShell and call the tests that way.

[nibanks]

For comparison, here's the latest run on Ubuntu with OpenSSL in our CI: https://dev.azure.com/ms/msquic/_build/results?buildId=264906&view=logs&j=358fb670-07e5-5f9a-d283-d837feb19209&t=e511c6c5-b9b6-5330-ae54-83dcd7e01e67

[nibanks]

For the algorithm names, let's start a new discussion for that.

[baentsch]

No, lots of failures are not expected. Can you share the details to what is failing?

How can I do this best? I've got lots of output on my console and a huge directory of results. Can I grep for failure or the like? This is the last lines of the test run:

[...]
Initializing for User Mode tests
[----------] 1 test from Misc/WithDatagramNegotiationArgs
[ RUN      ] Misc/WithDatagramNegotiationArgs.DatagramNegotiation/3
/root/msquic/src/test/lib/TestConnection.cpp:775: Failure
Unexpected transport Close Error, expected=0x0, actual=0x63
/root/msquic/src/test/lib/DatagramTest.cpp:101: Failure
Client.GetIsConnected() not true
[  FAILED  ] Misc/WithDatagramNegotiationArgs.DatagramNegotiation/3, where GetParam() = v6/DatagramReceiveEnabled (3 ms)
[----------] 1 test from Misc/WithDatagramNegotiationArgs (3 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (131 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] Misc/WithDatagramNegotiationArgs.DatagramNegotiation/3, where GetParam() = v6/DatagramReceiveEnabled

 1 FAILED TEST

[01/26/2022 19:01:42] 2330 test(s) run.                                                                                 
[01/26/2022 19:01:42] Output can be found in /root/msquic/artifacts/logs/msquictest/01.26.2022.18.07.31                 
Write-Error: 1353 test(s) failed.                                                                       

For the algorithm names, let's start a new discussion for that.

Will do as and when necessary. Thanks.

[thhous-msft]

0x63 means bind() failed. You don't have IPv6 disabled, right? msquic does not work correctly if IPv6 is disabled.

[baentsch]

You don't have IPv6 disabled, right? msquic does not work correctly if IPv6 is disabled.

Not on my host -- but the docker image I'm running this in has v6 disabled for some reason (need to understand that...). But then things are explained. Consider this question fully dealt with then: Thanks!