Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add integration tests to the CI #1537

Merged
merged 13 commits into from
Aug 1, 2022
Merged

Conversation

manuroe
Copy link
Contributor

@manuroe manuroe commented Jul 27, 2022

This PR brings a new test plan called AllWorkingTests where 482 out of 805 tests are disabled because:

We will be able to re-enable those tests later but let's start with a stable and working subset.

The main change is the tests code is to ensure that all MXSessions are closed at the end of each test. Else, we have this assert. FTR, this assert avoids to avoid remaining running MXSessions that slow down the tests to the death.

The coverage jumped to 51.2%:

image

@codecov-commenter
Copy link

codecov-commenter commented Jul 28, 2022

Codecov Report

Merging #1537 (db9114b) into develop (840771e) will increase coverage by 39.19%.
The diff coverage is 77.27%.

@@             Coverage Diff              @@
##           develop    #1537       +/-   ##
============================================
+ Coverage    12.03%   51.23%   +39.19%     
============================================
  Files          514      514               
  Lines        83966    83952       -14     
  Branches     35849    37412     +1563     
============================================
+ Hits         10105    43011    +32906     
+ Misses       73493    39837    -33656     
- Partials       368     1104      +736     
Impacted Files Coverage Δ
MatrixSDK/Data/Store/MXMemoryStore/MXMemoryStore.m 66.66% <0.00%> (+44.92%) ⬆️
MatrixSDKTests/MXAsyncTaskQueueUnitTests.swift 100.00% <ø> (ø)
...rixSDKTests/MXAuthenticationSessionUnitTests.swift 81.31% <ø> (-1.16%) ⬇️
MatrixSDKTests/MXCryptoRecoveryServiceTests.m 0.00% <0.00%> (ø)
MatrixSDKTests/MXEventAnnotationUnitTests.swift 96.29% <ø> (-0.26%) ⬇️
MatrixSDKTests/MXEventReferenceUnitTests.swift 96.22% <ø> (-0.27%) ⬇️
MatrixSDKTests/MXHTTPClientTests.m 65.78% <ø> (+65.78%) ⬆️
MatrixSDKTests/MXLazyLoadingTests.m 0.00% <0.00%> (ø)
MatrixSDKTests/MXLocationServiceTests.swift 0.00% <0.00%> (ø)
MatrixSDKTests/MXMegolmExportEncryptionUnitTests.m 100.00% <ø> (ø)
... and 307 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 840771e...db9114b. Read the comment docs.

@manuroe manuroe requested review from a team and stefanceriu and removed request for a team July 28, 2022 10:00
Copy link
Contributor

@stefanceriu stefanceriu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one small comment re the github runner, otherwise lgtm 👍

jobs:
integration-tests:
name: Integration Tests
runs-on: macos-11
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Element is using macos-12. We can start using that in the SDK as well but it's probably best done as a separate PR.

@manuroe manuroe merged commit 93670ea into develop Aug 1, 2022
@manuroe manuroe deleted the manu/working_integration_test_plan branch August 1, 2022 12:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants