You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ci: [1.X] CI failures fixes and disabled tests Jira tracking informations (#3303)
This PR addresses some test failures in new CI definition (present on
develop-2.0.0 branch)
1. **Code Coverage test failure** --> This test was failing because
packed package couldn't be find. This steams from the fact that the path
was wrongly pointing to different place because package pack job was
modified to fix it.
2. **minimalproject standards failure** --> We were focusing before on
making sure that testproject is conforming to standards (which also
means that NGO package conforms to standards) but minimalproject has few
errors which we aim to fix in this PR
3. **testproject-tools-integration standards failure** --> We were
focusing before on making sure that testproject is conforming to
standards (which also means that NGO package conforms to standards) but
testproject-tools-integration has few errors which we aim to fix in this
PR
4. **testproject standards test on 2021 editor** --> it seems to be only
2021 specific. For now this configuration was disabled and added for
tracking
5. **Standalone builds which use combination of ubuntu and 2021 editor**
--> Error that happens is "No usable version of libssl". The temporary
solution is to drop usage of this combination with reasons being that we
still have a coverage with ubuntu on all other editors, we still have
coverage of 2021 editor with win and mac and that the 2021 editor will
soon be out of support
7. **Android test failures on older editors** --> I'm going to
investigate and if those are specific tests (and not infrastructure)
then I will disable them for now since my next step after making this CI
green will be to investigate all disabled tests and fix them.
8. **iOS test failures 2021 specific** --> I'm going to investigate and
if those are specific tests (and not infrastructure) then I will disable
them for now since my next step after making this CI green will be to
investigate all disabled tests and fix them
9. **Consoles build failures on 2023 editor** --> Seems to be specific
to 2023 editor, the errors are for example "Exception: The required GDK
is not installed". I will disable console tests for 2023 editor
temporarily and add it to my list to fix together with other disabled
tests
---------
Co-authored-by: Noel Stephens <noel.stephens@unity3d.com>
# There is an error 'No usable version of libssl' when it comes to building with combination of ubuntu and 2021 editor. It's not really worth to address it since
134
+
# 1) The 2021 editor will soon be out of support
135
+
# 2) We still have the same coverage by using mac and ubuntu is used in a whole bunch of different tests, so I'm quite sure it won't lead to any bug leaks
136
+
# 3) The solution could be to manually install libss1.1 (since image has libssl3 and this causes conflicts on 2021 editor related to dotnet versions and support). There were several threads on this topic which can be looked on
137
+
{% if editor != "2021.3" or platform.name != "ubuntu" %}
# There is an error 'No usable version of libssl' when it comes to building with combination of ubuntu and 2021 editor. It's not really worth to address it since
168
+
# 1) The 2021 editor will soon be out of support
169
+
# 2) We still have the same coverage by using mac and ubuntu is used in a whole bunch of different tests, so I'm quite sure it won't lead to any bug leaks
170
+
# 3) The solution could be to manually install libss1.1 (since image has libssl3 and this causes conflicts on 2021 editor related to dotnet versions and support). There were several threads on this topic which can be looked on
{% for platform in test_platforms.console_test -%}
208
220
{% for editor in validation_editors.all -%}
221
+
# When building consoles with 2023 editor there are errors related to SDK version or uninstalled components. I will disable those for now and will add to my investigation list
Copy file name to clipboardexpand all lines: .yamato/console-standalone-test.yml
+6
Original file line number
Diff line number
Diff line change
@@ -15,6 +15,8 @@
15
15
{% for project in projects.default -%}
16
16
{% for platform in test_platforms.console_build -%}
17
17
{% for editor in validation_editors.all -%}
18
+
# When building consoles with 2023 editor there are errors related to SDK version or uninstalled components. I will disable those for now and will add to my investigation list
{% for platform in test_platforms.console_test -%}
59
62
{% for editor in validation_editors.all -%}
63
+
# When building consoles with 2023 editor there are errors related to SDK version or uninstalled components. I will disable those for now and will add to my investigation list
Copy file name to clipboardexpand all lines: .yamato/desktop-standalone-tests.yml
+12
Original file line number
Diff line number
Diff line change
@@ -13,6 +13,11 @@
13
13
{% for platform in test_platforms.desktop -%}
14
14
{% for editor in validation_editors.all -%}
15
15
{% for backend in scripting_backends -%}
16
+
# There is an error 'No usable version of libssl' when it comes to building with combination of ubuntu and 2021 editor. It's not really worth to address it since
17
+
# 1) The 2021 editor will soon be out of support
18
+
# 2) We still have the same coverage by using mac and ubuntu is used in a whole bunch of different tests, so I'm quite sure it won't lead to any bug leaks
19
+
# 3) The solution could be to manually install libss1.1 (since image has libssl3 and this causes conflicts on 2021 editor related to dotnet versions and support). There were several threads on this topic which can be looked on
20
+
{% if editor != "2021.3" or platform.name != "ubuntu" %}
# There is an error 'No usable version of libssl' when it comes to building with combination of ubuntu and 2021 editor. It's not really worth to address it since
80
+
# 1) The 2021 editor will soon be out of support
81
+
# 2) We still have the same coverage by using mac and ubuntu is used in a whole bunch of different tests, so I'm quite sure it won't lead to any bug leaks
82
+
# 3) The solution could be to manually install libss1.1 (since image has libssl3 and this causes conflicts on 2021 editor related to dotnet versions and support). There were several threads on this topic which can be looked on
83
+
{% if editor != "2021.3" or platform.name != "ubuntu" %}
# This is in essence the same job as the one above with the difference that upm-ci is used instead of upm-pvp
31
+
# The reason for using it is that I had some problems with Code Coverage which in its current form uses upm-ci but if we would use the other pack job (the one above) we would need to use upm-pvp
32
+
# I had some problems with getting it to work so as temporary solution I created this pack job which is used ONLY as a dependency of Code Coverage job (other jobs use the above definition of pack job)
33
+
# TODO: remove this job and utilize the above one for Code Coverage job. This is tracked in MTT-11383
Copy file name to clipboardexpand all lines: com.unity.netcode.gameobjects/Tests/Editor/Metrics/NetworkMetricsRegistrationTests.cs
+1-1
Original file line number
Diff line number
Diff line change
@@ -16,7 +16,7 @@ public class NetworkMetricsRegistrationTests
16
16
.ToArray();
17
17
18
18
[TestCaseSource(nameof(s_MetricTypes))]
19
-
[Ignore("Disable test while we reevaluate the assumption that INetworkMetricEvent interfaces must be reported from MLAPI.")]
19
+
[Ignore("Disable test while we reevaluate the assumption that INetworkMetricEvent interfaces must be reported from MLAPI. This is tracked in MTT-11339")]
Copy file name to clipboardexpand all lines: com.unity.netcode.gameobjects/Tests/Runtime/NetworkVariableTests.cs
+5-4
Original file line number
Diff line number
Diff line change
@@ -1844,6 +1844,7 @@ public void WhenSerializingAndDeserializingValueTypeNetworkVariables_ValuesAreSe
1844
1844
}
1845
1845
1846
1846
[Test]
1847
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356. The job is failing on mobile devices on 2021 editor specifically
@@ -2179,7 +2180,7 @@ public string ArrayStr<T>(NativeArray<T> arr) where T : unmanaged
2179
2180
}
2180
2181
2181
2182
[Test]
2182
-
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// I will add this test to track in Jira as next step (after having working CI in place). The job is failing on iOS
2183
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356.
@@ -2645,7 +2646,7 @@ public string DictionaryStr<TKey, TVal>(Dictionary<TKey, TVal> list)
2645
2646
}
2646
2647
2647
2648
[Test]
2648
-
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// I will add this test to track in Jira as next step (after having working CI in place). The job is failing on iOS
2649
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356.
@@ -2832,7 +2833,7 @@ public void WhenSerializingAndDeserializingVeryLargeListNetworkVariables_ValuesA
2832
2833
}
2833
2834
2834
2835
[Test]
2835
-
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// I will add this test to track in Jira as next step (after having working CI in place). The job is failing on iOS
2836
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356.
@@ -2988,7 +2989,7 @@ public void WhenSerializingAndDeserializingVeryLargeHashSetNetworkVariables_Valu
2988
2989
}
2989
2990
2990
2991
[Test]
2991
-
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// I will add this test to track in Jira as next step (after having working CI in place). The job is unstable on mobile devices
2992
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356.
Copy file name to clipboardexpand all lines: com.unity.netcode.gameobjects/Tests/Runtime/RpcTypeSerializationTests.cs
+2
Original file line number
Diff line number
Diff line change
@@ -4,6 +4,7 @@
4
4
usingUnity.Collections;
5
5
usingUnity.Netcode.TestHelpers.Runtime;
6
6
usingUnityEngine;
7
+
usingUnityEngine.TestTools;
7
8
usingQuaternion=UnityEngine.Quaternion;
8
9
usingVector2=UnityEngine.Vector2;
9
10
usingVector3=UnityEngine.Vector3;
@@ -1503,6 +1504,7 @@ public void WhenSendingAnArrayOfValueTypesOverAnRpc_ValuesAreSerializedCorrectly
1503
1504
}
1504
1505
1505
1506
[Test]
1507
+
[UnityPlatform(exclude=new[]{RuntimePlatform.Android,RuntimePlatform.IPhonePlayer})]// Tracked in MTT-11356. The job is failing on mobile devices on 2021 editor specifically
0 commit comments