-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[tests] Apple mobile test coverage improvements #84254
Comments
Tagging subscribers to 'os-ios': @steveisok, @akoeplinger Issue DetailsDescriptionThis issue aims to expand the coverage of iOS runtime tests and improve the build process. Expand runtime tests coverage on iOSCurrently, only Parallel AOT compilationTo improve build time, the AOT compilation could be moved to Helix and executed simultaneously before the test execution. Additionally, unifying AOT compilation in one target would improve code maintenance as several targets use Split build and test executionTo mitigate various transient issues, build and test execution could be divided into separate steps. The test build should build the repository, create tests, and zip artifacts (as done in Tasks
|
@steveisok I think you mentioned once this may not be a good approach. My assumption is that it may reduce costs and development time in cases when transient issues occur. What could be the potential downsides of such an approach? Are there some bottlenecks? |
Description
This issue lists improvements in Apple mobile infrastructure and test coverage. The tasks are categorized into four main areas: test coverage, reliability, scalability, and monitoring.
Expand runtime tests coverage
The primary goal is to align test coverage with the production environments, ensuring validation across all scenarios. Currently, only legacy runtime tests are executed on Apple mobile platforms using the interpreter, with a subset of smoke tests executed with Native AOT. The library and functional tests utilize the Mono AOT compiler. List of tasks:
Microsoft.NET.Sdk.props
and with itMicrosoft.NETCoreSdk.BundledVersions.props
which definesNETCoreSdkPortableRuntimeIdentifier
Scalability
The primary goal is to improve the overall test build and execution speed. List of tasks:
Reliability
The primary goal is to establish a stable infrastructure environment for test execution. List of tasks:
publish
folder for different builds tasks - see commentMonitoring
The primary goal of monitoring should be enabling effective triage of active issues and tracking the reliability of tests and infrastructure over time. A list of tasks will be added.
The text was updated successfully, but these errors were encountered: