Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve test benchmarks and update validation logic #107

Merged
merged 45 commits into from
Mar 28, 2024

Conversation

SmetDenis
Copy link
Member

@SmetDenis SmetDenis commented Mar 28, 2024

An overhaul of the test benchmarks was conducted and various csv test files were generated. Also, updated the ValidationCsv logic in handling aggregation rules and optimizing validation conditions. Modifying the logic resulted in time and memory optimization for the CSV Validator.

@coveralls
Copy link

coveralls commented Mar 28, 2024

Pull Request Test Coverage Report for Build 8475123560

Details

  • 80 of 87 (91.95%) changed or added relevant lines in 33 files are covered.
  • 1 unchanged line in 1 file lost coverage.
  • Overall coverage increased (+0.2%) to 96.36%

Changes Missing Coverage Covered Lines Changed/Added Lines %
src/Commands/ValidateCsv.php 9 10 90.0%
src/Rules/AbstarctRule.php 4 5 80.0%
src/Validators/ValidatorColumn.php 3 4 75.0%
src/Validators/ValidatorCsv.php 20 21 95.24%
src/Utils.php 5 8 62.5%
Files with Coverage Reduction New Missed Lines %
src/Validators/ValidatorCsv.php 1 94.78%
Totals Coverage Status
Change from base Build 8460344009: 0.2%
Covered Lines: 2462
Relevant Lines: 2555

💛 - Coveralls

An overhaul of the test benchmarks was conducted and various csv test files were generated. Also, updated the ValidationCsv logic in handling aggregation rules and optimizing validation conditions. Modifying the logic resulted in time and memory optimization for the CSV Validator.
The PHP setup block was removed from the GitHub Actions main workflow file as it is no longer needed. The creation of Docker images was enabled by uncommenting the respective code block. Furthermore, the command for running benchmarks was updated to use Docker instead of PHP directly. This modification will simplify the workflow and enhance its efficiency.
The PHP setup block was removed from the GitHub Actions main workflow file as it is no longer needed. The creation of Docker images was enabled by uncommenting the respective code block. Furthermore, the command for running benchmarks was updated to use Docker instead of PHP directly. This modification will simplify the workflow and enhance its efficiency.
@SmetDenis SmetDenis changed the title Test Improve test benchmarks and update validation logic Mar 28, 2024
The PHP setup block was removed from the GitHub Actions main workflow file as it is no longer needed. The creation of Docker images was enabled by uncommenting the respective code block. Furthermore, the command for running benchmarks was updated to use Docker instead of PHP directly. This modification will simplify the workflow and enhance its efficiency.
The PHP setup block was removed from the GitHub Actions main workflow file as it is no longer needed. The creation of Docker images was enabled by uncommenting the respective code block. Furthermore, the command for running benchmarks was updated to use Docker instead of PHP directly. This modification will simplify the workflow and enhance its efficiency.
Performance of CSV validation code was improved by modifying the debug option and marking the ComboInterquartileMean as a slow operation. Additionally, a benchmark test was renamed for consistency and the 'interquartile_mean' was disabled due to poor performance. The non-required 'benchmark-7-max-header.yml' file was deleted to clean up the code base.
Adjusted the CSV validation process for better performance by optimizing the debug option and marking ComboInterquartileMean as a slow operation. Renamed benchmark test for consistency, and disabled the 'interquartile_mean' due to performance issues. Removed the 'benchmark-7-max-header.yml' file which was not required, ultimately cleaning the codebase.
Adjusted the CSV validation process for better performance by optimizing the debug option and marking ComboInterquartileMean as a slow operation. Renamed benchmark test for consistency, and disabled the 'interquartile_mean' due to performance issues. Removed the 'benchmark-7-max-header.yml' file which was not required, ultimately cleaning the codebase.
Adjusted the CSV validation process for better performance by optimizing the debug option and marking ComboInterquartileMean as a slow operation. Renamed benchmark test for consistency, and disabled the 'interquartile_mean' due to performance issues. Removed the 'benchmark-7-max-header.yml' file which was not required, ultimately cleaning the codebase.
Renamed 'release-docker.yml' to 'publish.yml' and combined the functionality of 'release-phar.yml', which has now been deleted, into one unified GitHub Actions workflow. Also updated the debugging text in 'ComboCountZero.php' to improve readability and adjusted the badge's referenced file path in 'PackageTest.php'.
Renamed 'release-docker.yml' to 'publish.yml' and combined the functionality of 'release-phar.yml', which has now been deleted, into one unified GitHub Actions workflow. Also updated the debugging text in 'ComboCountZero.php' to improve readability and adjusted the badge's referenced file path in 'PackageTest.php'.
@SmetDenis SmetDenis merged commit ca96491 into master Mar 28, 2024
10 checks passed
@SmetDenis SmetDenis deleted the readme-benchmarks branch March 28, 2024 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants