Skip to content

ci: Add INFO level notices to acceptance tests#2148

Merged
davidgamez merged 3 commits intomasterfrom
acceptance_tests_info
Apr 29, 2026
Merged

ci: Add INFO level notices to acceptance tests#2148
davidgamez merged 3 commits intomasterfrom
acceptance_tests_info

Conversation

@davidgamez
Copy link
Copy Markdown
Member

@davidgamez davidgamez commented Apr 28, 2026

Summary:

Closes #1962

Add INFO notices to the acceptance summary.

Expected behavior:

The INFO notices should be visible in the acceptance tests comparison.

Please make sure these boxes are checked before submitting your pull request - thanks!

  • Run the unit tests with gradle test to make sure you didn't break anything
  • Add or update any needed documentation to the repo
  • Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
  • Linked all relevant issues
  • Include screenshot(s) showing how this pull request works and fixes the issue(s)

@github-actions
Copy link
Copy Markdown
Contributor

📝 Acceptance Test Report

📋 Summary

❌ The rule acceptance test has failed for commit ad921dc
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

New Info Notices (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Info Notices (257 out of 1001 datasets, ~26%) ❌

Details of new errors due to code change, which is above the provided threshold of 1%.

Dataset Notice Code
mdb-1009 trip_headsign_matches_intermediate_stop
mdb-1021 trip_headsign_matches_intermediate_stop
mdb-1022 trip_headsign_matches_intermediate_stop
mdb-1027 trip_headsign_matches_intermediate_stop
mdb-1031 trip_headsign_matches_intermediate_stop
mdb-1041 trip_headsign_matches_intermediate_stop
mdb-1042 trip_headsign_matches_intermediate_stop
mdb-1043 trip_headsign_matches_intermediate_stop
mdb-1044 trip_headsign_matches_intermediate_stop
mdb-1059 trip_headsign_matches_intermediate_stop
mdb-106 trip_headsign_matches_intermediate_stop
mdb-1062 trip_headsign_matches_intermediate_stop
mdb-1063 trip_headsign_matches_intermediate_stop
mdb-1066 trip_headsign_matches_intermediate_stop
mdb-1071 trip_headsign_matches_intermediate_stop
mdb-1077 trip_headsign_matches_intermediate_stop
mdb-1082 trip_headsign_matches_intermediate_stop
mdb-1085 trip_headsign_matches_intermediate_stop
mdb-1088 trip_headsign_matches_intermediate_stop
mdb-1094 trip_headsign_matches_intermediate_stop
mdb-1095 trip_headsign_matches_intermediate_stop
mdb-11 trip_headsign_matches_intermediate_stop
mdb-1103 trip_headsign_matches_intermediate_stop
mdb-1108 trip_headsign_matches_intermediate_stop
mdb-1120 trip_headsign_matches_intermediate_stop
mdb-1127 trip_headsign_matches_intermediate_stop
mdb-1144 trip_headsign_matches_intermediate_stop
mdb-1146 trip_headsign_matches_intermediate_stop
mdb-1151 trip_headsign_matches_intermediate_stop
mdb-1154 trip_headsign_matches_intermediate_stop
mdb-1161 trip_headsign_matches_intermediate_stop
mdb-1172 trip_headsign_matches_intermediate_stop
mdb-1176 trip_headsign_matches_intermediate_stop
mdb-1194 trip_headsign_matches_intermediate_stop
mdb-1199 trip_headsign_matches_intermediate_stop
mdb-1224 trip_headsign_matches_intermediate_stop
mdb-1227 trip_headsign_matches_intermediate_stop
mdb-1270 trip_headsign_matches_intermediate_stop
mdb-1271 trip_headsign_matches_intermediate_stop
mdb-1272 trip_headsign_matches_intermediate_stop
mdb-1273 trip_headsign_matches_intermediate_stop
mdb-1292 trip_headsign_matches_intermediate_stop
mdb-1294 trip_headsign_matches_intermediate_stop
mdb-1326 trip_headsign_matches_intermediate_stop
mdb-1791 trip_headsign_matches_intermediate_stop
mdb-1812 trip_headsign_matches_intermediate_stop
mdb-1815 trip_headsign_matches_intermediate_stop
mdb-1816 trip_headsign_matches_intermediate_stop
mdb-1825 trip_headsign_matches_intermediate_stop
mdb-1829 trip_headsign_matches_intermediate_stop
mdb-1831 trip_headsign_matches_intermediate_stop
mdb-1832 trip_headsign_matches_intermediate_stop
mdb-1833 trip_headsign_matches_intermediate_stop
mdb-1834 trip_headsign_matches_intermediate_stop
mdb-1835 trip_headsign_matches_intermediate_stop
mdb-1859 trip_headsign_matches_intermediate_stop
mdb-1898 trip_headsign_matches_intermediate_stop
mdb-1903 trip_headsign_matches_intermediate_stop
mdb-1909 trip_headsign_matches_intermediate_stop
mdb-1915 trip_headsign_matches_intermediate_stop
mdb-1918 trip_headsign_matches_intermediate_stop
mdb-1919 trip_headsign_matches_intermediate_stop
mdb-1927 trip_headsign_matches_intermediate_stop
mdb-1928 trip_headsign_matches_intermediate_stop
mdb-1929 trip_headsign_matches_intermediate_stop
mdb-1930 trip_headsign_matches_intermediate_stop
mdb-1931 trip_headsign_matches_intermediate_stop
mdb-1933 trip_headsign_matches_intermediate_stop
mdb-1934 trip_headsign_matches_intermediate_stop
mdb-1935 trip_headsign_matches_intermediate_stop
mdb-1938 trip_headsign_matches_intermediate_stop
mdb-1939 trip_headsign_matches_intermediate_stop
mdb-1940 trip_headsign_matches_intermediate_stop
mdb-1941 trip_headsign_matches_intermediate_stop
mdb-1942 trip_headsign_matches_intermediate_stop
mdb-1944 trip_headsign_matches_intermediate_stop
mdb-1945 trip_headsign_matches_intermediate_stop
mdb-1948 trip_headsign_matches_intermediate_stop
mdb-1949 trip_headsign_matches_intermediate_stop
mdb-1951 trip_headsign_matches_intermediate_stop
mdb-1952 trip_headsign_matches_intermediate_stop
mdb-1953 trip_headsign_matches_intermediate_stop
mdb-1956 trip_headsign_matches_intermediate_stop
mdb-1957 trip_headsign_matches_intermediate_stop
mdb-2002 trip_headsign_matches_intermediate_stop
mdb-2008 trip_headsign_matches_intermediate_stop
mdb-2015 trip_headsign_matches_intermediate_stop
mdb-2027 trip_headsign_matches_intermediate_stop
mdb-2078 trip_headsign_matches_intermediate_stop
mdb-2079 trip_headsign_matches_intermediate_stop
mdb-2086 trip_headsign_matches_intermediate_stop
mdb-2087 trip_headsign_matches_intermediate_stop
mdb-2089 trip_headsign_matches_intermediate_stop
mdb-2090 trip_headsign_matches_intermediate_stop
mdb-2092 trip_headsign_matches_intermediate_stop
mdb-2094 trip_headsign_matches_intermediate_stop
mdb-2098 trip_headsign_matches_intermediate_stop
mdb-2101 trip_headsign_matches_intermediate_stop
mdb-2106 trip_headsign_matches_intermediate_stop
mdb-2108 trip_headsign_matches_intermediate_stop
mdb-2115 trip_headsign_matches_intermediate_stop
mdb-2116 trip_headsign_matches_intermediate_stop
mdb-2135 trip_headsign_matches_intermediate_stop
mdb-2148 trip_headsign_matches_intermediate_stop
mdb-2155 trip_headsign_matches_intermediate_stop
mdb-220 trip_headsign_matches_intermediate_stop
mdb-2212 trip_headsign_matches_intermediate_stop
mdb-228 trip_headsign_matches_intermediate_stop
mdb-2333 trip_headsign_matches_intermediate_stop
mdb-2337 trip_headsign_matches_intermediate_stop
mdb-2341 trip_headsign_matches_intermediate_stop
mdb-2345 trip_headsign_matches_intermediate_stop
mdb-2353 trip_headsign_matches_intermediate_stop
mdb-2359 trip_headsign_matches_intermediate_stop
mdb-2364 trip_headsign_matches_intermediate_stop
mdb-2366 trip_headsign_matches_intermediate_stop
mdb-2373 trip_headsign_matches_intermediate_stop
mdb-2385 trip_headsign_matches_intermediate_stop
mdb-2387 trip_headsign_matches_intermediate_stop
mdb-2393 trip_headsign_matches_intermediate_stop
mdb-2399 trip_headsign_matches_intermediate_stop
mdb-2417 trip_headsign_matches_intermediate_stop
mdb-2449 trip_headsign_matches_intermediate_stop
mdb-2455 trip_headsign_matches_intermediate_stop
mdb-2461 trip_headsign_matches_intermediate_stop
mdb-2508 trip_headsign_matches_intermediate_stop
mdb-2519 trip_headsign_matches_intermediate_stop
mdb-2579 trip_headsign_matches_intermediate_stop
mdb-2595 trip_headsign_matches_intermediate_stop
mdb-2598 trip_headsign_matches_intermediate_stop
mdb-2635 trip_headsign_matches_intermediate_stop
mdb-2636 trip_headsign_matches_intermediate_stop
mdb-2639 trip_headsign_matches_intermediate_stop
mdb-2651 trip_headsign_matches_intermediate_stop
mdb-2661 trip_headsign_matches_intermediate_stop
mdb-2666 trip_headsign_matches_intermediate_stop
mdb-2682 trip_headsign_matches_intermediate_stop
mdb-2688 trip_headsign_matches_intermediate_stop
mdb-2689 trip_headsign_matches_intermediate_stop
mdb-2713 trip_headsign_matches_intermediate_stop
mdb-2751 trip_headsign_matches_intermediate_stop
mdb-2762 trip_headsign_matches_intermediate_stop
mdb-2764 trip_headsign_matches_intermediate_stop
mdb-2765 trip_headsign_matches_intermediate_stop
mdb-2771 trip_headsign_matches_intermediate_stop
mdb-2772 trip_headsign_matches_intermediate_stop
mdb-2773 trip_headsign_matches_intermediate_stop
mdb-2774 trip_headsign_matches_intermediate_stop
mdb-2777 trip_headsign_matches_intermediate_stop
mdb-2786 trip_headsign_matches_intermediate_stop
mdb-2790 trip_headsign_matches_intermediate_stop
mdb-2792 trip_headsign_matches_intermediate_stop
mdb-2795 trip_headsign_matches_intermediate_stop
mdb-2798 trip_headsign_matches_intermediate_stop
mdb-28 trip_headsign_matches_intermediate_stop
mdb-2802 trip_headsign_matches_intermediate_stop
mdb-2804 trip_headsign_matches_intermediate_stop
mdb-2818 trip_headsign_matches_intermediate_stop
mdb-2819 trip_headsign_matches_intermediate_stop
mdb-2820 trip_headsign_matches_intermediate_stop
mdb-2821 trip_headsign_matches_intermediate_stop
mdb-2822 trip_headsign_matches_intermediate_stop
mdb-2824 trip_headsign_matches_intermediate_stop
mdb-2825 trip_headsign_matches_intermediate_stop
mdb-2826 trip_headsign_matches_intermediate_stop
mdb-2832 trip_headsign_matches_intermediate_stop
mdb-2836 trip_headsign_matches_intermediate_stop
mdb-2839 trip_headsign_matches_intermediate_stop
mdb-2841 trip_headsign_matches_intermediate_stop
mdb-2848 trip_headsign_matches_intermediate_stop
mdb-2867 trip_headsign_matches_intermediate_stop
mdb-2868 trip_headsign_matches_intermediate_stop
mdb-2898 trip_headsign_matches_intermediate_stop
mdb-2899 trip_headsign_matches_intermediate_stop
mdb-2904 trip_headsign_matches_intermediate_stop
mdb-2906 trip_headsign_matches_intermediate_stop
mdb-2907 trip_headsign_matches_intermediate_stop
mdb-2908 trip_headsign_matches_intermediate_stop
mdb-2911 trip_headsign_matches_intermediate_stop
mdb-2923 trip_headsign_matches_intermediate_stop
mdb-2925 trip_headsign_matches_intermediate_stop
mdb-2933 trip_headsign_matches_intermediate_stop
mdb-2935 trip_headsign_matches_intermediate_stop
mdb-2992 trip_headsign_matches_intermediate_stop
mdb-43 trip_headsign_matches_intermediate_stop
mdb-53 trip_headsign_matches_intermediate_stop
mdb-534 trip_headsign_matches_intermediate_stop
mdb-57 trip_headsign_matches_intermediate_stop
mdb-59 trip_headsign_matches_intermediate_stop
mdb-61 trip_headsign_matches_intermediate_stop
mdb-64 trip_headsign_matches_intermediate_stop
mdb-643 trip_headsign_matches_intermediate_stop
mdb-646 trip_headsign_matches_intermediate_stop
mdb-647 trip_headsign_matches_intermediate_stop
mdb-655 trip_headsign_matches_intermediate_stop
mdb-668 trip_headsign_matches_intermediate_stop
mdb-670 trip_headsign_matches_intermediate_stop
mdb-672 trip_headsign_matches_intermediate_stop
mdb-680 trip_headsign_matches_intermediate_stop
mdb-682 trip_headsign_matches_intermediate_stop
mdb-684 trip_headsign_matches_intermediate_stop
mdb-686 trip_headsign_matches_intermediate_stop
mdb-733 trip_headsign_matches_intermediate_stop
mdb-735 trip_headsign_matches_intermediate_stop
mdb-74 trip_headsign_matches_intermediate_stop
mdb-75 trip_headsign_matches_intermediate_stop
mdb-751 trip_headsign_matches_intermediate_stop
mdb-758 trip_headsign_matches_intermediate_stop
mdb-76 trip_headsign_matches_intermediate_stop
mdb-763 trip_headsign_matches_intermediate_stop
mdb-767 trip_headsign_matches_intermediate_stop
mdb-769 trip_headsign_matches_intermediate_stop
mdb-770 trip_headsign_matches_intermediate_stop
mdb-771 trip_headsign_matches_intermediate_stop
mdb-772 trip_headsign_matches_intermediate_stop
mdb-774 trip_headsign_matches_intermediate_stop
mdb-776 trip_headsign_matches_intermediate_stop
mdb-777 trip_headsign_matches_intermediate_stop
mdb-778 trip_headsign_matches_intermediate_stop
mdb-779 trip_headsign_matches_intermediate_stop
mdb-78 trip_headsign_matches_intermediate_stop
mdb-780 trip_headsign_matches_intermediate_stop
mdb-781 trip_headsign_matches_intermediate_stop
mdb-782 trip_headsign_matches_intermediate_stop
mdb-783 trip_headsign_matches_intermediate_stop
mdb-787 trip_headsign_matches_intermediate_stop
mdb-791 trip_headsign_matches_intermediate_stop
mdb-792 trip_headsign_matches_intermediate_stop
mdb-793 trip_headsign_matches_intermediate_stop
mdb-794 trip_headsign_matches_intermediate_stop
mdb-8 trip_headsign_matches_intermediate_stop
mdb-813 trip_headsign_matches_intermediate_stop
mdb-841 trip_headsign_matches_intermediate_stop
mdb-856 trip_headsign_matches_intermediate_stop
mdb-858 trip_headsign_matches_intermediate_stop
mdb-862 trip_headsign_matches_intermediate_stop
mdb-864 trip_headsign_matches_intermediate_stop
mdb-865 trip_headsign_matches_intermediate_stop
mdb-866 trip_headsign_matches_intermediate_stop
mdb-868 trip_headsign_matches_intermediate_stop
mdb-881 trip_headsign_matches_intermediate_stop
mdb-887 trip_headsign_matches_intermediate_stop
mdb-892 trip_headsign_matches_intermediate_stop
mdb-895 trip_headsign_matches_intermediate_stop
mdb-898 trip_headsign_matches_intermediate_stop
mdb-9 trip_headsign_matches_intermediate_stop
mdb-900 trip_headsign_matches_intermediate_stop
mdb-904 trip_headsign_matches_intermediate_stop
mdb-906 trip_headsign_matches_intermediate_stop
mdb-92 trip_headsign_matches_intermediate_stop
mdb-921 trip_headsign_matches_intermediate_stop
mdb-978 trip_headsign_matches_intermediate_stop
mdb-979 trip_headsign_matches_intermediate_stop
mdb-980 trip_headsign_matches_intermediate_stop
mdb-982 trip_headsign_matches_intermediate_stop
mdb-986 trip_headsign_matches_intermediate_stop
mdb-990 trip_headsign_matches_intermediate_stop

🛡️ Corruption Check

2 out of 1003 sources (~0 %) are corrupted.
Dataset Ref Report Exists Ref Report Readable Latest Report Exists Latest Report Readable
mdb-1114
mdb-1123
🔍 System errors for mdb-1114 (reference)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1114 (latest)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1123 (reference)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1123 (latest)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]

💾 Out of Memory Check

No datasets experienced an OutOfMemoryError.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 5.58 5.89 ⬆️+0.31
Median -- 1.62 1.91 ⬆️+0.28
Standard Deviation -- 22.65 24.11 ⬆️+1.47
Minimum in References Reports mdb-299 0.48 0.51 ⬆️+0.03
Maximum in Reference Reports mdb-2014 626.39 678.59 ⬆️+52.20
Minimum in Latest Reports mdb-299 0.48 0.51 ⬆️+0.03
Maximum in Latest Reports mdb-2014 626.39 678.59 ⬆️+52.20
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 578.87 MiB 576.06 MiB ⬇️-2.81 MiB
Median -- 326.52 MiB 327.93 MiB ⬆️+1.41 MiB
Standard Deviation -- 1.03 GiB 1.00 GiB ⬇️-25.97 MiB
Minimum in References Reports mdb-79 39.82 MiB 44.43 MiB ⬆️+4.60 MiB
Maximum in Reference Reports mdb-2393 10.18 GiB 9.40 GiB ⬇️-792.98 MiB
Minimum in Latest Reports mdb-651 40.36 MiB 40.32 MiB ⬇️-36.28 KiB
Maximum in Latest Reports mdb-2393 10.18 GiB 9.40 GiB ⬇️-792.98 MiB

@github-actions
Copy link
Copy Markdown
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 431e68f
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

New Info Notices (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Info Notices (0 out of 1001 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

2 out of 1003 sources (~0 %) are corrupted.
Dataset Ref Report Exists Ref Report Readable Latest Report Exists Latest Report Readable
mdb-1114
mdb-1123
🔍 System errors for mdb-1114 (reference)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1114 (latest)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1123 (reference)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]
🔍 System errors for mdb-1123 (latest)
[
  {
    "code": "i_o_error",
    "severity": "ERROR",
    "totalNotices": 1,
    "sampleNotices": [
      {
        "exception": "java.util.zip.ZipException",
        "message": "Archive is not a ZIP archive"
      }
    ]
  }
]

💾 Out of Memory Check

No datasets experienced an OutOfMemoryError.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 5.64 5.79 ⬆️+0.14
Median -- 1.65 1.95 ⬆️+0.30
Standard Deviation -- 24.25 21.70 ⬇️-2.55
Minimum in References Reports mdb-299 0.49 0.53 ⬆️+0.04
Maximum in Reference Reports mdb-2014 686.36 591.82 ⬇️-94.54
Minimum in Latest Reports mdb-518 0.68 0.53 ⬇️-0.15
Maximum in Latest Reports mdb-2014 686.36 591.82 ⬇️-94.54
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 580.46 MiB 576.26 MiB ⬇️-4.21 MiB
Median -- 327.93 MiB 327.93 MiB ⬇️0 bytes
Standard Deviation -- 1.03 GiB 1.02 GiB ⬇️-14.32 MiB
Minimum in References Reports mdb-77 39.49 MiB 411.93 MiB ⬆️+372.43 MiB
Maximum in Reference Reports mdb-2393 9.91 GiB 9.32 GiB ⬇️-604.36 MiB
Minimum in Latest Reports mdb-86 56.43 MiB 40.92 MiB ⬇️-15.51 MiB
Maximum in Latest Reports mdb-2393 9.91 GiB 9.32 GiB ⬇️-604.36 MiB

@davidgamez
Copy link
Copy Markdown
Member Author

davidgamez commented Apr 29, 2026

📝 Acceptance Test Report

📋 Summary

❌ The rule acceptance test has failed for commit ad921dc Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1001 datasets, ~0%) ✅
No changes were detected due to the code change.

Dropped Errors (0 out of 1001 datasets, ~0%) ✅
No changes were detected due to the code change.

New Warnings (0 out of 1001 datasets, ~0%) ✅
No changes were detected due to the code change.

Dropped Warnings (0 out of 1001 datasets, ~0%) ✅
No changes were detected due to the code change.

New Info Notices (0 out of 1001 datasets, ~0%) ✅
No changes were detected due to the code change.

Dropped Info Notices (257 out of 1001 datasets, ~26%) ❌
Details of new errors due to code change, which is above the provided threshold of 1%.

Dataset Notice Code

🛡️ Corruption Check

2 out of 1003 sources (~0 %) are corrupted.
** Dataset Ref Report Exists Ref Report Readable Latest Report Exists Latest Report Readable mdb-1114 ✅ ✅ ✅ ✅ mdb-1123 ✅ ✅ ✅ ✅ 🔍 System errors for mdb-1114 (reference) json [ { "code": "i_o_error", "severity": "ERROR", "totalNotices": 1, "sampleNotices": [ { "exception": "java.util.zip.ZipException", "message": "Archive is not a ZIP archive" } ] } ] 🔍 System errors for mdb-1114 (latest) json [ { "code": "i_o_error", "severity": "ERROR", "totalNotices": 1, "sampleNotices": [ { "exception": "java.util.zip.ZipException", "message": "Archive is not a ZIP archive" } ] } ] 🔍 System errors for mdb-1123 (reference) json [ { "code": "i_o_error", "severity": "ERROR", "totalNotices": 1, "sampleNotices": [ { "exception": "java.util.zip.ZipException", "message": "Archive is not a ZIP archive" } ] } ] 🔍 System errors for mdb-1123 (latest) json [ { "code": "i_o_error", "severity": "ERROR", "totalNotices": 1, "sampleNotices": [ { "exception": "java.util.zip.ZipException", "message": "Archive is not a ZIP archive" } ] } ] **
** ### 💾 Out of Memory Check No datasets experienced an OutOfMemoryError. ### ⏱️ Performance Assessment 📈 Validation Time Assess the performance in terms of seconds taken for the validation process. Time Metric Dataset ID Reference (s) Latest (s) Difference (s) Average -- 5.58 5.89 ⬆️+0.31 Median -- 1.62 1.91 ⬆️+0.28 Standard Deviation -- 22.65 24.11 ⬆️+1.47 Minimum in References Reports mdb-299 0.48 0.51 ⬆️+0.03 Maximum in Reference Reports mdb-2014 626.39 678.59 ⬆️+52.20 Minimum in Latest Reports mdb-299 0.48 0.51 ⬆️+0.03 Maximum in Latest Reports mdb-2014 626.39 678.59 ⬆️+52.20 📜 Memory Consumption Metric Dataset ID Reference (s) Latest (s) Difference (s) Average -- 578.87 MiB 576.06 MiB ⬇️-2.81 MiB Median -- 326.52 MiB 327.93 MiB ⬆️+1.41 MiB Standard Deviation -- 1.03 GiB 1.00 GiB ⬇️-25.97 MiB Minimum in References Reports mdb-79 39.82 MiB 44.43 MiB ⬆️+4.60 MiB Maximum in Reference Reports mdb-2393 10.18 GiB 9.40 GiB ⬇️-792.98 MiB Minimum in Latest Reports mdb-651 40.36 MiB 40.32 MiB ⬇️-36.28 KiB Maximum in Latest Reports mdb-2393 10.18 GiB 9.40 GiB ⬇️-792.98 MiB **

This was for testing and also to get the data from the previous merged PR.

@davidgamez davidgamez merged commit 7efb4e3 into master Apr 29, 2026
103 checks passed
@davidgamez davidgamez deleted the acceptance_tests_info branch April 29, 2026 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add INFO level notices to acceptance tests

2 participants