Skip to content

[SYSTEMDS-3891] Add Materialized Planning Support - #2573

Merged
janniklinde merged 1 commit into
apache:mainfrom
janniklinde:ooc/planner-merge-19-a
Aug 1, 2026
Merged

[SYSTEMDS-3891] Add Materialized Planning Support#2573
janniklinde merged 1 commit into
apache:mainfrom
janniklinde:ooc/planner-merge-19-a

Conversation

@janniklinde

Copy link
Copy Markdown
Contributor

This PR adds support for explicitly requesting and injecting materialization boundaries. This allows primitives to request persisted input streams, which may be shared across multiple downstream primitives.

@codecov

codecov Bot commented Aug 1, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 66.21622% with 100 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.60%. Comparing base (bf7b6ba) to head (15c3276).

Files with missing lines Patch % Lines
...untime/ooc/primitives/MaterializeOOCPrimitive.java 53.06% 16 Missing and 7 partials ⚠️
...org/apache/sysds/runtime/ooc/store/StateTable.java 20.00% 12 Missing and 4 partials ⚠️
...org/apache/sysds/runtime/ooc/store/StoreLease.java 64.10% 11 Missing and 3 partials ⚠️
.../sysds/runtime/instructions/ooc/CachingStream.java 47.36% 4 Missing and 6 partials ⚠️
...che/sysds/runtime/ooc/primitives/OOCPrimitive.java 84.84% 6 Missing and 4 partials ⚠️
...che/sysds/runtime/ooc/planning/OOCStoreLayout.java 25.00% 6 Missing ⚠️
...che/sysds/runtime/ooc/store/MaterializedStore.java 82.85% 3 Missing and 3 partials ⚠️
.../sysds/runtime/ooc/stream/SourceOOCStreamable.java 0.00% 5 Missing ⚠️
...sysds/runtime/ooc/store/OOCStreamMaterializer.java 55.55% 4 Missing ⚠️
.../sysds/runtime/instructions/ooc/OOCStreamable.java 0.00% 3 Missing ⚠️
... and 2 more
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2573      +/-   ##
============================================
- Coverage     71.63%   71.60%   -0.03%     
- Complexity    50318    50359      +41     
============================================
  Files          1624     1626       +2     
  Lines        194442   194664     +222     
  Branches      37978    38007      +29     
============================================
+ Hits         139290   139393     +103     
- Misses        44252    44351      +99     
- Partials      10900    10920      +20     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@janniklinde
janniklinde merged commit af500c8 into apache:main Aug 1, 2026
51 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in SystemDS PR Queue Aug 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant