systemds-ooc-experiments

OOC Framework experiments

Dataset generation

java --add-modules=jdk.incubator.vector -Xmx8g -jar target/SystemDS.jar -f .\test_matrix_vector.dml -stats

with OOC backend

java --add-modules=jdk.incubator.vector -Xmx8g -jar target/SystemDS.jar -f .\test_matrix_vector.dml -stats -ooc -exec singleNode

with CP backend

java --add-modules=jdk.incubator.vector -Xmx8g -jar target/SystemDS.jar -f .\test_matrix_vector.dml -stats

$ java --add-modules=jdk.incubator.vector -Xmx8g -jar target/SystemDS.jar -f ./lmds.dml -stats -ooc -exec singleNode
WARNING: Using incubator modules: jdk.incubator.vector
25/11/26 15:15:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Evicting condition: 4000009/25769803
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@6436a7db
Evicting condition: 8000018/25769803
Evicting condition: 12000027/25769803
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@5dd1c9f2
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@59b38691
Evicting condition: 16000036/25769803
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@2e2ff723
Evicting condition: 20000045/25769803
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@324a0017
Evicting condition: 24000054/25769803
value of imv: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$BlockEntry@6187d1f5
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 0
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 4000025
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 8000050
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 12000075
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 16000100
written, partition id: org.apache.sysds.runtime.instructions.ooc.OOCEvictionManager$partitionFile@147d17af, offset: 20000125
SystemDS Statistics:
Total elapsed time:             40.098 sec.
Total compilation time:         1.110 sec.
Total execution time:           38.988 sec.
Cache hits (Mem/Li/WB/FS/HDFS): 3/0/0/0/0.
Cache writes (Li/WB/FS/HDFS):   0/1/0/1.
Cache times (ACQr/m, RLS, EXP): 21.715/0.000/0.001/0.229 sec.
HOP DAGs recompiled (PRED, SB): 0/0.
HOP DAGs recompile time:        0.000 sec.
Total JIT compile time:         1.945 sec.
Total JVM GC count:             95.
Total JVM GC time:              0.176 sec.
Heavy hitter instructions:
  #  Instruction  Time(s)  Count
  1  ooc_ba+*      21.856      1
  2  ooc_tsmm      16.658      1
  3  write          0.229      1
  4  solve          0.136      1
  5  r'             0.066      1
  6  ooc_uak+       0.010      1
  7  createvar      0.010     11
  8  ooc_r'         0.008      1
  9  ooc_rblk       0.004      2
 10  ooc_!=         0.004      1