DLPX-93376 Apache HOP project level performance configuration tuning

[AnoopKumarDelphix]

DLPX-93376 Apache HOP project level performance configuration tuning

Problem

Performance with Apache HOP is slightly lesser or similar to Kettle for Delimited Fixed-Width and Mainframe jobs

The wait between each transform hop waits for the certain period of time which is calculated dynamically in HOP implemented by DynamicWaitTimes.java

Solution

The logic to determine if the handleGetRow method waits for a rowset was decided considering only 1 rowset, which is now modified to consider all the rowset size.
Note:Minimum sleeps vary by OS scheduler, this could be 1ms or more

Also the new version of HOP 2.10 has some performance optimization which is pulled into this forked repo.
https://github.com/apache/hop/blob/release/2.10.0/engine/src/main/java/org/apache/hop/pipeline/transform/BaseTransform.java

Testing Done

VM : https://anp-at.dlpxdc.co/masking

masking-agnostic Partial

masking-agnostic Passed after rerun

• Manually built the HOP binaries using ./mvnw clean install -Dmaven.test.skip=true
• Replaced the hop-engine.jar into $MASKING_HOME/hop-runner/lib/ directory
• Tested all the file masking jobs functional testing is done and is working as expected.
• Observed slight increase in performance resulting in increase in memory consumption.

Bonus

HOP GUI class path correction taken care similar to hop.run.sh

[dlpx-akashpandey]

LGTM

[sandeep-delphix]

LGTM, just one small comment, please fix if needed.