KYLIN-3913: Remove getAllOutputs api in ExecutableManager to avoid OOM for large metadata

[lshmouse]

See: https://issues.apache.org/jira/browse/KYLIN-3913

[asfgit]

Can one of the admins verify this patch?

[asfgit]

Can one of the admins verify this patch?

[codecov-io]

Codecov Report

❗ No coverage uploaded for pull request base (master@0b7bda8). Click here to learn what that means.
The diff coverage is 0%.

@@            Coverage Diff            @@
##             master     #557   +/-   ##
=========================================
  Coverage          ?   25.37%           
  Complexity        ?     5794           
=========================================
  Files             ?     1371           
  Lines             ?    81062           
  Branches          ?    11365           
=========================================
  Hits              ?    20572           
  Misses            ?    58480           
  Partials          ?     2010

Impacted Files	Coverage Δ	Complexity Δ
.../apache/kylin/job/execution/ExecutableManager.java	36.19% <0%> (ø)	35 <0> (?)
...pache/kylin/engine/mr/common/JobInfoConverter.java	14.84% <0%> (ø)	6 <1> (?)
...va/org/apache/kylin/tool/JobInstanceExtractor.java	0% <0%> (ø)	0 <0> (?)
...java/org/apache/kylin/rest/service/JobService.java	0% <0%> (ø)	0 <0> (?)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0b7bda8...e563d4f. Read the comment docs.

[nichunen]

Hi @lshmouse , have you tested your pr on a kylin instance with huge number of jobs.

In your PR, org.apache.kylin.engine.mr.common.JobInfoConverter#parseToJobSearchResult will visit metastore to get the execute output data. I doubt this will decrease the performance, and make job listing slower.

[lshmouse]

@nichunen Thanks for your reviews. I will update performance data later.

[nichunen]

It will be done in #630, the commit in this pr will be kept there, close this pr