KYLIN-4081 Use absolute path instead of relative for local segment cache

[hit-lacus]

Use absolute path instead of relative path for local segment cache may cause unpredicted result. After restart receiver, if working directory change, Receiver cannot find segment data/checkpoint which created previously, and recreate new one, which is a serious problem.

[codecov-io]

Codecov Report

Merging #741 into master will decrease coverage by <.01%.
The diff coverage is 0%.

@@             Coverage Diff              @@
##             master     #741      +/-   ##
============================================
- Coverage     25.71%   25.71%   -0.01%     
  Complexity     6021     6021              
============================================
  Files          1387     1387              
  Lines         82758    82760       +2     
  Branches      11586    11586              
============================================
- Hits          21282    21279       -3     
- Misses        59432    59436       +4     
- Partials       2044     2045       +1

Impacted Files	Coverage Δ	Complexity Δ
...rg/apache/kylin/stream/server/StreamingServer.java	0% <0%> (ø)	0 <0> (ø)	⬇️
...rg/apache/kylin/cube/inmemcubing/MemDiskStore.java	69.3% <0%> (-0.92%)	7% <0%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 58f990c...f18df6c. Read the comment docs.

[coveralls]

Pull Request Test Coverage Report for Build 4753

• 9 of 64 (14.06%) changed or added relevant lines in 6 files are covered.
• 3 unchanged lines in 3 files lost coverage.
• Overall coverage decreased (-0.01%) to 28.176%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
stream-core/src/main/java/org/apache/kylin/stream/core/storage/columnar/ColumnarSegmentStore.java	1	2	50.0%
core-common/src/main/java/org/apache/kylin/common/KylinConfigBase.java	0	2	0.0%
stream-core/src/main/java/org/apache/kylin/stream/core/consumer/StreamingConsumerChannel.java	0	2	0.0%
stream-core/src/main/java/org/apache/kylin/stream/core/storage/StreamingSegmentManager.java	2	4	50.0%
stream-receiver/src/main/java/org/apache/kylin/stream/server/StreamingServer.java	0	21	0.0%
stream-core/src/main/java/org/apache/kylin/stream/core/metrics/StreamingMetrics.java	6	33	18.18%

Files with Coverage Reduction	New Missed Lines	%
stream-core/src/main/java/org/apache/kylin/stream/core/storage/columnar/ColumnarStoreCache.java	1	55.81%
stream-receiver/src/main/java/org/apache/kylin/stream/server/StreamingServer.java	1	0.0%
stream-core/src/main/java/org/apache/kylin/stream/core/metrics/StreamingMetrics.java	1	25.64%

Totals
Change from base Build 4751:	-0.01%
Covered Lines:	23338
Relevant Lines:	82828

---

💛 - Coveralls

[allenma]

If user specify an absolute path, such as /path1/index, should respect that, otherwise if it is an relative path, use KylinHome as parent

[hit-lacus]

If user specify an absolute path, such as /path1/index, should respect that, otherwise if it is an relative path, use KylinHome as parent

Yes, you are right.

[hit-lacus]

Test Local Segment Cache Path

working directory is $HOME

• Without manual configure

• kylin.stream.index.path=/root/xiaoxiang.yu/KYLIN_4081_index

• kylin.stream.index.path=KYLIN_4081_index

All manual test passed.

[allenma]

LGTM

[hit-lacus]

Test Metrics

kylin.stream.metrics.option=console

You can get metrics in logs/streaming_receiver.out.

-- Meters ----------------------------------------------------------------------
streaming.events.consume.cnt.UserActionCube.0
             count = 2588
         mean rate = 541.27 events/second
     1-minute rate = 0.00 events/second
     5-minute rate = 0.00 events/second
    15-minute rate = 0.00 events/second

-- Gauges ----------------------------------------------------------------------
gc.PS-MarkSweep.count
             value = 2
gc.PS-MarkSweep.time
             value = 90
gc.PS-Scavenge.count
             value = 2
gc.PS-Scavenge.time
             value = 42
memory.heap.committed
             value = 1163395072
memory.heap.init
             value = 1073741824
memory.heap.max
             value = 3817865216

kylin.stream.metrics.option=csv

You can get all file under $KYLIN_HOME/stream_metrics_csv, like this

[root@cdh-client apache-kylin-3.0.0-SNAPSHOT-bin-4081-receiver]# tree stream_metrics_csv/
stream_metrics_csv/
├── gc.PS-MarkSweep.count.csv
├── gc.PS-MarkSweep.time.csv
├── gc.PS-Scavenge.count.csv
├── gc.PS-Scavenge.time.csv
├── memory.heap.committed.csv
├── memory.heap.init.csv
├── memory.heap.max.csv
├── memory.heap.usage.csv
├── memory.heap.used.csv
├── memory.non-heap.committed.csv
├── memory.non-heap.init.csv
├── memory.non-heap.max.csv
├── memory.non-heap.usage.csv
├── memory.non-heap.used.csv
├── memory.pools.Code-Cache.committed.csv
├── memory.pools.Code-Cache.init.csv
├── memory.pools.Code-Cache.max.csv
├── memory.pools.Code-Cache.usage.csv
├── memory.pools.Code-Cache.used.csv
├── memory.pools.Compressed-Class-Space.committed.csv
├── memory.pools.Compressed-Class-Space.init.csv
├── memory.pools.Compressed-Class-Space.max.csv
├── memory.pools.Compressed-Class-Space.usage.csv
├── memory.pools.Compressed-Class-Space.used.csv
├── memory.pools.Metaspace.committed.csv
├── memory.pools.Metaspace.init.csv
├── memory.pools.Metaspace.max.csv
├── memory.pools.Metaspace.usage.csv
├── memory.pools.Metaspace.used.csv
├── memory.pools.PS-Eden-Space.committed.csv

kylin.stream.metrics.option=jmx