Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

docs: add metrics doc on barrier #8902

Merged
merged 5 commits into from Mar 31, 2023
Merged

docs: add metrics doc on barrier #8902

merged 5 commits into from Mar 31, 2023

Conversation

kwannoel
Copy link
Contributor

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

Credit goes to @BugenZhao for most of the content here.
I have just added some tweaks.

Checklist For Contributors

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features Sqlsmith: Sql feature generation #7934).
  • I have demonstrated that backward compatibility is not broken by breaking changes and created issues to track deprecated features to be removed in the future. (Please refer to the issue)
  • All checks passed in ./risedev check (or alias, ./risedev c)

Checklist For Reviewers

  • I have requested macro/micro-benchmarks as this PR can affect performance substantially, and the results are shown.

Documentation

  • My PR DOES NOT contain user-facing changes.
Click here for Documentation

Types of user-facing changes

Please keep the types that apply to your changes, and remove the others.

  • Installation and deployment
  • Connector (sources & sinks)
  • SQL commands, functions, and operators
  • RisingWave cluster configuration changes
  • Other (please specify in the release note below)

Release note

@kwannoel kwannoel changed the title add metrics doc on barrier docs: add metrics doc on barrier Mar 31, 2023
@github-actions github-actions bot added the component/doc Issues about documentation. label Mar 31, 2023
@BugenZhao BugenZhao requested review from lmatz and removed request for fuyufjh March 31, 2023 03:05
@kwannoel kwannoel added this pull request to the merge queue Mar 31, 2023
@BugenZhao BugenZhao removed this pull request from the merge queue due to a manual request Mar 31, 2023
BugenZhao
BugenZhao approved these changes Mar 31, 2023
View reviewed changes
Copy link
Member

@BugenZhao BugenZhao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this doc!

docs/metrics.md Outdated
Concretely, here are some costs of processing streaming messages:
1. CPU cost of evaluating expressions.
2. I/O remote exchange between fragments.
3. hash-join / hash-agg cache-miss (results in extra costs to access state on s3).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about making this statement more general? "Executor" should be enough.

docs/metrics.md
2. I/O remote exchange between fragments.
3. hash-join / hash-agg cache-miss (results in extra costs to access state on s3).

Next, high barrier latency could also be caused by buffers in the graph.
Copy link
Member

@BugenZhao BugenZhao Mar 31, 2023 •
edited

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May give a hint that in this case we can tweak the buffer size through configuration file (developer-oriented and should be careful), and a heuristic algorithm is on the way. 🤤

Copy link
Contributor Author

@kwannoel kwannoel Mar 31, 2023 •
edited

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May give a hint that in this case we can tweak the buffer size through configuration file (developer),

Which options can configure this? So far I just see stream_connector_message_buffer_size, but that's just for connector source -> source executor.

and a heuristic algorithm is on the way. 🤤

Any discussions / issues / RFCs I can link to?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which options can configure this? So far I just see stream_connector_message_buffer_size, but that's just for connector source -> source executor.

risingwave/src/config/example.toml

Lines 49 to 50 in a36e013

stream_exchange_initial_permits = 8192
stream_exchange_batched_permits = 1024

Any discussions / issues / RFCs I can link to?

I guess we can link to #8654.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, PTAL

@kwannoel kwannoel requested a review from BugenZhao March 31, 2023 08:02
@codecov
Copy link

codecov bot commented Mar 31, 2023 •
edited

Codecov Report

Merging #8902 (a3a9359) into main (620ab91) will decrease coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #8902      +/-   ##
==========================================
- Coverage   70.81%   70.80%   -0.01%     
==========================================
  Files        1181     1181              
  Lines      195771   195771              
==========================================
- Hits       138628   138623       -5     
- Misses      57143    57148       +5
Flag Coverage Δ
rust 70.80% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 5 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@kwannoel kwannoel added this pull request to the merge queue Mar 31, 2023
Merged via the queue into main with commit 74b935e Mar 31, 2023
4 of 5 checks passed
@kwannoel kwannoel deleted the barrier-docs branch March 31, 2023 09:48
Little-Wallace added a commit to Little-Wallace/risingwave that referenced this pull request Apr 11, 2023
@Little-Wallace
Squashed commit of the following:
347e4ad 
commit ee6d44f
Author: Clearlove <52417396+Eurekaaw@users.noreply.github.com>
Date:   Mon Apr 10 13:11:02 2023 -0400

    feat(optimizer): push `LogicalLimit` down `LogicalProject`, enabled in batch (risingwavelabs#8971)

    Signed-off-by: Clearlove <yifei.c.wei@gmail.com>

commit 5bb0911
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Mon Apr 10 23:01:53 2023 +0800

    fix: timestamptz type mismatch (risingwavelabs#9090)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit ab09d29
Author: stonepage <40830455+st1page@users.noreply.github.com>
Date:   Mon Apr 10 21:54:15 2023 +0800

    chore: improve error msg (risingwavelabs#9089)

commit 7088fd3
Author: Richard Chien <stdrc@outlook.com>
Date:   Mon Apr 10 20:20:53 2023 +0800

    refactor(common): remove `unwrap` from `memcmp_encoding` and improve `encode_row` (risingwavelabs#9087)

    Signed-off-by: Richard Chien <stdrc@outlook.com>

commit 490161d
Author: StrikeW <wangsiyuanse@gmail.com>
Date:   Mon Apr 10 18:56:27 2023 +0800

    perf(storage): Merge multiple imms in the staging version to a large one (risingwavelabs#7368)

commit fcc069a
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Mon Apr 10 18:43:13 2023 +0800

    feat(meta cache): stats meta cache unhit in prometheus (risingwavelabs#9078)

commit 4929b30
Author: Dylan <chenzl25@mail2.sysu.edu.cn>
Date:   Mon Apr 10 17:31:52 2023 +0800

    feat(stream): stream window join naming (risingwavelabs#9076)

commit fd38f3d
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Mon Apr 10 02:24:30 2023 -0700

    fix(planner): `stddev`/`var` rewriter panic due to mix use of pre/post project index (risingwavelabs#9081)

commit a3fc14a
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Mon Apr 10 16:08:45 2023 +0800

    fix(expr): correctly handle unicode for substr (risingwavelabs#9079)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>

commit d1868a9
Author: August <pin@singularity-data.com>
Date:   Mon Apr 10 15:56:52 2023 +0800

    fix: reject ddl rather than panic when no available parallel units to schedule (risingwavelabs#9080)

commit 046f1d2
Author: Dylan <chenzl25@mail2.sysu.edu.cn>
Date:   Mon Apr 10 15:08:50 2023 +0800

    feat(optimizer): support functional index selection (risingwavelabs#9067)

commit a63807d
Author: Shanicky Chen <peng@singularity-data.com>
Date:   Mon Apr 10 14:45:43 2023 +0800

    chore: remove Uint256 functionality and related code (risingwavelabs#9073)

commit fc5836f
Author: xxchan <xxchan22f@gmail.com>
Date:   Mon Apr 10 08:33:22 2023 +0200

    ci: reuse some code across scripts (risingwavelabs#8926)

commit 10190e8
Author: Dylan <chenzl25@mail2.sysu.edu.cn>
Date:   Mon Apr 10 13:48:31 2023 +0800

    fix(stream): fix inner interval join (risingwavelabs#9071)

commit ed5af28
Author: congyi wang <58715567+wcy-fdu@users.noreply.github.com>
Date:   Mon Apr 10 12:14:57 2023 +0800

    feat(streaming): monitor materialize cache miss rate when handling pk conflict (risingwavelabs#8946)

commit 1e3221b
Author: Lanqing Yang <lanqingy@usc.edu>
Date:   Sun Apr 9 20:59:11 2023 -0700

    feat(expr): support for sqrt function (risingwavelabs#9017)

    Co-authored-by: root <root@HQ-10MSTD3EY.roblox.local>

commit 95ab15c
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Sun Apr 9 17:30:45 2023 +0800

    feat: Estimate size for data chunk (risingwavelabs#9050)

commit ced72de
Author: Dylan <chenzl25@mail2.sysu.edu.cn>
Date:   Sun Apr 9 16:34:23 2023 +0800

    feat(frontend): support functional indexes creation (risingwavelabs#8976)

commit d8926b8
Author: William Wen <44139337+wenym1@users.noreply.github.com>
Date:   Sun Apr 9 01:47:25 2023 +0200

    feat(sink): introduce log trait and adopt log reader and write in sink executor (risingwavelabs#8558)

commit cc93b46
Author: Yuanxin Cao <60498509+xx01cyx@users.noreply.github.com>
Date:   Sat Apr 8 23:50:16 2023 +0800

    fix(sink): allow parsing `bool` and `u32` for kafka sink config (risingwavelabs#9057)

commit de6c5a3
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Fri Apr 7 23:19:15 2023 +0800

    refactor(common): do not leak types on row (risingwavelabs#9053)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>

commit 1aa1278
Author: Tesla Zhang‮ <ice1000kotlin@foxmail.com>
Date:   Fri Apr 7 11:00:32 2023 -0400

    refactor(plan_node): create `BatchPlanRef`, simplify `HopWindow` nodes (risingwavelabs#9044)

commit c343f00
Author: congyi wang <58715567+wcy-fdu@users.noreply.github.com>
Date:   Fri Apr 7 22:19:21 2023 +0800

    refactor(metrics): fix cache metrics to be table id + actor id (risingwavelabs#9039)

commit 9a15a88
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Fri Apr 7 03:19:50 2023 -0700

    chore: `rust_decimal` feature -db-tokio-postgres +maths (risingwavelabs#9043)

commit 85980fd
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Fri Apr 7 16:55:24 2023 +0800

    feat: Implement GetSize for array (risingwavelabs#8995)

commit 36dd239
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Fri Apr 7 15:20:21 2023 +0800

    refactor: do not leak the nested runtime (risingwavelabs#8968)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>
    Signed-off-by: Runji Wang <wangrunji0408@163.com>
    Co-authored-by: Runji Wang <wangrunji0408@163.com>

commit e685bdb
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Fri Apr 7 14:18:06 2023 +0800

    chore: deprecate console sink (risingwavelabs#8950)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit 5169ce9
Author: Richard Chien <stdrc@outlook.com>
Date:   Fri Apr 7 14:14:17 2023 +0800

    feat(stream common): add internal cache for `SortBuffer` (risingwavelabs#8963)

    Signed-off-by: Richard Chien <stdrc@outlook.com>

commit 09e6a63
Author: ZENOTME <43447882+ZENOTME@users.noreply.github.com>
Date:   Fri Apr 7 14:08:15 2023 +0800

    refactor(frontend): refactor query to reduce redundent code in extended mode (risingwavelabs#9023)

commit 8e0bf7a
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Thu Apr 6 10:11:45 2023 -0700

    fix(sqlparser): support more PostgreSQL `trim` syntax (risingwavelabs#8985)

commit 8038315
Author: Xinjing Hu <honeta@qq.com>
Date:   Thu Apr 6 20:59:17 2023 +0800

    perf(encoding): add benchmark for data chunk encoding (risingwavelabs#9035)

    Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

commit 5af13c1
Author: Zhanxiang (Patrick) Huang <hzxa21@hotmail.com>
Date:   Thu Apr 6 20:34:58 2023 +0800

    feat(metric): introduce an alert panel in grafana user dashboard (risingwavelabs#9031)

commit 3af7d21
Author: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
Date:   Thu Apr 6 20:14:34 2023 +0800

    feat(sqlsmith): Generate more join expressions (risingwavelabs#8395)

commit 1293fda
Author: xxchan <xxchan22f@gmail.com>
Date:   Thu Apr 6 13:40:34 2023 +0200

    ci: increase timeout for e2e java-binding test (risingwavelabs#9032)

commit eb20393
Author: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
Date:   Thu Apr 6 18:36:28 2023 +0800

    perf(common): Optimize null_bitmap with `Set64` (risingwavelabs#8941)

    Co-authored-by: Bugen Zhao <i@bugenzhao.com>

commit 29389e1
Author: Shanicky Chen <peng@singularity-data.com>
Date:   Thu Apr 6 18:07:42 2023 +0800

    feat(common): introduce ArrayBuilder and Array for Int256/Uint256  (risingwavelabs#8989)

    Co-authored-by: lmatz <lmatz823@gmail.com>

commit 83b7c79
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Thu Apr 6 17:52:55 2023 +0800

    feat(metrics): add metric for source upstream (risingwavelabs#9027)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit 78505b1
Author: Runji Wang <wangrunji0408@163.com>
Date:   Thu Apr 6 17:40:40 2023 +0800

    fix(udf): fix missing chunks (risingwavelabs#9025)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>
    Co-authored-by: lmatz <lmatz823@gmail.com>

commit ba2f6e1
Author: Zhanxiang (Patrick) Huang <hzxa21@hotmail.com>
Date:   Thu Apr 6 16:17:57 2023 +0800

    feat(metric): add recovery metrics (risingwavelabs#9022)

commit ea53cf3
Author: Runji Wang <wangrunji0408@163.com>
Date:   Thu Apr 6 15:23:51 2023 +0800

    test: simulate for worker node heartbeat timeout (risingwavelabs#7640)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>
    Co-authored-by: August <pin@singularity-data.com>
    Co-authored-by: Shanicky Chen <peng@singularity-data.com>
    Co-authored-by: Shanicky Chen <peng@risingwave-labs.com>

commit b19e651
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Thu Apr 6 14:58:51 2023 +0800

    fix: ban types when creating sink (risingwavelabs#9008)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit 4c0a0b4
Author: August <pin@singularity-data.com>
Date:   Thu Apr 6 14:42:52 2023 +0800

    fix: fix some check and clean for drop database and schema (risingwavelabs#8981)

commit 8f8c191
Author: Richard Chien <stdrc@outlook.com>
Date:   Thu Apr 6 14:28:01 2023 +0800

    refactor(stream sort): use new `SortBuffer` in `SortExecutor` (risingwavelabs#8891)

    Signed-off-by: Richard Chien <stdrc@outlook.com>

commit efe56ec
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Thu Apr 6 14:17:47 2023 +0800

    fix(expr): align `position` syntax and `strpos` semantic with SQL standard (risingwavelabs#9000)

commit f1b7942
Author: WillyKidd <57129289+WillyKidd@users.noreply.github.com>
Date:   Thu Apr 6 13:39:31 2023 +0800

    feat(source): introduce create/show connection statement (risingwavelabs#8907)

commit 7c9da96
Author: Tesla Zhang‮ <ice1000kotlin@foxmail.com>
Date:   Thu Apr 6 01:24:48 2023 -0400

    refactor(plan_node): `TopN` simplification (risingwavelabs#9011)

commit f80ef5d
Author: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
Date:   Thu Apr 6 12:26:26 2023 +0800

    bench(common): add more benchmark cases for unaligned number of keys (risingwavelabs#9018)

commit 3091f16
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Thu Apr 6 08:07:44 2023 +0800

    perf(hash join): do not store null rows (close risingwavelabs#9009) (risingwavelabs#9010)

commit 110972a
Author: lmatz <lmatz823@gmail.com>
Date:   Wed Apr 5 15:56:11 2023 +0800

    fix(binder): multiple unions should retain the same cte_to_relation context (risingwavelabs#9007)

commit be4f748
Author: Eric Fu <eric@singularity-data.com>
Date:   Wed Apr 5 15:31:30 2023 +0800

    fix(risedev): auto build connector node (risingwavelabs#9006)

commit b67e00f
Author: broccoliSpicy <93440049+broccoliSpicy@users.noreply.github.com>
Date:   Wed Apr 5 14:21:33 2023 +0800

    fix(binder): Incorrect cast when specifying columns (risingwavelabs#8770)

    Co-authored-by: xxchan <xxchan22f@gmail.com>

commit ce25cf5
Author: Runji Wang <wangrunji0408@163.com>
Date:   Wed Apr 5 14:20:55 2023 +0800

    fix(udf): fix wrong number of rows (risingwavelabs#9003)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>

commit db072cb
Author: ZENOTME <43447882+ZENOTME@users.noreply.github.com>
Date:   Wed Apr 5 10:32:55 2023 +0800

    feat(frontend):support pull_up_hop rule (risingwavelabs#8954)

commit 731f211
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Tue Apr 4 23:46:40 2023 +0800

    feat(binder): support some alternate names for existing exprs (risingwavelabs#8998)

commit 29c4185
Author: ZENOTME <43447882+ZENOTME@users.noreply.github.com>
Date:   Tue Apr 4 22:54:51 2023 +0800

    refactor(frontend): refine extended handle (risingwavelabs#8992)

commit 381e3b8
Author: Zhanxiang (Patrick) Huang <hzxa21@hotmail.com>
Date:   Tue Apr 4 22:35:27 2023 +0800

    feat(grafana): introduce a new dashboard to dsiplay user facing metrics (risingwavelabs#8994)

commit ef22c5b
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Tue Apr 4 20:52:54 2023 +0800

    chore: add metrics for native chunk (risingwavelabs#8997)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit fadd752
Author: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
Date:   Tue Apr 4 20:39:02 2023 +0800

    chore(common): add more benchmark cases for hash key (risingwavelabs#8993)

commit 5d8c0b4
Author: Tao Wu <wutao@singularity-data.com>
Date:   Tue Apr 4 19:59:09 2023 +0800

    test: add e2e tests for natural join and cross join (risingwavelabs#8948)

commit 35f7c0c
Author: Shanicky Chen <peng@singularity-data.com>
Date:   Tue Apr 4 19:03:55 2023 +0800

    feat(common): introduce Int256/Uint256 as Scalar and ScalarRef (risingwavelabs#8984)

commit 085dc31
Author: xxchan <xxchan22f@gmail.com>
Date:   Tue Apr 4 12:22:50 2023 +0200

    ci: reduce java-binding log (risingwavelabs#8967)

commit 506986f
Author: Yuhao Su <31772373+yuhao-su@users.noreply.github.com>
Date:   Tue Apr 4 18:09:28 2023 +0800

    fix: drop table with watermark panic (risingwavelabs#8990)

commit b9ff193
Author: Runji Wang <wangrunji0408@163.com>
Date:   Tue Apr 4 17:57:58 2023 +0800

    fix(udf): fix decimal and list types for UDF (risingwavelabs#8958)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>

commit 80c477f
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Tue Apr 4 17:20:20 2023 +0800

    feat(frontend): support update column to default value (risingwavelabs#8987)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>

commit 570a253
Author: August <pin@singularity-data.com>
Date:   Tue Apr 4 15:54:45 2023 +0800

    chore: notify function separately rather than inside the relation group (risingwavelabs#8983)

commit ffc634f
Author: xxchan <xxchan22f@gmail.com>
Date:   Tue Apr 4 09:49:10 2023 +0200

    fix: fix cargo audit issues and add audit to ci (risingwavelabs#8959)

commit bbe15be
Author: Runji Wang <wangrunji0408@163.com>
Date:   Tue Apr 4 15:36:43 2023 +0800

    feat: support `date_part` function and more fields for `extract` (risingwavelabs#8830)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>
    Co-authored-by: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>

commit dca4ced
Author: zwang28 <70626450+zwang28@users.noreply.github.com>
Date:   Tue Apr 4 15:24:43 2023 +0800

    feat(metric): add metric for object size and count (risingwavelabs#8980)

commit c617632
Author: Huangjw <1223644280@qq.com>
Date:   Tue Apr 4 14:47:56 2023 +0800

    fix(ci): fix docker release scripts (risingwavelabs#8977)

commit da1822c
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Tue Apr 4 14:01:32 2023 +0800

    refactor: Remove unused code (risingwavelabs#8974)

commit 9b53293
Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Date:   Tue Apr 4 13:31:14 2023 +0800

    chore(deps): bump spin from 0.9.6 to 0.9.8 (risingwavelabs#8969)

    Signed-off-by: dependabot[bot] <support@github.com>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

commit 6687739
Author: Runji Wang <wangrunji0408@163.com>
Date:   Tue Apr 4 12:40:34 2023 +0800

    fix(expr): fix `lpad` and `rpad` on empty fill string (risingwavelabs#8970)

    Signed-off-by: Runji Wang <wangrunji0408@163.com>

commit 368ed93
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Tue Apr 4 12:38:23 2023 +0800

    fix(test): clean-up temporary config file (risingwavelabs#8972)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>

commit 43bd8c9
Author: August <pin@singularity-data.com>
Date:   Tue Apr 4 12:14:10 2023 +0800

    fix: use original lru crate in meta client and simulation (risingwavelabs#8956)

commit 30dca71
Author: Tesla Zhang‮ <ice1000kotlin@foxmail.com>
Date:   Mon Apr 3 10:36:46 2023 -0400

    refactor(plan_node): simplify `Expand` and `Filter` (risingwavelabs#8932)

commit 626ff72
Author: xxchan <xxchan22f@gmail.com>
Date:   Mon Apr 3 15:28:41 2023 +0200

    refactor(risedev): replace std::fs with fs_err (risingwavelabs#8955)

commit 88d84a0
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Mon Apr 3 18:51:10 2023 +0800

    refactor: Add backtrace for risedev (risingwavelabs#8960)

commit 1527b6c
Author: Huangjw <1223644280@qq.com>
Date:   Mon Apr 3 18:45:16 2023 +0800

    chore(release): update release version and fix ci release script (risingwavelabs#8913)

commit 8278061
Author: ZENOTME <43447882+ZENOTME@users.noreply.github.com>
Date:   Mon Apr 3 16:30:10 2023 +0800

    refactor(frontend): refactor extended query mode (risingwavelabs#8919)

commit 06025d5
Author: lmatz <lmatz823@gmail.com>
Date:   Mon Apr 3 16:06:38 2023 +0800

    chore(metrics): add and correct some description of metrics shown on Grafana (risingwavelabs#8890)

commit 806c623
Author: Yuanxin Cao <60498509+xx01cyx@users.noreply.github.com>
Date:   Mon Apr 3 15:49:08 2023 +0800

    feat(sink): reject invalid options when creating sink (risingwavelabs#8757)

    Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

commit 36c4605
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Mon Apr 3 15:47:16 2023 +0800

    test(regress): enable `strings` (risingwavelabs#8952)

commit 3c884e1
Author: idx0-dev <124041366+idx0-dev@users.noreply.github.com>
Date:   Mon Apr 3 15:27:06 2023 +0800

    feat:  encode JSON in the same way as debezium (risingwavelabs#8865)

commit 312d418
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Mon Apr 3 15:04:38 2023 +0800

    fix: unstable test by checking cardinality instead of actual values (risingwavelabs#8947)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit 6c3c80d
Author: Yuanxin Cao <60498509+xx01cyx@users.noreply.github.com>
Date:   Mon Apr 3 14:35:31 2023 +0800

    feat(streaming): introduce dedup cache and append-only dedup executor (risingwavelabs#8874)

    Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

commit 37ce407
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Mon Apr 3 14:16:59 2023 +0800

    fix(delete range): maintain unused iters in `seek` (close risingwavelabs#8928) (risingwavelabs#8929)

commit 6f46e4c
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Mon Apr 3 14:14:18 2023 +0800

    fix(shared buffer): shared buffer consistency issue (close risingwavelabs#8944) (risingwavelabs#8945)

commit 4254b42
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Mon Apr 3 13:48:38 2023 +0800

    test(regress): enable `text` (risingwavelabs#8943)

commit 7c259eb
Author: WillyKidd <57129289+WillyKidd@users.noreply.github.com>
Date:   Mon Apr 3 13:42:10 2023 +0800

    fix(connector): dbz source handler avoid oom more elegantly (risingwavelabs#8799)

commit ea52212
Author: idx0-dev <124041366+idx0-dev@users.noreply.github.com>
Date:   Mon Apr 3 12:57:08 2023 +0800

    feat(e2esinktest): switch to stream_chunk (risingwavelabs#8914)

commit ac104a7
Author: xiangjinwu <17769960+xiangjinwu@users.noreply.github.com>
Date:   Mon Apr 3 10:13:17 2023 +0800

    test(regress): enable `case` (also covers `coalesce` `nullif`) (risingwavelabs#8921)

commit 9f56e80
Author: StrikeW <wangsiyuanse@gmail.com>
Date:   Sun Apr 2 23:54:44 2023 +0800

    fix(ci): quick fix for main cron ci (risingwavelabs#8931)

commit e217689
Author: Tesla Zhang‮ <ice1000kotlin@foxmail.com>
Date:   Sun Apr 2 09:20:10 2023 -0400

    refactor(plan_node): simplify agg-related nodes (risingwavelabs#8930)

commit 039d4a0
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Sat Apr 1 17:31:50 2023 +0800

    fix(move table): apply version correctly (close risingwavelabs#8764) (risingwavelabs#8765)

commit ad53077
Author: Shuxian Wang <wsx@berkeley.edu>
Date:   Fri Mar 31 15:21:13 2023 -0700

    fix(stream): Better cache handling for temporal join. (risingwavelabs#8871)

commit d687d71
Author: Bugen Zhao <i@bugenzhao.com>
Date:   Fri Mar 31 23:00:45 2023 +0800

    refactor(config): split streaming and batch developer config (risingwavelabs#8911)

    Signed-off-by: Bugen Zhao <i@bugenzhao.com>

commit ff1440f
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Fri Mar 31 21:39:27 2023 +0800

    refactor: Remove unnecessary bash scripts (risingwavelabs#8925)

commit dbbd1cb
Author: Yuhao Su <31772373+yuhao-su@users.noreply.github.com>
Date:   Fri Mar 31 18:46:55 2023 +0800

    feat(generated_columns): support select generated columns from source (risingwavelabs#8841)

    Co-authored-by: Bugen Zhao <i@bugenzhao.com>
    Co-authored-by: stonepage <40830455+st1page@users.noreply.github.com>

commit e51b240
Author: Bohan Zhang <tabvision@bupt.icu>
Date:   Fri Mar 31 17:45:44 2023 +0800

    fix: propagate connector reader error to the upper layer (risingwavelabs#8920)

    Signed-off-by: tabVersion <tabvision@bupt.icu>

commit 74b935e
Author: Noel Kwan <47273164+kwannoel@users.noreply.github.com>
Date:   Fri Mar 31 17:25:54 2023 +0800

    docs: add metrics doc on barrier (risingwavelabs#8902)

commit 96d92ca
Author: Liang <44948473+soundOfDestiny@users.noreply.github.com>
Date:   Fri Mar 31 17:22:52 2023 +0800

    feat(sst meta): rollback fetch meta strategy (risingwavelabs#8917)

commit 6c99e93
Author: Li0k <yuli@singularity-data.com>
Date:   Fri Mar 31 16:45:39 2023 +0800

    chore(storage): monitor compacting task count per level (risingwavelabs#8681)

commit 188846e
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Fri Mar 31 16:29:42 2023 +0800

    fix: Disable generated warning in docker compose (risingwavelabs#8916)

commit 85ecc73
Author: August <pin@singularity-data.com>
Date:   Fri Mar 31 15:45:56 2023 +0800

    fix: replay functions in snapshot on frontend (risingwavelabs#8912)

commit dc5d3de
Author: Kevin Axel <kevinaxel@163.com>
Date:   Fri Mar 31 15:42:03 2023 +0800

    feat(optimizer): bushy join equivalent condition derivation (risingwavelabs#8668)

    Signed-off-by: Kevin Axel <kevinaxel@163.com>

commit 010bec6
Author: Xinjing Hu <honeta@qq.com>
Date:   Fri Mar 31 15:32:24 2023 +0800

    perf(encoding): use estimate size to reserve memory in row encoding (risingwavelabs#8909)

    Co-authored-by: stonepage <40830455+st1page@users.noreply.github.com>

commit 1b05700
Author: Renjie Liu <liurenjie2008@gmail.com>
Date:   Fri Mar 31 15:10:23 2023 +0800

    refactor: Simplify some commands in kafka cdc example. (risingwavelabs#8910)

commit 9bcfb17
Author: Tesla Zhang‮ <ice1000kotlin@foxmail.com>
Date:   Fri Mar 31 02:20:44 2023 -0400

    refactor(plan_node): Further simplify join-related plan nodes (risingwavelabs#8905)

Signed-off-by: Little-Wallace <bupt2013211450@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lmatz lmatz lmatz approved these changes

@BugenZhao BugenZhao BugenZhao approved these changes

Assignees
No one assigned
Labels
component/doc Issues about documentation.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@kwannoel @lmatz @BugenZhao