-
Notifications
You must be signed in to change notification settings - Fork 536
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: introduce system tables about table fragment info #10712
Conversation
Codecov Report
@@ Coverage Diff @@
## main #10712 +/- ##
==========================================
- Coverage 70.25% 70.20% -0.06%
==========================================
Files 1291 1292 +1
Lines 220677 220852 +175
==========================================
+ Hits 155038 155049 +11
- Misses 65639 65803 +164
Flags with carried forward coverage won't be shown. Click here to find out more.
... and 6 files with indirect coverage changes 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
Examples in a local run: dev=> select * from rw_actors;
actor_id | fragment_id | parallel_unit_id | status
----------+-------------+------------------+---------
2001 | 2001 | 11000 | RUNNING
2002 | 2001 | 11001 | RUNNING
2003 | 2001 | 11002 | RUNNING
2004 | 2001 | 11003 | RUNNING
2005 | 2002 | 11000 | RUNNING
2006 | 2002 | 11001 | RUNNING
2007 | 2002 | 11002 | RUNNING
2008 | 2002 | 11003 | RUNNING
(8 rows)
dev=> select * from rw_fragments;
fragment_id | table_id | distribution_type | state_table_ids | upstream_fragment_ids
-------------+----------+-------------------+-----------------+-----------------------
2001 | 3001 | HASH | {3001} | {2002}
2002 | 3001 | HASH | {} | {}
(2 rows)
dev=> select * from rw_table_fragments;
table_id | status
----------+---------
3001 | CREATED
(1 row) |
@@ -595,4 +601,82 @@ impl SysCatalogReaderImpl { | |||
}) | |||
.collect_vec()) | |||
} | |||
|
|||
/// FIXME: we need to introduce revision snapshot read on meta to avoid any inconsistency when |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Opened an issue for it: #10732 .
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
Resolve #8803 , introduced system tables
rw_table_fragments
,rw_fragments
andrw_actors
to expose status, type and distribution information about streaming jobs.rw_table_fragments
rw_fragments
rw_actors
Checklist
./risedev check
(or alias,./risedev c
)Documentation
Click here for Documentation
Types of user-facing changes
Please keep the types that apply to your changes, and remove the others.
Release note
Introduce system tables
rw_table_fragments
,rw_fragments
andrw_actors
.