Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement] add information_schema.table_options #32572

Closed
2 of 3 tasks
dataroaring opened this issue Mar 20, 2024 · 3 comments · Fixed by #34384
Closed
2 of 3 tasks

[Enhancement] add information_schema.table_options #32572

dataroaring opened this issue Mar 20, 2024 · 3 comments · Fixed by #34384
Labels
difficulty/medium doris-future java Pull requests that update Java code

Comments

@dataroaring
Copy link
Contributor

dataroaring commented Mar 20, 2024 •
edited
Loading

Search before asking

  • I had searched in the issues and found no similar issues.

Description

Add an internal table under information_schema named table_options, which contains TABLE_NAME, DISTRIBUTE_KEY, DISTRIBUTE_TYPE,BUCKETS_NUM,PARTITION_NUM,PROPERTIES

Solution

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@dataroaring dataroaring added difficulty/medium java Pull requests that update Java code doris-future labels Mar 20, 2024
@Vallishp
Copy link
Contributor

@dataroaring @liugddx is this feature in progress? if not please assign to me. i can take it up. thanks.

@liugddx
Copy link
Member

liugddx commented Apr 29, 2024

@dataroaring @liugddx is this feature in progress? if not please assign to me. i can take it up. thanks.

you can do

@Vallishp
Copy link
Contributor

@dataroaring @liugddx is this feature in progress? if not please assign to me. i can take it up. thanks.

you can do

ok. will work on this. thank you

Vallishp added a commit to Vallishp/doris that referenced this issue May 2, 2024
@Vallishp
[Enhancement] add information_schema.table_options(apache#32572)
7169306
@Vallishp Vallishp mentioned this issue May 2, 2024
Merged
Vallishp added a commit to Vallishp/doris that referenced this issue May 2, 2024
@Vallishp
[Enhancement] add information_schema.table_options(apache#32572)
74c81a4
Vallishp added a commit to Vallishp/doris that referenced this issue May 2, 2024
@Vallishp
[Enhancement] add information_schema.table_options(apache#32572)
87d155e
Vallishp added a commit to Vallishp/doris that referenced this issue May 7, 2024
@Vallishp
[Enhancement] add information_schema.table_options(apache#32572)
9435132
yiguolei pushed a commit that referenced this issue May 28, 2024
@Vallishp @gavinchou @xinyiZzz
[Enhancement] add information_schema.table_options(#32572) (#34384)
6fc50c5 
## Proposed changes

Issue Number: close #32572

Support table_options in information_schema.
UT result:
mysql> select * from information_schema.table_options where
table_schema="test_table_options_db"\G
*************************** 1. row ***************************
     TABLE_NAME: rangetable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: user_id
DISTRIBUTE_TYPE: HASH
    BUCKETS_NUM: 8
  PARTITION_NUM: 3
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 6,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
*************************** 2. row ***************************
     TABLE_NAME: listtable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: user_id
DISTRIBUTE_TYPE: HASH
    BUCKETS_NUM: 16
  PARTITION_NUM: 3
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 6,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
*************************** 3. row ***************************
     TABLE_NAME: randomtable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: RANDOM
DISTRIBUTE_TYPE: RANDOM
    BUCKETS_NUM: 16
  PARTITION_NUM: 1
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 3,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
3 rows in set (0.03 sec)




## Further comments

If this is a relatively large or complex change, kick off the discussion
at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why
you chose the solution you did and what alternatives you considered,
etc...

---------

Co-authored-by: Gavin Chou <gavineaglechou@gmail.com>
Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com>
dataroaring pushed a commit that referenced this issue May 28, 2024
@Vallishp @gavinchou
@xinyiZzz @dataroaring
[Enhancement] add information_schema.table_options(#32572) (#34384)
5527c54 
## Proposed changes

Issue Number: close #32572

Support table_options in information_schema.
UT result:
mysql> select * from information_schema.table_options where
table_schema="test_table_options_db"\G
*************************** 1. row ***************************
     TABLE_NAME: rangetable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: user_id
DISTRIBUTE_TYPE: HASH
    BUCKETS_NUM: 8
  PARTITION_NUM: 3
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 6,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
*************************** 2. row ***************************
     TABLE_NAME: listtable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: user_id
DISTRIBUTE_TYPE: HASH
    BUCKETS_NUM: 16
  PARTITION_NUM: 3
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 6,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
*************************** 3. row ***************************
     TABLE_NAME: randomtable
  TABLE_CATALOG: internal
   TABLE_SCHEMA: test_table_options_db
 DISTRIBUTE_KEY: RANDOM
DISTRIBUTE_TYPE: RANDOM
    BUCKETS_NUM: 16
  PARTITION_NUM: 1
PROPERTIES: min_load_replica_num = -1, data_sort.col_num = 3,
group_commit_interval_ms = 10000, data_sort.sort_type = LEXICAL,
is_being_synced = false, binlog.enable = false, binlog.ttl_seconds =
86400, inverted_index_storage_format = V1,
time_series_compaction_empty_rowsets_threshold = 5,
default.replication_allocation = tag.location.default: 1,
time_series_compaction_level_threshold = 1,
time_series_compaction_time_threshold_seconds = 3600, storage_format =
V2, store_row_column = false, light_schema_change = true,
enable_unique_key_merge_on_write = false, in_memory = false,
file_cache_ttl_seconds = 0, group_commit_data_bytes = 134217728,
compaction_policy = size_based, _auto_bucket = false,
binlog.max_history_nums = 9223372036854775807,
time_series_compaction_file_count_threshold = 2000,
skip_write_index_on_load = false, disable_auto_compaction = false,
time_series_compaction_goal_size_mbytes = 1024, storage_medium = HDD,
enable_single_replica_compaction = false, compression = LZ4F,
binlog.max_bytes = 9223372036854775807
3 rows in set (0.03 sec)




## Further comments

If this is a relatively large or complex change, kick off the discussion
at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why
you chose the solution you did and what alternatives you considered,
etc...

---------

Co-authored-by: Gavin Chou <gavineaglechou@gmail.com>
Co-authored-by: Xinyi Zou <zouxinyi02@gmail.com>
Vallishp added a commit to Vallishp/doris that referenced this issue Sep 10, 2024
@Vallishp
[Enhancement] add information_schema.table_options(apache#32572)
96df5fe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
difficulty/medium doris-future java Pull requests that update Java code
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Enhancement] add information_schema.table_options(#32572) Vallishp/doris
3 participants
@Vallishp @liugddx @dataroaring