-
Notifications
You must be signed in to change notification settings - Fork 6.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow nested with multiple nesting and subcolumns of complex types #17310
Conversation
String toString() const; | ||
}; | ||
|
||
struct SubstreamPath : public std::vector<Substream> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
.
@@ -46,10 +48,13 @@ IMergeTreeDataPart::MergeTreeReaderPtr MergeTreeDataPartWide::getReader( | |||
const ValueSizeMap & avg_value_size_hints, | |||
const ReadBufferFromFileBase::ProfileCallback & profile_callback) const | |||
{ | |||
auto new_settings = reader_settings; | |||
new_settings.convert_nested_to_subcolumns = true; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Don't understand.
src/DataTypes/DataTypeArray.cpp
Outdated
sizes_data.resize(offsets_data.size()); | ||
sizes_data[0] = offsets_data[0]; | ||
for (size_t i = 1; i < offsets_data.size(); ++i) | ||
sizes_data[i] = offsets_data[i] - offsets_data[i - 1]; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I expect that compiler will generate suboptimal code due to possible aliasing.
src/DataTypes/DataTypeArray.cpp
Outdated
offsets_data.resize(sizes_data.size()); | ||
offsets_data[0] = sizes_data[0]; | ||
for (size_t i = 0; i < sizes_data.size(); ++i) | ||
offsets_data[i] = offsets_data[i - 1] + sizes_data[i]; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The same issue as above.
Looks like conversion from ANTLR AST is wrong. I will disable this test for ANTLR. |
I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Data type
Nested
now supports arbitrary levels of nesting. Introduced subcolumns of complex types, such assize0
inArray
,null
inNullable
, names ofTuple
elements, which can be read without reading of whole column.Detailed description / Documentation draft:
Continuation of #14963.
This closes #18826.