Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use compressed chunk tupdesc to check which metadata columns we have #6663

Merged
merged 1 commit into from Feb 23, 2024

Conversation

akuzm
Copy link
Member

@akuzm akuzm commented Feb 16, 2024

The compressed qual pushdown will look at presence of metadata columns in the compressed chunk, not at whether the uncompressed column is an orderby. This way, the decision on which columns have metadata is made only during the creation of compressed chunk.

Apply the same approach in row compressor as well.

This doesn't introduce any behavior changes, just changes the decision about which columns have metadata to happen in a single place. This will simplify experimenting with configurable metadata columns.

Disable-check: force-changelog-file

Copy link

codecov bot commented Feb 16, 2024

Codecov Report

Attention: Patch coverage is 84.61538% with 8 lines in your changes are missing coverage. Please review.

Project coverage is 81.44%. Comparing base (59f50f2) to head (0005dbe).
Report is 24 commits behind head on main.

Files Patch % Lines
tsl/src/compression/compression.c 75.00% 0 Missing and 4 partials ⚠️
tsl/src/nodes/decompress_chunk/qual_pushdown.c 88.88% 1 Missing and 2 partials ⚠️
tsl/src/compression/create.c 88.88% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6663      +/-   ##
==========================================
+ Coverage   80.06%   81.44%   +1.37%     
==========================================
  Files         190      191       +1     
  Lines       37181    36421     -760     
  Branches     9450     9459       +9     
==========================================
- Hits        29770    29662     -108     
+ Misses       2997     2985      -12     
+ Partials     4414     3774     -640     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@akuzm akuzm marked this pull request as ready for review February 16, 2024 17:23
@antekresic antekresic self-requested a review February 19, 2024 14:55
Copy link
Contributor

@antekresic antekresic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Copy link
Member

@svenklemm svenklemm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@akuzm akuzm force-pushed the metadata branch 2 times, most recently from 30879e8 to 35586ec Compare February 22, 2024 19:53
The compressed qual pushdown will look at presence of metadata columns
in the compressed chunk, not at whether the uncompressed column is an
orderby. This way, the decision on which columns have metadata is made
only during the creation of compressed chunk.

This doesn't introduce any behavior changes, just changes the decision
about which columns have metadata to happen in a single place. This will
simplify experimenting with configurable metadata columns.
@akuzm akuzm merged commit 402c1c3 into timescale:main Feb 23, 2024
43 checks passed
@akuzm akuzm deleted the metadata branch February 23, 2024 08:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants