Skip to content

Remove the logic of memtable flush controlled by memory series size#13653

Closed
HTHou wants to merge 44 commits intomasterfrom
split_text_chunk
Closed

Remove the logic of memtable flush controlled by memory series size#13653
HTHou wants to merge 44 commits intomasterfrom
split_text_chunk

Conversation

@HTHou
Copy link
Contributor

@HTHou HTHou commented Sep 29, 2024

Description

In this PR, if the row number of a memory chunk exceeded the avgSeriesPointNumberThreshold, or the size of a binary type memory chunk exceeded the targetChunkSize, this memory chunk will split to multiple disk chunks in the TsFile.

@HTHou HTHou closed this Sep 29, 2024
@codecov
Copy link

codecov bot commented Sep 29, 2024

Codecov Report

Attention: Patch coverage is 81.62162% with 34 lines in your changes missing coverage. Please review.

Project coverage is 39.47%. Comparing base (fd721d6) to head (f016492).
Report is 7 commits behind head on master.

Files with missing lines Patch % Lines
...e/dataregion/memtable/AlignedWritableMemChunk.java 83.52% 14 Missing ⚠️
...geengine/dataregion/memtable/WritableMemChunk.java 82.14% 10 Missing ⚠️
...he/iotdb/db/utils/datastructure/AlignedTVList.java 69.56% 7 Missing ⚠️
...ageengine/dataregion/memtable/TsFileProcessor.java 66.66% 2 Missing ⚠️
...pache/iotdb/db/service/metrics/WritingMetrics.java 0.00% 1 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #13653      +/-   ##
============================================
+ Coverage     39.41%   39.47%   +0.06%     
  Complexity      193      193              
============================================
  Files          4342     4342              
  Lines        275482   275504      +22     
  Branches      33637    33644       +7     
============================================
+ Hits         108580   108763     +183     
+ Misses       166902   166741     -161     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@HTHou HTHou reopened this Sep 29, 2024
@HTHou HTHou changed the title [DRAFT] Split MemChunk if row number exceeded the avgSeriesPointNumberThreshold Remove the logic of memtable flush controlled by memory chunk size Oct 10, 2024
@HTHou HTHou marked this pull request as ready for review October 12, 2024 07:08
@HTHou HTHou changed the title Remove the logic of memtable flush controlled by memory chunk size Remove the logic of memtable flush controlled by memory series size Oct 12, 2024
@sonarqubecloud
Copy link

@HTHou HTHou closed this Dec 30, 2024
@HTHou HTHou deleted the split_text_chunk branch December 30, 2024 09:29
@HTHou
Copy link
Contributor Author

HTHou commented Dec 30, 2024

moved to #14591

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants