Skip to content

[To dev/1.3] Load: Flush ChunkGroup to a temporary file and cache TableSchema in advance to reduce memory allocation && Add IT test about Load file across multiple time partitions (#16225) (#16253)#16273

Merged
Caideyipi merged 4 commits intoapache:dev/1.3from
luoluoyuyu:cp-load
Aug 27, 2025

Conversation

@luoluoyuyu
Copy link
Member

Description

As the title said


This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

…dvance to reduce memory allocation (apache#16225)

* Load: Flush ChunkGroup to a temporary file and cache TableSchema in advance to reduce memory allocation

* update

* update

* update

* update

* fix

* fix

* update

* update

(cherry picked from commit 2a46823)
…ache#16253)

* add IT

* add IT

(cherry picked from commit 67c450b)

# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/conf/IoTDBConfig.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/conf/IoTDBDescriptor.java
Copy link
Collaborator

@Caideyipi Caideyipi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Caideyipi Caideyipi merged commit 926a086 into apache:dev/1.3 Aug 27, 2025
17 of 18 checks passed
@luoluoyuyu luoluoyuyu deleted the cp-load branch August 29, 2025 10:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments