Skip to content

[To dev/1.3] Improve pipe runtime memory allocation#18135

Merged
jt2594838 merged 1 commit into
apache:dev/1.3from
Caideyipi:cp-35cf94a-dev-1.3
Jul 7, 2026
Merged

[To dev/1.3] Improve pipe runtime memory allocation#18135
jt2594838 merged 1 commit into
apache:dev/1.3from
Caideyipi:cp-35cf94a-dev-1.3

Conversation

@Caideyipi

Copy link
Copy Markdown
Collaborator

This PR cherry-picks 35cf94a (#18051) to dev/1.3.

Adaptations for dev/1.3:

  • Keep dev/1.3 pipeconsensus/container structure instead of master iotconsensusv2/parser/i18n layout.
  • Port dynamic pipe runtime memory allocation changes for TsFile parsing, batching, and file transfer buffers.

Validation:

  • mvn spotless:apply -pl iotdb-core/datanode
  • mvn -Ddevelocity.off=true test -pl iotdb-core/datanode -Dtest=TsFileInsertionDataContainerTest
  • mvn -Ddevelocity.off=true test -pl iotdb-core/datanode -Dtest=PipeDataNodeTaskAgentTest

* Improve pipe runtime memory allocation

* Fix pipe TsFile parser memory self-lock

* Fix Chinese pipe TsFile parser i18n message

* Fix TsFile parser OOM retry test setup

* Address pipe dynamic memory review comments

* Fix scan parser tablet memory release

* Deduplicate pipe meta heartbeat reporting

* Reduce pipe sync file transfer duplication

* Fix pipe i18n review comments

(cherry picked from commit 35cf94a)
@jt2594838 jt2594838 merged commit 46badda into apache:dev/1.3 Jul 7, 2026
15 of 18 checks passed
@jt2594838 jt2594838 deleted the cp-35cf94a-dev-1.3 branch July 7, 2026 09:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants