Skip to content

[To dev/1.3] Pipe/Load: Implement multi-disk awareness of multiple file systems during file copying and moving (#15356)#16052

Merged
Caideyipi merged 2 commits intoapache:dev/1.3from
luoluoyuyu:cp-multi-disk
Aug 4, 2025
Merged

[To dev/1.3] Pipe/Load: Implement multi-disk awareness of multiple file systems during file copying and moving (#15356)#16052
Caideyipi merged 2 commits intoapache:dev/1.3from
luoluoyuyu:cp-multi-disk

Conversation

@luoluoyuyu
Copy link
Member

Description

As the title said


This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR

luoluoyuyu and others added 2 commits July 29, 2025 15:10
…ring file copying and moving (apache#15356)

* Pipe/Load: Implement multi-disk awareness of multiple file systems during file copying and moving

* spotless

* fix

* fix

* update ActiveLoadUtil

* update InheritSystemMultiDisksStrategySelector

* update ILoadDisksSelector

* update ActiveLoadUtil

* fix

* fix

* modify the code based on review comments

* modify the code based on review comments

* spotless

* fix

* fix

(cherry picked from commit 432e027)

# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/protocol/thrift/IoTDBDataNodeReceiver.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileAnalyzer.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/disk/ILoadDiskSelector.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/disk/InheritSystemMultiDisksStrategySelector.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/load/disk/MinIOSelector.java
@luoluoyuyu luoluoyuyu closed this Aug 1, 2025
@luoluoyuyu luoluoyuyu deleted the cp-multi-disk branch August 1, 2025 01:53
@luoluoyuyu luoluoyuyu restored the cp-multi-disk branch August 1, 2025 07:10
@luoluoyuyu luoluoyuyu reopened this Aug 1, 2025
Copy link
Collaborator

@Caideyipi Caideyipi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Caideyipi Caideyipi merged commit 64b5f6c into apache:dev/1.3 Aug 4, 2025
33 of 35 checks passed
@luoluoyuyu luoluoyuyu deleted the cp-multi-disk branch August 12, 2025 01:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants