Skip to content

Pipe Meta: Fixed multiple bugs of pipe meta sync#12115

Merged
SteveYurongSu merged 8 commits intoapache:pipe-meta-syncfrom
Caideyipi:pipe-meta-sync-fix-13
Mar 7, 2024
Merged

Pipe Meta: Fixed multiple bugs of pipe meta sync#12115
SteveYurongSu merged 8 commits intoapache:pipe-meta-syncfrom
Caideyipi:pipe-meta-sync-fix-13

Conversation

@Caideyipi
Copy link
Collaborator

@Caideyipi Caideyipi commented Mar 4, 2024 •
edited
Loading

Description

This PR:

  • Fixed the bug that the sender may skip the file when receiver is out of memory
  • Refactored configNode extractor start logic
  • Fixed IT problem by enable flushing and other fix

This PR has:

  • been self-reviewed.
    • concurrent read
    • concurrent write
    • concurrent read and write
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods.
  • added or updated version, license, or notice information
  • added comments explaining the "why" and the intent of the code wherever would not be obvious
    for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold
    for code coverage.
  • added integration tests.
  • been tested in a test IoTDB cluster.
Key changed/added classes (or packages if there are too many classes) in this PR

@SteveYurongSu SteveYurongSu self-requested a review March 4, 2024 15:57
@SteveYurongSu SteveYurongSu self-assigned this Mar 4, 2024
@Caideyipi Caideyipi changed the title Pipe Meta: Fixed the bug that the sender may skip the file when receiver is out of memory Pipe Meta: Fixed the bug that the sender may skip the file when receiver is out of memory & refactor configNode extractor start logic Mar 5, 2024
@Caideyipi Caideyipi changed the title Pipe Meta: Fixed the bug that the sender may skip the file when receiver is out of memory & refactor configNode extractor start logic Pipe Meta: Fixed the bug that the sender may skip the file when receiver is out of memory & Refactor configNode extractor start logic Mar 5, 2024
@Caideyipi Caideyipi changed the title Pipe Meta: Fixed the bug that the sender may skip the file when receiver is out of memory & Refactor configNode extractor start logic Pipe Meta: Fixed multiple bugs of pipe meta sync Mar 7, 2024
@Caideyipi
Merge remote-tracking branch 'upstream/pipe-meta-sync' into pipe-meta…
523150e 
…-sync-fix-13

# Conflicts:
#	iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/manager/pipe/transfer/execution/PipeConfigNodeSubtask.java
@SteveYurongSu SteveYurongSu merged commit ea6927d into apache:pipe-meta-sync Mar 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@SteveYurongSu SteveYurongSu Awaiting requested review from SteveYurongSu

Assignees

@SteveYurongSu SteveYurongSu

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Caideyipi @SteveYurongSu