[To dev/1.3] Pipe: Reduce the memory usage & Enable insertNode memory control for stream mode degrade and stuck restart (#14102)

[SteveYurongSu]

Co-authored-by: Steve Yurong Su rong@apache.org
(cherry picked from commit 3cb544e)

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[codecov]

Codecov Report

Attention: Patch coverage is 35.65217% with 148 lines in your changes missing coverage. Please review.

Project coverage is 41.19%. Comparing base (ad41c55) to head (2b53767).
Report is 2 commits behind head on dev/1.3.

Files with missing lines	Patch %	Lines
...pipe/agent/task/meta/PipeTemporaryMetaInAgent.java	0.00%	29 Missing ⚠️
...otdb/db/pipe/agent/task/PipeDataNodeTaskAgent.java	0.00%	15 Missing ⚠️
...gent/task/meta/PipeTemporaryMetaInCoordinator.java	46.15%	14 Missing ⚠️
...mmons/consensus/index/impl/StateProgressIndex.java	0.00%	12 Missing ⚠️
...ensus/index/impl/TimeWindowStateProgressIndex.java	26.66%	11 Missing ⚠️
.../metric/PipeTemporaryMetaInCoordinatorMetrics.java	0.00%	8 Missing ⚠️
...ol/thrift/impl/DataNodeInternalRPCServiceImpl.java	0.00%	8 Missing ⚠️
...e/iotdb/commons/pipe/agent/task/PipeTaskAgent.java	68.00%	8 Missing ⚠️
...he/iotdb/confignode/persistence/pipe/PipeInfo.java	0.00%	7 Missing ⚠️
...ons/consensus/index/impl/RecoverProgressIndex.java	28.57%	5 Missing ⚠️
... and 17 more

Additional details and impacted files

@@              Coverage Diff              @@
##             dev/1.3   #14161      +/-   ##
=============================================
- Coverage      41.22%   41.19%   -0.04%     
  Complexity        71       71              
=============================================
  Files           3469     3470       +1     
  Lines         222086   222234     +148     
  Branches       26383    26399      +16     
=============================================
- Hits           91562    91548      -14     
- Misses        130524   130686     +162     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

---

🚨 Try these New Features:

• Flaky Tests Detection - Detect and resolve failed and flaky tests