[improve][meta] Improve fault tolerance of blocking calls by supporting timeout

[mattisonchao]

Motivation

We've got a lot of blocking calls without a timeout in the BookKeeper metadata plugin. In a bad situation, it will trigger some deadlocks.

Modifications

• Improve the fault tolerance of blocking calls by supporting timeout.

Verifying this change

• Make sure that the change passes the CI checks.

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

[hangc0276]

@horizonzy Please help take a look, thanks.

[horizonzy]

pulsar/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/bookkeeper/PulsarLedgerUnderreplicationManager.java

Line 448 in d06cda6

for (String c : store.getChildren(parent).get()) {

Here should also be catch

[codecov-commenter]

Codecov Report

Merging #21028 (c0df801) into master (0cb1c78) will increase coverage by 39.58%.
Report is 6 commits behind head on master.
The diff coverage is 62.42%.

@@              Coverage Diff              @@
##             master   #21028       +/-   ##
=============================================
+ Coverage     33.56%   73.14%   +39.58%     
- Complexity    12198    32267    +20069     
=============================================
  Files          1621     1875      +254     
  Lines        126970   139577    +12607     
  Branches      13857    15344     +1487     
=============================================
+ Hits          42618   102095    +59477     
+ Misses        78748    29403    -49345     
- Partials       5604     8079     +2475     

Flag	Coverage Δ
inttests	24.23% <1.73%> (-0.01%)	⬇️
systests	25.25% <0.57%> (?)
unittests	72.41% <62.42%> (+40.31%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed	Coverage Δ
...ookkeeper/PulsarLedgerUnderreplicationManager.java	51.09% <52.85%> (+51.09%)	⬆️
...etadata/bookkeeper/PulsarLedgerManagerFactory.java	61.53% <57.14%> (+30.98%)	⬆️
...ookkeeper/LongHierarchicalLedgerRangeIterator.java	81.66% <66.66%> (+81.66%)	⬆️
...metadata/bookkeeper/PulsarRegistrationManager.java	62.56% <70.96%> (+53.16%)	⬆️
...kkeeper/LegacyHierarchicalLedgerRangeIterator.java	72.15% <71.42%> (+72.15%)	⬆️
...ulsar/metadata/bookkeeper/PulsarLayoutManager.java	66.66% <77.77%> (+46.66%)	⬆️
...ar/metadata/bookkeeper/AbstractMetadataDriver.java	75.92% <100.00%> (+26.86%)	⬆️

... and 1514 files with indirect coverage changes

[horizonzy]

LGTM