Optimize the performance of optimizer pollTask

[lintingbin]

Why are the changes needed?

Close #3582.

Brief change log

• Optimize the implementation of the TableOptimizingProcess.poll() function to avoid waiting for locks and return immediately if the lock cannot be acquired.

How was this patch tested?

• Add some test cases that check the changes thoroughly including negative and positive cases if possible

• Add screenshots for manual tests if appropriate

• Run test locally before making a pull request

Documentation

• Does this pull request introduce a new feature? no
• If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

[czy006]

Thank you for your contribution,Suggestion add 0.8.1 release fix it

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 40.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 28.26%. Comparing base (58c6013) to head (8557e41).
Report is 2 commits behind head on master.

Files with missing lines	Patch %	Lines
...pache/amoro/server/optimizing/OptimizingQueue.java	40.00%	1 Missing and 2 partials ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master    #3583      +/-   ##
============================================
+ Coverage     21.76%   28.26%   +6.50%     
- Complexity     2391     3702    +1311     
============================================
  Files           431      614     +183     
  Lines         40501    49766    +9265     
  Branches       5745     6434     +689     
============================================
+ Hits           8816    14068    +5252     
- Misses        30938    34690    +3752     
- Partials        747     1008     +261     

Flag	Coverage Δ
core	28.26% <40.00%> (?)
trino	?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[zhoujinsong]

Hi, I am not sure if this is the right path to fix this issue.

Do we find which process got the process lock? @lintingbin @xxubai

[xxubai]

Do we find which process got the process lock? @lintingbin @xxubai

Not yet. I have deployed the release 0.8.0-incubating in our non-production environment and so far have not encountered similar issues.

[lintingbin]

@lintingbin @xxubai It seems that the committing phase is locked. Before we optimized the clients parameter, there were many queues in the committing phase.

[zhoujinsong]

The committing tables will get the process lock and block the poll task process because it is not removed from the tableQueue.

It should be improved, but it is not a new issue for 0.8.0

[lintingbin]

The committing tables will get the process lock and block the poll task process because it is not removed from the tableQueue.

It should be improved, but it is not a new issue for 0.8.0

👌