[Enhancement] Routine load task schduling

[rickif]

Why I'm doing:
Now, the routine load task scheduling may be slowed down by some slow tasks.
What I'm doing:

1. remove the limit of routine load task scheduler threadpool
2. Quickly determine if a task needs to be scheduled based on local offset information

Fixes #issue

What type of PR is this:

• BugFix
• Feature
• Enhancement
• Refactor
• UT
• Doc
• Tool

Does this PR entail a change in behavior?

• Yes, this PR will result in a change in behavior.
• No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

• Interface/UI changes: syntax, type conversion, expression evaluation, display information
• Parameter changes: default values, similar parameters but with different default values
• Policy changes: use new policy to replace old one, functionality automatically enabled
• Feature removed
• Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

• I have added test cases for my bug fix or my new feature
• This pr needs user documentation (for new or modified features or behaviors)
  • I have added documentation for my new feature or new function
• This is a backport pr

Bugfix cherry-pick branch check:

• I have checked the version labels which the pr will be auto-backported to the target branch
  • 3.2
  • 3.1
  • 3.0
  • 2.5

[starrocks-cr]

The most risky bug in this code is:
Potential ClassCastException when casting RoutineLoadJob to KafkaRoutineLoadJob without checking its type.

You can modify the code like this:

// Add a type check before casting
if (routineLoadJob instanceof KafkaRoutineLoadJob) {
    KafkaRoutineLoadJob kafkaRoutineLoadJob = (KafkaRoutineLoadJob) routineLoadJob;
    // existing code continues here...
} else {
    // handle the case where it's not an instance of KafkaRoutineLoadJob, possibly throw an exception or return false
}

[sonarcloud]

Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[github-actions]

[FE Incremental Coverage Report]

✅ pass : 14 / 16 (87.50%)

file detail

	path	covered_line	new_line	coverage	not_covered_line_detail
🔵	com/starrocks/load/routineload/KafkaTaskInfo.java	12	14	85.71%	[101, 125]
🔵	com/starrocks/load/routineload/RoutineLoadTaskScheduler.java	1	1	100.00%	[]
🔵	com/starrocks/load/routineload/KafkaRoutineLoadJob.java	1	1	100.00%	[]

[github-actions]

[BE Incremental Coverage Report]

✅ pass : 0 / 0 (0%)

[github-actions]

@Mergifyio backport branch-3.2

[github-actions]

@Mergifyio backport branch-3.1

[github-actions]

@Mergifyio backport branch-3.0

[github-actions]

@Mergifyio backport branch-2.5

[mergify]

backport branch-3.2

✅ Backports have been created

• #38284 [Enhancement] Routine load task schduling (backport #37638) has been created for branch branch-3.2 but encountered conflicts

[mergify]

backport branch-3.1

✅ Backports have been created

• #38285 [Enhancement] Routine load task schduling (backport #37638) has been created for branch branch-3.1 but encountered conflicts

[mergify]

backport branch-3.0

✅ Backports have been created

• #38286 [Enhancement] Routine load task schduling (backport #37638) has been created for branch branch-3.0 but encountered conflicts

[mergify]

backport branch-2.5

✅ Backports have been created

• #38287 [Enhancement] Routine load task schduling (backport #37638) has been created for branch branch-2.5 but encountered conflicts