Use batch to list the job id in the job queue to avoid crash redis

[stonezdj]

fixes: #19436

Thank you for contributing to Harbor!

Comprehensive Summary of your change

Issue being fixed

Fixes #(issue)

Please indicate you've done the following:

• Well Written Title and Summary of the PR
• Label the PR as needed. "release-note/ignore-for-release, release-note/new-feature, release-note/update, release-note/enhancement, release-note/community, release-note/breaking-change, release-note/docs, release-note/infra, release-note/deprecation"
• Accepted the DCO. Commits without the DCO will delay acceptance.
• Made sure tests are passing and test coverage is added if needed.
• Considered the docs impact and opened a new docs issue or PR with docs changes if needed in website repository.

[codecov]

Codecov Report

Merging #19444 (035d788) into main (84a85fb) will decrease coverage by 25.81%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main   #19444       +/-   ##
===========================================
- Coverage   70.62%   44.81%   -25.81%     
===========================================
  Files         744      244      -500     
  Lines       95316    13416    -81900     
  Branches        0     2752     +2752     
===========================================
- Hits        67319     6013    -61306     
+ Misses      24356     7097    -17259     
+ Partials     3641      306     -3335     

Flag	Coverage Δ
unittests	44.81% <ø> (-25.81%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 988 files with indirect coverage changes

[chlins]

lgtm

[wy65701436]

lgtm