commit vulkan compute command as soon as enough pending dispatches collected for avoiding driver timeout

[nihui]

Significantly reduce the vkWaitForFences failed -4 error caused by insufficient GPU computing power.

[tencent-adm]

Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[codecov-commenter]

Codecov Report

❌ Patch coverage is 84.61538% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 93.18%. Comparing base (1b847b1) to head (6b3c54c).

Files with missing lines	Patch %	Lines
src/gpu.cpp	85.29%	5 Missing ⚠️
src/net.cpp	75.00%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #6541      +/-   ##
==========================================
+ Coverage   93.16%   93.18%   +0.01%     
==========================================
  Files         847      847              
  Lines      266225   267341    +1116     
==========================================
+ Hits       248040   249109    +1069     
- Misses      18185    18232      +47     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[Copilot]

Pull request overview

This PR aims to reduce Vulkan driver timeouts (e.g., vkWaitForFences failed -4) by proactively submitting compute command buffers once enough work has been queued, with thresholds scaled by a newly introduced GPU “rough performance score”.

Changes:

• Add GpuInfo::rough_score() and compute/log the score during Vulkan device initialization.
• Track queued compute work via VkCompute::pending_dispatch_total().
• In Vulkan NetPrivate::forward_layer, submit and reset the command buffer early when pending dispatches exceed a score-based threshold.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
src/net.cpp	Adds early submit logic based on pending dispatch count and GPU rough score.
src/gpu.h	Exposes GpuInfo::rough_score() API with documentation.
src/gpu.cpp	Implements rough score evaluation and logs it during GPU instance creation.
src/command.h	Exposes VkCompute::pending_dispatch_total() for submit heuristics.
src/command.cpp	Tracks and resets pending dispatch totals during command recording/submit/reset.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.