fix the action error with no go.sum file

[zhzhuang-zju]

What type of PR is this?
/kind cleanup

What this PR does / why we need it:
Refer to #4901, we need to remove the redundant path settings in ci.yaml to fix the action error with no go.sum file.

Which issue(s) this PR fixes:
Fixes #4901

Special notes for your reviewer:
none
Does this PR introduce a user-facing change?:

NONE

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 53.15%. Comparing base (c7c8f49) to head (ddccefe).

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #4902      +/-   ##
==========================================
+ Coverage   53.12%   53.15%   +0.02%     
==========================================
  Files         251      251              
  Lines       20417    20417              
==========================================
+ Hits        10847    10852       +5     
+ Misses       8856     8852       -4     
+ Partials      714      713       -1     

Flag	Coverage Δ
unittests	53.15% <ø> (+0.02%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[RainbowMango]

/lgtm
/assign @liangyuanpeng

[liangyuanpeng]

Verifyed and not warning now.
/approve

[karmada-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: liangyuanpeng

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• .github/workflows/OWNERS [liangyuanpeng]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment