polish(pu): polish comments in a2c/bcq/fqf/ibc policy

[puyuan1996]

Description

• polish(pu): polish comments in dqn, a2c, bcq, fqf, ibc.

Related Issue

TODO

Check List

• merge the latest version source branch/repo, and resolve all the conflicts
• pass style check
• pass all the tests

[codecov]

Codecov Report

Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (a57bc30) 76.78% compared to head (1e07862) 76.79%.

Files	Patch %	Lines
ding/policy/bcq.py	66.66%	4 Missing ⚠️

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #768   +/-   ##
=======================================
  Coverage   76.78%   76.79%           
=======================================
  Files         676      676           
  Lines       54431    54427    -4     
=======================================
- Hits        41797    41796    -1     
+ Misses      12634    12631    -3     

Flag	Coverage Δ
unittests	76.79% <87.87%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.