Update Input Template of RL Policy to Improve Module Flexisiblity

[Jinyu-W]

Description

RL Workflow:

• add customized_callbacks to RLComponentBundle
• add env.tick to replace the default None in AbsEnvSampler._get_global_and_agent_state()

RL Algorithms:

• fix RL algorithms to_device issue
• add **kwargs to support more problem setting (e.g., Graph based ones)
  • add **kwargs to RL models' forward funcs and _shape_check()
  • add **kwargs to RL policies' get_action related funcs and _post_check()
  • add **kwargs to choose_actions of AbsEnvSampler; remain it None in current sample() and eval()
• add detached loss to the return value of update_critic() and update_actor() of current TrainOps; add default False early_stop to update_actor() of current TrainOps

Linked issue(s)/Pull request(s)

• issue_number

Type of Change

• Non-breaking bug fix
• Breaking bug fix
• New feature
• Test
• Doc update
• Docker update

Related Component

• Simulation toolkit
• RL toolkit
• Distributed toolkit

Has Been Tested

• OS:
  • Windows
  • Mac OS
  • Linux
• Python version:
  • 3.7
  • 3.8
  • 3.9
• Key information snapshot(s):

Needs Follow Up Actions

• New release package
• New docker image

Checklist

• Add/update the related comments
• Add/update the related tests
• Add/update the related documentations
• Update the dependent downstream modules usage

[lihuoran]

Is **kwargs used in _shape_check()? Or you just want to keep it for future flexibility?

[Jinyu-W]

Not used yet. Only for future flexibility.