Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extract independent snapshot functions for metrics: network, RL, experiment, statistics etc. #209

Open
zuoxingdong opened this issue Jun 14, 2020 · 0 comments

Comments

@zuoxingdong
Copy link
Owner

zuoxingdong commented Jun 14, 2020

This will dramatically increase reusability and reduce boilerplate code.

e.g.

snapshot_nn(net, ['total_parameters', 'trainable_parameters'])

Networks:

  • Total parameters: trainable parameters, un-trainable parameters
    • Extract the number of such parameters
    • Extract a generator of such parameters
  • Gradient norm

Policy:

  • Entropy
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant