Skip to content

BaseAgent, scalar losses#98

Merged
jakegrigsby merged 16 commits intomainfrom
scalar_loss
Mar 3, 2026
Merged

BaseAgent, scalar losses#98
jakegrigsby merged 16 commits intomainfrom
scalar_loss

Conversation

@jakegrigsby
Copy link
Copy Markdown
Collaborator

@jakegrigsby jakegrigsby commented Mar 3, 2026

An update that makes it easier to customize agents in external projects

  • creates a BaseAgent
  • refactors loss computation to be less specific to (actor_loss, critic_loss)
  • registration system (@register_agent etc) makes it easier to plug custom objects into example training scripts

And adds some RL things:

  • n_step returns
  • hl-gauss style value regression labels (instead of two-hot)
  • extra options for normalization in MLP components

@jakegrigsby jakegrigsby merged commit db6d5e7 into main Mar 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant