Skip to content

v1.2.2

Latest

Choose a tag to compare

@chengruiz chengruiz released this 30 Sep 12:42
· 20 commits to main since this release

This release improves training stability, normalization configuration, and mjlab integration, with fixes for hook initialization, CLI argument inheritance, and package distribution.

Added

  • NormFactory for configurable RMSNorm and LayerNorm in attention and transformer layers, including eps and elementwise_affine options for qk_norm and block_norm.
  • Custom activation imports through module-qualified names in resolve_activation_fn.
  • dtype, copy, and requires_grad options in Agent.to_tensor.
  • Public export of configure_distributed_cache_dirs from cusrl.utils; the helper now safely skips configuration when RANK is unset.

Breaking / Migration Notes

  • HookComposite.compile() now leaves the composite objective uncompiled by default. Pass compiled_objective=True to enable its compilation.
  • Activation strings such as "nn.ReLU" and "torch.ReLU" should be replaced with "ReLU" or "torch.nn.ReLU".

Fixed

  • Improved numerical stability in AdvantageNormalization by using population variance, avoiding undefined variance for single-sample inputs.
  • Improved grouped variance computation in RunningMeanStd and added validation for positive epsilon.
  • ObservationNormalization now defers synchronization only when distributed execution is enabled.
  • Initially inactive hooks now receive pre_init, init, and post_init, ensuring they are ready for later activation.
  • Agent.to_tensor now copies NumPy input by default, preventing unintended storage sharing.
  • Fixed inheritance of inline Tyro arguments such as --env-args=... and --env-kwargs=....
  • EnvironmentFactorySpec.make_environment() no longer mutates the stored environment kwargs.
  • MjlabEnvAdapter now respects the environment's auto_reset setting, reports its timestep, and saves/restores common_step_counter.
  • Added positive num_batches and batch_size validation to RandomSampler, TemporalRandomSampler, and AutoRandomSampler.
  • Corrected setuptools package discovery to include all cusrl subpackages.