Skip to content

[Feature/Question] - Is it possible to (explicitly) save / re-use GRPO generations in GRPO training? #2602

@ai-nikolai

Description

@ai-nikolai

Overview of Idea:

  1. Currently GRPO generations are being generated online and then often discarded. It would be interesting to save the GRPO dataset into a CSV file (with all the generations for example).
  2. It would also be interesting to be able to load a csv / dataset iterator that is able to load up older generations as a mixin...

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions