[Feature/Question] - Is it possible to (explicitly) save / re-use GRPO generations in GRPO training?

[ai-nikolai]

Overview of Idea:

1. Currently GRPO generations are being generated online and then often discarded. It would be interesting to save the GRPO dataset into a CSV file (with all the generations for example).
2. It would also be interesting to be able to load a csv / dataset iterator that is able to load up older generations as a mixin...

[github-actions]

Is this issue still important to you? Apologies in advance we might have missed this issue as well. For faster response times, please post on our Reddit server - https://www.reddit.com/r/unsloth or our Discord - https://discord.com/invite/unsloth