Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Switch to filtered prosocial dataset (#3162)
This PR modifies ProsocialDialogue to use the filtered version of the dataset I have created, with less irrelevant data and less rejections. In this modified dataset I have filtered out the mostly irrelevant lines where the safety label is "casual" and "possibly/probably needs caution", which I have found to be mostly pointless, as well as some lines where the phrasing of the response might hurt the model's performance by refusing to act on a request. This is an alternative solution that may work instead of removing the dataset completely, as mentioned in #3144
- Loading branch information