In which Training step do you use HH-RLHF and SHP datasets?

[richhh520]

In which Training step do you use HH-RLHF and SHP datasets?
Thanks for your help.

[Edward-Sun]

Hi @richhh520

They are used in the first step of training the reward model, i.e., preference model pre-training