You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Traceback (most recent call last):
File "applications/DeepSpeed-Chat/training/step3_rlhf_finetuning/main.py", line 586, in <module>
main()
File "applications/DeepSpeed-Chat/training/step3_rlhf_finetuning/main.py", line 469, in main
out = trainer.generate_experience(batch_prompt['prompt'],
File "/applications/DeepSpeed-Chat/training/step3_rlhf_finetuning/ppo_trainer.py", line 119, in generate_experience
seq = self._generate_sequence(prompts, mask, step)
File "applications/DeepSpeed-Chat/training/step3_rlhf_finetuning/ppo_trainer.py", line 113, in _generate_sequence
out_seq = torch.cat(out_seq, dim=0) # concate output in the batch dim
RuntimeError: torch.cat(): expected a non-empty list of Tensors
Using A100 cuda=11.8, torch=2.0.0, python=3.10.12, deepspeed=0.10.0, transformers=4.30.2
training script config:
Train RLHF- phase, encountered error:
Using A100 cuda=11.8, torch=2.0.0, python=3.10.12, deepspeed=0.10.0, transformers=4.30.2
training script config:
The text was updated successfully, but these errors were encountered: