disable_dropout not used in KTOTrainer

[zwhe99]

When I looked in to the code of KTO, I found a disable_dropout arg in the comment.

trl/trl/trainer/kto_trainer.py

Lines 255 to 256 in 9a28b3f

	disable_dropout (`bool`, defaults to `True`):
	Whether or not to disable dropouts in `model` and `ref_model`.

It has never been used in the code. Actually, KTO always disables dropout:

trl/trl/trainer/kto_trainer.py

Lines 459 to 462 in 9a28b3f

	# disable dropout in the model and reference model
	disable_dropout_in_model(model)
	if self.ref_model is not None:
	disable_dropout_in_model(self.ref_model)

Is this an expected behavior?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.