Add KTO loss on DPO

[w5688414]

PR types

PR changes

Description

[paddle-bot]

Thanks for your contribution!

[codecov]

Codecov Report

Attention: Patch coverage is 26.66667% with 22 lines in your changes missing coverage. Please review.

Project coverage is 54.29%. Comparing base (09a0ce7) to head (9c79701).
Report is 185 commits behind head on develop.

Files	Patch %	Lines
paddlenlp/datasets/intokens_dataset.py	16.66%	10 Missing ⚠️
paddlenlp/trainer/trainer.py	0.00%	8 Missing ⚠️
paddlenlp/trainer/trainer_utils.py	33.33%	2 Missing ⚠️
paddlenlp/transformers/llama/modeling.py	71.42%	2 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #8461      +/-   ##
===========================================
- Coverage    55.36%   54.29%   -1.08%     
===========================================
  Files          614      617       +3     
  Lines        96016    96342     +326     
===========================================
- Hits         53164    52305     -859     
- Misses       42852    44037    +1185     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。