请问支持 early stopping 吗？

[zhaiwenjia]

Reminder

• I have read the README and searched the existing issues.

System Info

看了文档和以前的 issue 没有发现有这个功能。谢谢

Reproduction

无

Expected behavior

No response

Others

No response

[CaiJichang212]

Reminder

• I have read the README and searched the existing issues.

System Info

看了文档和以前的 issue 没有发现有这个功能。谢谢

Reproduction

无

Expected behavior

No response

Others

No response

你好，请问现在支持了嘛？early stopping

[yejh123]

同问

[xxupiano]

同问

[plseal]

同问

[SiriusWy]

同问

[imagoodman-aa]

同问

[DenceChen]

给个回复？

[plseal]

https://github.com/hiyouga/LLaMA-Factory/blob/59e12bffe8d823eaa2ece2d0104379865e60a58d/src/llamafactory/train/sft/workflow.py#L86

SFT的时候在上面这个代码的86行下面加这段代码就可以early stopping了。

    callbacks.append(
      EarlyStoppingCallback(early_stopping_patience=5)
    )

import使用这个

from transformers import DataCollatorForLanguageModeling,EarlyStoppingCallback

[DenceChen]

@plseal 很赞我试试，感谢！ 这个默认看loss5个eval-step不提升提前停止？模型保持正常把？