Skip to content

fix(opd): pin teacher scoring temperature to 1.0 - #2319

Open
kkyyxhll wants to merge 1 commit into
THUDM:mainfrom
kkyyxhll:fix/opd-teacher-scoring-temperature
Open

fix(opd): pin teacher scoring temperature to 1.0#2319
kkyyxhll wants to merge 1 commit into
THUDM:mainfrom
kkyyxhll:fix/opd-teacher-scoring-temperature

Conversation

@kkyyxhll

Copy link
Copy Markdown

@zhuzilin 辛苦review一下,非常感谢!
pr #2085 把opd的teacher payload的temperature0.0 改成了 args.rollout_temperature,但sgl内input的logp使用的都是1.0。因此会引起混淆。

sgl 的 SGLANG_RETURN_ORIGINAL_LOGPROB和temperature只影响output的logp,input的logp不受影响(opd在这,max_new_tokens=0)

下面是实际测试结果,不同temperature并不影响input的各种logp
起serve:

python -m sglang.launch_server \
  --model /root/Qwen3-0.6B \
  --reasoning-parser qwen3 \
  --tool-call-parser qwen25

temperature=1.0的payload

curl -s http://127.0.0.1:30010/generate -H 'Content-Type: application/json' -d '{
  "input_ids": [3838,374,279,6722,315,9625,30,576,6722,315,9625,374,12095],
  "sampling_params": {"temperature": 1, "max_new_tokens": 0},
  "return_logprob": true,
  "logprob_start_len": 0
}'

结果(temperature=1.0)
image

修改payload的temperature=2.0
结果如下(temperature=2.0)
image

修改payload的temperature=0.5
结果如下(temperature=0.5)
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant