Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

生成结果|endoftext|后面很奇怪，不知道贼干啥 #6

Closed
htw2012 opened this issue Aug 4, 2023 · 2 comments
Closed

生成结果|endoftext|后面很奇怪，不知道贼干啥 #6

htw2012 opened this issue Aug 4, 2023 · 2 comments

Comments

@htw2012
Copy link

htw2012 commented Aug 4, 2023

image
@Jintao-Huang
Copy link
Collaborator

推理qwen-7b-chat可以参考: https://modelscope.cn/models/qwen/Qwen-7B-Chat/summary
examples/pytorch/llm目录下的llm_infer.py文件是推理llm_sft.py微调产生的模型的.

@Jintao-Huang
Copy link
Collaborator

哈咯, 我们排查了一下，是因为generate_config中没有增加eos_token_id造成的, 该bug已经修复啦 ~

@greatheart1000 greatheart1000 mentioned this issue May 15, 2024
Closed
@zhangfan-algo zhangfan-algo mentioned this issue Jun 7, 2024
Closed
@aoyinke aoyinke mentioned this issue Jun 27, 2024
Closed
@LIUKAI0815 LIUKAI0815 mentioned this issue Sep 14, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@htw2012 @Jintao-Huang