-
Notifications
You must be signed in to change notification settings - Fork 62
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ValueError: 150004 is not in list #22
Comments
大家有遇到这个ValueError么,我看了一下obj["prompt"]最后一个值为130004,把代码里的context_length = obj['prompt'].index(150004)改成了context_length = obj['prompt'].index(130004),然后报了另外一个错误,有人知道解决方法么:
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 2409803) of binary: /tal-vePFS/SFT/dengshuhao1/local/anaconda3/envs/Chatglm_lora_multi-gpu/bin/python
|
看了之前的issue,拉取了最新的代码,好像还是有这个ValueError: 150004 is not in list的问题,有人遇到过么,大佬可以帮助解答一下么,拜托了@liangwq |
清华更新了他们的模型和token。你可以进入到模型里面看他的最新的token config的json文件怎么写的 |
能详细解释下啥意思么? |
|
@dsh54054 这个问题您解决了吗,遇到同样的问题了 |
@algorithmconquer 把multi_gpu_fintune_belle.py的变量EOS_ID = 150005修改为EOS_ID = 130005就可以了 |
@dsh54054 多谢 |
Failures:
[1]:
time : 2023-04-12_07:04:52
host : localhost
rank : 1 (local_rank: 1)
exitcode : 1 (pid: 2408522)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
Root Cause (first observed failure):
[0]:
time : 2023-04-12_07:04:52
host : localhost
rank : 0 (local_rank: 0)
exitcode : 1 (pid: 2408521)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html
The text was updated successfully, but these errors were encountered: