-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add Qwen1.5 in LLaVA #1146
base: main
Are you sure you want to change the base?
add Qwen1.5 in LLaVA #1146
Conversation
I encountered this issue after making the modifications: Traceback (most recent call last): |
@20191864218 You should make change as follow: |
I followed your steps to modify the corresponding part of the code, but the error still persists. `from typing import List, Optional, Tuple, Union import torch from transformers import AutoConfig, AutoModelForCausalLM from transformers.modeling_outputs import CausalLMOutputWithPast from ..llava_arch import LlavaMetaModel, LlavaMetaForCausalLM class LlavaTaiyiConfig(QWenConfig): class LlavaTaiyiModel(LlavaMetaModel, QWenModel):
class LlavaTaiyiForCausalLM(QWenLMHeadModel, LlavaMetaForCausalLM):
AutoConfig.register("llava_Taiyi", LlavaTaiyiConfig) |
Just curious, how is the two-stage training doing? Will qwen-based LLaVA perform better, maybe in terms of dialogue capability, reasoning capability, etc? |
|
Yes, this is just a test I conducted to explore the capabilities of larger SOTA language models under the LLaVA framework. Perhaps I should wait until I have more refined results before presenting them. |
你好,我在使用qwen的时候也遇到了相同的问题,tokenizer的相关文件是指qwen模型里的tokenization_qwen.py吗?我已经使用了huggingface上qwen模型的文件,是更新到哪个版本呢? |
我是把此链接下的文件全部替换 |
好的,感谢回复,是用https://huggingface.co/Qwen/Qwen-tokenizer的文件替换下载的qwen模型里的文件是嘛? |
是的,全部替换即可 |
Thanks a lot! It's a great help. |
No description provided.