New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

是否提供基于ziya的inference code？ #51

Closed

liu6381810 opened this issue Jul 10, 2023 · 1 comment

liu6381810 commented Jul 10, 2023

想load一个基于ziya的video-llama模型跑video caption任务，目前是否提供类似的inference脚本。或者直接从demo.py里去改吗？

Contributor

lixin4ever commented Jul 10, 2023

目前只有VL-only Video-LLaMA (也就是只有视觉分支的Video-LLaMA)支持中文, 可以尝试修改demo_video.py和video_llama_eval.yaml来运行本地demo并进行推理

需要注意的是，我们只是在第二阶段训练中加入了11K翻译后的指令微调数据，可能训练得不是很充分

lixin4ever closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment