-
-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Model] Initial support for BLIP-2 #5920
base: main
Are you sure you want to change the base?
Conversation
@DarkLight1337 Thank you very much for your work, looking forward to having BLIP-2 in Vllm! The two underlying PR were merged in Vllm! |
The implementation is done but it appears that the model has some numerical inaccuracies (as shown by the warnings and errors in CI). I will be busy for the next few days so any help with debugging this would be appreciated! |
Looks like it's an issue with |
@ywang96 I got the tests to pass, so we can merge this PR if it looks good to you. |
Implement BLIP-2 model (tested with
Salesforce/blip2-opt-2.7b
).FIX #4739