Skip to content

[FEAT] Support OpenVINO vision model #32

@szeyu

Description

@szeyu

Is your feature request related to a problem? Please describe.

Reference :

OpenVINO has created its own python code ov_phi3_vision.py to support vision model

Describe the solution you'd like

Vision Langauge Model Support:

Quantised vision model weight

Model Model Link
Phi-3.5-vision-instruct-int4-ov link

Additional context

Vision model and Non-Vision model should be initialised in a separated way as both model loaded in different way.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions