feat: support pull and load vision model

[vansangpfiev]

Describe Your Changes

This pull request introduces several updates to the handling of model configurations, particularly around the inclusion of a new mmproj field. The changes span multiple files and primarily focus on ensuring that the mmproj field is appropriately read, stored, and written in the configuration process.

Key changes include:

Model Configuration Updates:

• Added a new mmproj field to the ModelConfig structure and ensured it is included when converting to and from JSON. (engine/config/model_config.h - [1] [2]
• Updated the RemoteModelConfig structure to ensure consistent formatting. (engine/config/model_config.h - engine/config/model_config.hL38-R38)

YAML Handling Enhancements:

• Modified YamlHandler::ReadYamlFile to add the mmproj file to the YAML configuration if it exists. (engine/config/yaml_config.cc - engine/config/yaml_config.ccR44-R57)
• Updated YamlHandler::ModelConfigFromYaml to read the mmproj field from the YAML configuration. (engine/config/yaml_config.cc - engine/config/yaml_config.ccR148-R149)
• Enhanced YamlHandler::UpdateModelConfig and YamlHandler::WriteYamlFile to handle the mmproj field. (engine/config/yaml_config.cc - [1] [2]

Model Service and Controller Adjustments:

• Adjusted the Models::StartModel method to correctly check for the presence of the mmproj field. (engine/controllers/models.cc - engine/controllers/models.ccL536-R537)
• Updated ModelService::StartModel to include the mmproj field in the JSON data if it is not empty. (engine/services/model_service.cc - engine/services/model_service.ccR953-R961)

Fixes Issues

• idea: support pull vision models from cortexso hub #2048

Self Checklist

• API: pull vision models, completion request via /v1/chat/completions

[github-actions]

Preview URL: https://0fdd70f7.cortex-docs.pages.dev