Feature Description
When a model contains an mmproj, it will be put in VRAM, even if i don't intend to use it. Using --no-mmproj-offload would work, but it is forbidden by lemonade. Just allowing the option would be fine for me.
Use Case / Motivation
Have more VRAM for useful things
Platform Relevance
All platforms
Additional Context
No response
Feature Description
When a model contains an mmproj, it will be put in VRAM, even if i don't intend to use it. Using --no-mmproj-offload would work, but it is forbidden by lemonade. Just allowing the option would be fine for me.
Use Case / Motivation
Have more VRAM for useful things
Platform Relevance
All platforms
Additional Context
No response