Will there be exmperimental 4gb VRAM support with smaller model quants?

[Marczellito]

I know i'm asking for a lot, don't treat it as a request feature, but i'm wondering - are there any plans for support of graphics cards with VRAM smaller than 8 GB? That would probably also require smaller quants of models, as even LFM2.5-24B-A2B takes about 4 GB of VRAM even before any expert.
Than you for your work!

[VecSzn]

Thanks for asking. I've not planned for that for now, but the model need already around 4GB on the card before even starting to run with an expert. If you have a 6GB card maybe LFM2.5 or Ornith could work too but that would be untested.

[Marczellito]

Thanks for your response! Sadly my laptop has only 4 GB VRAM so I'm not even gonna try... Keep up the good work!