When using a 32GB GPU, the VRAM becomes extremely tight for VL models approaching 33GB（eg. Qwen3 vl 30B Q8）, as it is insufficient to accommodate most layers of the main language model alongside the visual projector simultaneously. This option can free up approximately several GB of VRAM, making this parameter extremely useful.And some times visual projector can not work well on old GPUs。
When using a 32GB GPU, the VRAM becomes extremely tight for VL models approaching 33GB（eg. Qwen3 vl 30B Q8）, as it is insufficient to accommodate most layers of the main language model alongside the visual projector simultaneously. This option can free up approximately several GB of VRAM, making this parameter extremely useful.And some times visual projector can not work well on old GPUs。