Skip to content

Inference failure in the Qwen3 Omni quantized model #862

@Tortoise17

Description

@Tortoise17

Autoround cannot load the model from local path.

If the path is from huggingface, it loads.

If the path is from local, it gives the error:


auto_round/utils.py", line 1610, in mllm_load_model
model = model.eval()
UnboundLocalError: local variable 'model' referenced before assignment. 

If you can hint the issue.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions