Autoround cannot load the model from local path.
If the path is from huggingface, it loads.
If the path is from local, it gives the error:
auto_round/utils.py", line 1610, in mllm_load_model
model = model.eval()
UnboundLocalError: local variable 'model' referenced before assignment.
If you can hint the issue.
Autoround cannot load the model from local path.
If the path is from huggingface, it loads.
If the path is from local, it gives the error:
If you can hint the issue.