bump version to v0.2.3

[lvhan028]

No description provided.

[zhyncs]

Hi @lvhan028 hold on please

After #1085, this doesn't work as before.

python3 -m lmdeploy serve api_server /workdir/workspace

traceback

  File "/workdir/lmdeploy/lmdeploy/serve/async_engine.py", line 111, in _build_turbomind
    raise ArgumentError('Please set model_name or backend_config.')
TypeError: __init__() missing 1 required positional argument: 'message'

I have to set model-name explicitly like this.

python3 -m lmdeploy serve api_server /workdir/workspace --model-name llama2

Is this an expected feature or a bug? If it’s a bug, may I fix it before releasing it?

[lvhan028]

@irexyc

[irexyc]

@zhyncs

I can't reproduce your error, are you using the latest main code?

According to your error, the error line is 111, but the code in main branch is at line 109

  File "/workdir/lmdeploy/lmdeploy/serve/async_engine.py", line 111, in _build_turbomind
    raise ArgumentError('Please set model_name or backend_config.')
TypeError: __init__() missing 1 required positional argument: 'message'

[zhyncs]

@zhyncs

I can't reproduce your error, are you using the latest main code?

According to your error, the error line is 111, but the code in main branch is at line 109

  File "/workdir/lmdeploy/lmdeploy/serve/async_engine.py", line 111, in _build_turbomind
    raise ArgumentError('Please set model_name or backend_config.')
TypeError: __init__() missing 1 required positional argument: 'message'

Yes, I use the latest main code.

[zhyncs]

@irexyc use the llama 2 13b chat workspace please

[irexyc]

Found the reason. It was because my workspace folder had a name like vicuna so the best_match_model function can match it to the right model. If the workspace had a name like worksapce, it would failed.

[zhyncs]

Since the _from_workspace handles the model_name

lmdeploy/lmdeploy/turbomind/turbomind.py

Line 374 in 41dd740

self.model_name = cfg.model_name

We don't need raise the exception like this

lmdeploy/lmdeploy/serve/async_engine.py

Lines 107 to 109 in 41dd740

	potential_names = best_match_model(model_path)
	if potential_names is None:
	raise ArgumentError('Please set model_name or backend_config.')

[zhyncs]

Found the reason

Fine, may I send the pr? It's up to you.

[zhyncs]

According to your error, the error line is 111, but the code in main branch is at line 109

I added pdb LOL. It's same.

[zhyncs]

Hi @irexyc May you help review this pr #1125? Thanks.

[RunningLeon]

LGTM