Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add restful interface regrssion daily test workflow. #1302

Merged
merged 34 commits into from
Mar 19, 2024
Merged

Add restful interface regrssion daily test workflow. #1302

merged 34 commits into from
Mar 19, 2024

Conversation

zhulinJulia24
Copy link
Collaborator

@zhulinJulia24 zhulinJulia24 commented Mar 18, 2024 •
edited

  1. whl package instead of build process
  2. add restful interface regression into daily workflow. Now restful testcase will lead server crash in main branch, so the default value is false.

daily workflow will like this:

image

  1. modelname llama-2 into llama2, because of support model update feature.
  2. fix Llama-2-7b-chat into Llama-2-7b-chat-hf.
  3. remove base model testcase in command chat testcase.
  4. add more labels into restful interface testcase.
  5. add workspace restful testcase.

zhulin1 and others added 26 commits March 13, 2024 18:13
@zhulinJulia24
Copy link
Collaborator Author

zhulinJulia24 commented Mar 18, 2024 •
edited

test workflow is running :
https://github.com/zhulinJulia24/lmdeploy/actions/runs/8323053254

RunningLeon
RunningLeon approved these changes Mar 19, 2024
View reviewed changes
Copy link
Collaborator

@RunningLeon RunningLeon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

lvhan028
lvhan028 reviewed Mar 19, 2024
View reviewed changes
autotest/tools/restful/test_restful_chat_workspace.py
'model': item,
'cuda_prefix': None,
'tp_num': tp_num
} for item in get_turbomind_model_list(tp_num) if 'chat' in item.lower()]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will base models like internlm2/internlm2-base-7b be tested?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not covered yet. I will cover it with complation interface. not chat complation interface.

@lvhan028 lvhan028 merged commit ef4668d into InternLM:main Mar 19, 2024
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lvhan028 lvhan028 lvhan028 approved these changes

@RunningLeon RunningLeon RunningLeon approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@zhulinJulia24 @lvhan028 @RunningLeon