Skip to content

[Doc] Update doc for prebuilt models #767

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Aug 17, 2023
Merged

[Doc] Update doc for prebuilt models #767

merged 2 commits into from
Aug 17, 2023

Conversation

@CharlieFRuan
Copy link
Member

@CharlieFRuan CharlieFRuan commented Aug 16, 2023 •
edited
Loading

Update documentation for prebuilt models, reflecting the current prebuilt we support.

Following up to #752.

@CharlieFRuan
Copy link
Member Author

CharlieFRuan commented Aug 16, 2023

Hi @Hzfengsy, it would be great if you could cross check for me! The main change is the Prebuilt for CLI table:
Screen Shot 2023-08-16 at 1 18 46 AM

@Hzfengsy
Copy link
Member

Hzfengsy commented Aug 16, 2023

Thanks for the great work @CharlieFRuan!

The name Model Series is a bit confusing to me, which can be explained to be:

  1. The original repo of the model
  2. The model arch

There are different solutions, either looks good to me:

  1. Renaming the Model Series to Original Model, and provide the links to its original repo (HF or github)
  2. Renaming the Model Series to Model Arch and making all llama-based models (e.g. vicuna, chinese-llama, uncensored-llama) use the same arch Llama
  3. Keep both two columns of Original Model and Model Arch as mentioned above.

Also love to hear the opinions from you and the community :)

@CharlieFRuan
Copy link
Member Author

CharlieFRuan commented Aug 17, 2023

@Hzfengsy thanks for the suggestions! I went with Original Model; I guess users can see the corresponding architecture in the Supported Model Architectures section.
image

@Hzfengsy Hzfengsy merged commit 796d3fd into main Aug 17, 2023
@Hzfengsy
Copy link
Member

Hzfengsy commented Aug 17, 2023

Thanks @CharlieFRuan!

@Hzfengsy Hzfengsy mentioned this pull request Aug 17, 2023
Closed
@CharlieFRuan CharlieFRuan deleted the update-prebuilt-docs branch August 17, 2023 06:02
jimscard added a commit to jimscard/mlc-llm that referenced this pull request Sep 15, 2023
@jimscard
Merge branch 'main' of https://github.com/jimscard/mlc-llm
f3afec2 
* 'main' of https://github.com/jimscard/mlc-llm:
  [Doc] Minor update to `Build Android Package from Source` section (mlc-ai#785)
  added cors to fast api (mlc-ai#757)
  Update Llama2 cached sin/cos to use max_sequence_length (mlc-ai#780)
  Update gpu.rst to add sudo apt update before first install (mlc-ai#784)
  [Doc] Update doc for prebuilt models (mlc-ai#767)
  Improve code completion experience (mlc-ai#772)
  Automatically set 'offset' parameter if 'messages' parameter is set (mlc-ai#754)
  Update tokenizers-cpp to latest and fix rust build error (mlc-ai#762)
  [Utils] Skip generating benchmark scripts in cases (mlc-ai#759)
  [Android] Add libOpenCL-pixel for supporintg Pixel phones. (mlc-ai#723)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Hzfengsy Hzfengsy Hzfengsy approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@CharlieFRuan @Hzfengsy