Skip to content

[Feat] Compatible with Hugging Face & update more models #712

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 31 commits into from
Apr 18, 2024
Merged

[Feat] Compatible with Hugging Face & update more models #712

merged 31 commits into from
Apr 18, 2024

Conversation

@Jintao-Huang
Copy link
Collaborator

@Jintao-Huang Jintao-Huang commented Apr 16, 2024 •
edited
Loading

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Model or Dataset Support

PR information

  1. 兼容huggingface的模型和数据集, 使用环境变量 USE_HF 控制; 文档书写（中英文）.
  2. 支持 yi-6b-chat-awq, yi-6b-chat-int8, yi-34b-chat-awq, yi-34b-chat-int8, wizardlm2-7b-awq, wizardlm2-8x22b. (ISSUE: 可以支持一下WizardLM-2么？ #724)
  3. 更好的awq, gptq, aqlm模型支持方式.
  4. 支持--deepspeed zero3-offload.

English:

  1. Compatibility with HuggingFace models and datasets is controlled by the environment variable USE_HF. The documentation is written in both Chinese and English.
  2. The following models are supported: yi-6b-chat-awq, yi-6b-chat-int8, yi-34b-chat-awq, yi-34b-chat-int8, wizardlm2-7b-awq, wizardlm2-8x22b.
  3. Better support for AWQ, GPTQ and AQLM models.
  4. support --deepspeed zero3-offload.

@Jintao-Huang Jintao-Huang added the enhancement New feature or request label Apr 16, 2024
@Jintao-Huang Jintao-Huang marked this pull request as draft April 16, 2024 08:00
@Jintao-Huang Jintao-Huang marked this pull request as ready for review April 17, 2024 11:55
@Jintao-Huang Jintao-Huang added the more models support more models label Apr 18, 2024
@Jintao-Huang Jintao-Huang changed the title [Feat] Compatible with Hugging Face [Feat] Compatible with Hugging Face & update more models Apr 18, 2024
@Jintao-Huang Jintao-Huang merged commit 7851713 into modelscope:main Apr 18, 2024
tastelikefeet added a commit that referenced this pull request Apr 18, 2024
@tastelikefeet
Merge commit '94349d3e1caf90257ee97388aa871a89d947acdf' into release/2.0
361d773 
* commit '94349d3e1caf90257ee97388aa871a89d947acdf':
  Fix custom dataset (#736)
  fix zsh install (#735)
  Submit lossing files (#727)
  update link error (#733)
  [Feat] Compatible with Hugging Face & update more models (#712)
  support roleplay dataset (#728)
  update (#719)
  Support eval on openai interfaces (#723)
  Fix loss scale (#720)
hjh0119 pushed a commit to hjh0119/swift that referenced this pull request Jul 22, 2024
@Jintao-Huang
[Feat] Compatible with Hugging Face & update more models (modelscope#712
473b88c 
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tastelikefeet tastelikefeet tastelikefeet approved these changes

Assignees

No one assigned

Labels

enhancement New feature or request more models support more models

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Jintao-Huang @tastelikefeet