Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support swift export #455

Merged
merged 36 commits into from
Feb 26, 2024
Merged

Conversation

Jintao-Huang
Copy link
Collaborator

No description provided.

@Jintao-Huang
Copy link
Collaborator Author

Jintao-Huang commented Feb 25, 2024

  1. support swift export. awq-4bits
  2. sh: --deepspeed_config_path -> --deepspeed. --merge_lora_and_save -> --merge_lora
  3. remove --model_cache_dir -> --model_id_or_path.
  4. add docs: LLM量化文档.md

@Jintao-Huang Jintao-Huang changed the title Support export Support swift export Feb 25, 2024
@Jintao-Huang
Copy link
Collaborator Author

support push to hub (swift export)

@Jintao-Huang Jintao-Huang merged commit 94105d2 into modelscope:main Feb 26, 2024
2 checks passed
tastelikefeet added a commit to tastelikefeet/swift that referenced this pull request Feb 28, 2024
…ui_0228

* commit '6cead7123ef0a35d34fe755bea2e5a61cd275092':
  Fix llama2 generation config (modelscope#468)
  swift export load model in cpu (modelscope#462)
  fix get_vllm_engine bug (modelscope#463)
  Fix llm quantization docs (modelscope#458)
  Support swift export (modelscope#455)
tastelikefeet added a commit to tastelikefeet/swift that referenced this pull request Feb 28, 2024
…mapro

* commit '6cead7123ef0a35d34fe755bea2e5a61cd275092':
  Fix llama2 generation config (modelscope#468)
  swift export load model in cpu (modelscope#462)
  fix get_vllm_engine bug (modelscope#463)
  Fix llm quantization docs (modelscope#458)
  Support swift export (modelscope#455)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants