Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[sync] sync npu branch with main #5278

Merged
merged 54 commits into from
Jan 18, 2024
Merged

[sync] sync npu branch with main #5278

merged 54 commits into from
Jan 18, 2024

Conversation

ver217
Copy link
Member

@ver217 ver217 commented Jan 18, 2024

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

digger-yu and others added 30 commits November 24, 2023 19:15
@digger-yu
fix typo change lazy_iniy to lazy_init (hpcaitech#5099)
2bdf76f
@digger-yu
[nfc] fix typo change directoty to directory (hpcaitech#5111)
d5661f0
@Orion-Zheng
[FEATURE] Add Safety Eval Datasets to ColossalEval (hpcaitech#5095)
7b789f4 
* add safetybench and cvalues(responsibility) eval dataset

* Modify code according to review suggestions

---------

Co-authored-by: Orion-Zheng <zhengzian@u.nus.edu>
@kurisusnowdeng
[hotfix] fixed memory usage of shardformer module replacement (hpcait…
126cf18 
…ech#5122)
@CWHer @ppt0011
@flybird11111 @eric8607242
[shardformer]: support gpt-j, falcon, Mistral and add interleaved pip…
7172459 
…eline for bert (hpcaitech#5088)

* [shardformer] implement policy for all GPT-J models and test

* [shardformer] support interleaved pipeline parallel for bert finetune

* [shardformer] shardformer support falcon (hpcaitech#4883)

* [shardformer]: fix interleaved pipeline for bert model (hpcaitech#5048)

* [hotfix]: disable seq parallel for gptj and falcon, and polish code (hpcaitech#5093)

* Add Mistral support for Shardformer (hpcaitech#5103)

* [shardformer] add tests to mistral (hpcaitech#5105)

---------

Co-authored-by: Pengtai Xu <henryxu880@gmail.com>
Co-authored-by: ppt0011 <143150326+ppt0011@users.noreply.github.com>
Co-authored-by: flybird11111 <1829166702@qq.com>
Co-authored-by: eric8607242 <e0928021388@gmail.com>
@binmakeswell
[doc] add moe news (hpcaitech#5128)
177c79f 
* [doc] add moe news

* [doc] add moe news

* [doc] add moe news
@FrankLeeeee
[doc] updated paper citation (hpcaitech#5131)
2899cfd
@digger-yu
fix typo change JOSNL TO JSONL etc. (hpcaitech#5116)
9110406
@github-actions
[format] applied code formatting on changed files in pull request 5088 (
d10ee42 
hpcaitech#5127)

Co-authored-by: github-actions <github-actions@github.com>
@github-actions
[format] applied code formatting on changed files in pull request 5124 (
9b36640 
hpcaitech#5125)

Co-authored-by: github-actions <github-actions@github.com>
@github-actions
[format] applied code formatting on changed files in pull request 5115 (
f6731db 
hpcaitech#5118)

Co-authored-by: github-actions <github-actions@github.com>
@flybird11111
[plugin]fix 3d checkpoint load when booster boost without optimizer. (h…
2a2ec49 
…pcaitech#5135)

* fix 3d checkpoint load when booster boost without optimizer

fix 3d checkpoint load when booster boost without optimizer

* test ci

* revert ci

* fix

fix
@MichelleMa8
[ColossalQA] refactor server and webui & add new feature (hpcaitech#5138
c7fd9a5 
)

* refactor server and webui & add new feature

* add requirements

* modify readme and ui
@MichelleMa8
[doc] fix colossalqa document (hpcaitech#5146)
368b5e3 
* fix doc

* modify doc
@flybird11111
fix (hpcaitech#5158)
3dbbf83 
fix
@chengeharrison @Camille7777
[Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (hpcaitech…
b397104 
…#4878)

* Add finetuning Colossal-Llama-2 example

* Add finetuning Colossal-Llama-2 example 2

* Add finetuning Colossal-Llama-2 example and support NEFTuning

* Add inference example and refine neftune

* Modify readme file

* update the imports

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>
@flybird11111
[gemini] hotfix NaN loss while using Gemini + tensor_parallel (hpcait…
21aa5de 
…ech#5150)

* fix

aaa

fix

fix

fix

* fix

* fix

* test ci

* fix ci

fix
@MichelleMa8
[colossalqa] fix pangu api (hpcaitech#5170)
b07a6f4 
* fix pangu api

* add comment
@chengeharrison
[ColossalEval] Support GSM, Data Leakage Evaluation and Tensor Parall…
cefdc32 
…el (hpcaitech#5169)

* Support GSM, Data Leakage Evaluation and Tensor Parallel

* remove redundant code and update inference.py in examples/gpt_evaluation

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
@flybird11111 @chengeharrison @Camille7777
[shardformer] llama support DistCrossEntropy (hpcaitech#5176)
79718fa 
* fix

aaa

fix

fix

fix

* fix

* fix

* test ci

* fix ci

fix

* llama support dist-cross

fix

fix

fix

fix

fix

fix

fix

fix

* fix

* fix

* fix

fix

* test ci

* test ci

* fix

* [Colossal-Llama-2] Add finetuning Colossal-Llama-2 example (hpcaitech#4878)

* Add finetuning Colossal-Llama-2 example

* Add finetuning Colossal-Llama-2 example 2

* Add finetuning Colossal-Llama-2 example and support NEFTuning

* Add inference example and refine neftune

* Modify readme file

* update the imports

---------

Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>

* llama support dist-cross

fix

fix

fix

fix

fix

fix

fix

fix

* fix

* fix

* fix

fix

* test ci

* test ci

* fix

* fix ci

* fix ci

---------

Co-authored-by: Yuanchen <70520919+chengeharrison@users.noreply.github.com>
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>
@chengeharrison
Fix ColossalEval (hpcaitech#5186)
3ff60d1 
Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
@flybird11111
[doc] update pytorch version in documents. (hpcaitech#5177)
681d9b1 
* fix

aaa

fix

fix

fix

* fix

* fix

* test ci

* fix ci

fix

* update pytorch version in documents
@ht-zhou
polish readme in application/chat (hpcaitech#5194)
af95267
@CWHer
[pipeline]: fix p2p comm, add metadata cache and support llama interl…
4fa689f 
…eaved pp (hpcaitech#5134)

* test: add more p2p tests

* fix: remove send_forward_recv_forward as p2p op list need to use the same group

* fix: make send and receive atomic

* feat: update P2PComm fn

* feat: add metadata cache in 1f1b

* feat: add metadata cache in interleaved pp

* feat: modify is_xx_stage fn

* revert: add _broadcast_object_list

* feat: add interleaved pp in llama policy

* feat: set NCCL_BUFFSIZE in HybridParallelPlugin
@chengeharrison
Improve logic for selecting metrics (hpcaitech#5196)
eae01b6 
Co-authored-by: Xu <yuanchen.xu00@gmail.com>
@KKZ20
[doc] Update required third-party library list for testing and torch …
64519eb 
…comptibility checking (hpcaitech#5207)

* doc/update requirements-test.txt

* update torch-cuda compatibility check
@flybird11111
support linear accumulation fusion (hpcaitech#5199)
02d2328 
support linear accumulation fusion

support linear accumulation fusion

fix
@CWHer
[pipeline]: support arbitrary batch size in forward_only mode (hpcait…
3c0d82b 
…ech#5201)

* fix: remove drop last in val & test dataloader

* feat: add run_forward_only, support arbitrary bs

* chore: modify ci script
@CWHer
[pipeline]: add p2p fallback order and fix interleaved pp deadlock (h…
d799a30 
…pcaitech#5214)

* fix: add fallback order option and update 1f1b

* fix: fix deadlock comm in interleaved pp

* test: modify p2p test
@ver217
[devops] update torch versoin in ci (hpcaitech#5217)
7f3400b
flybird11111 and others added 24 commits January 3, 2024 14:26
@flybird11111
fix-test (hpcaitech#5210)
365671b 
fix-test

fix-test
@flybird11111
fix flash attn (hpcaitech#5209)
451e914
@digger-yu
[nfc] fix typo colossalai/shardformer/ (hpcaitech#5133)
b0b53a1
@TongLi3701
[Colossal-LLaMA-2] Release Colossal-LLaMA-2-13b-base model (hpcaitech…
d992b55 
…#5224)

* update readme

* update readme

* update link

* update

* update readme

* update

* update

* update

* update title

* update example

* update example

* fix content

* add conclusion

* add license

* update

* update

* update version

* fix minor
@Camille7777
[doc] Update README.md of Colossal-LLAMA2 (hpcaitech#5233)
915b465 
* Update README.md

* Update README.md
@zhimin-z
[doc] Make leaderboard format more uniform and good-looking (hpcaitec…
ce65127 
…h#5231)

* Make leaderboard format more unifeid and good-looking

* Update README.md

* Update README.md
@binmakeswell
[doc] add Colossal-LLaMA-2-13B (hpcaitech#5234)
b9b32b1 
* [doc] add Colossal-LLaMA-2-13B

* [doc] add Colossal-LLaMA-2-13B

* [doc] add Colossal-LLaMA-2-13B
@github-actions
[format] applied code formatting on changed files in pull request 5234 (
4fb4a22 
hpcaitech#5235)

Co-authored-by: github-actions <github-actions@github.com>
@binmakeswell
[doc] SwiftInfer release (hpcaitech#5236)
7bc6969 
* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release

* [doc] SwiftInfer release
@zeyugao @CWHer
[pipeline] A more general _communicate in p2p (hpcaitech#5062)
d565df3 
* A more general _communicate

* feat: finish tree_flatten version p2p

* fix: update p2p api calls

---------

Co-authored-by: Wenhao Chen <cwher@outlook.com>
@digger-yu
[doc] fix typo in Colossal-LLaMA-2/README.md (hpcaitech#5247)
41e52c1
@FrankLeeeee
[workflow] fixed build CI (hpcaitech#5240)
edf94a3 
* [workflow] fixed build CI

* polish

* polish

* polish

* polish

* polish
@FrankLeeeee
[ci] fixed booster test (hpcaitech#5251)
d5eeeb1 
* [ci] fixed booster test

* [ci] fixed booster test

* [ci] fixed booster test
@FrankLeeeee
[ci] fixed ddp test (hpcaitech#5254)
2b83418 
* [ci] fixed ddp test

* polish
@digger-yu
fix typo in applications/ColossalEval/README.md (hpcaitech#5250)
756c400
@flybird11111 @CWHer
[ci] fix shardformer tests. (hpcaitech#5255)
e830ef9 
* fix ci

fix

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

---------

Co-authored-by: Wenhao Chen <cwher@outlook.com>
@binmakeswell
[doc] fix doc typo (hpcaitech#5256)
c174c4f 
* [doc] fix annotation display

* [doc] fix llama2 doc
@CWHer
[hotfix]: add pp sanity check and fix mbs arg (hpcaitech#5268)
ef4f0ee 
* fix: fix misleading mbs arg

* feat: add pp sanity check

* fix: fix 1f1b sanity check
@FrankLeeeee
[workflow] fixed incomplete bash command (hpcaitech#5272)
04244aa
@FrankLeeeee
[workflow] fixed oom tests (hpcaitech#5275)
d69cd2e 
* [workflow] fixed oom tests

* polish

* polish

* polish
@flybird11111 @CWHer
[ci] fix test_hybrid_parallel_plugin_checkpoint_io.py (hpcaitech#5276)
2a0558d 
* fix ci

fix

* fix test

* revert: revert p2p

* feat: add enable_metadata_cache option

* revert: enable t5 tests

* fix

---------

Co-authored-by: Wenhao Chen <cwher@outlook.com>
@flybird11111
[shardformer] hybridparallelplugin support gradients accumulation. (h…
46e0916 
…pcaitech#5246)

* support gradients acc

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

* fix

fix

* fix

fix

fix
@KKZ20
[hotfix] Fix ShardFormer test execution path when using sequence para…
5d9a0ae 
…llelism (hpcaitech#5230)
@ver217
Merge branch 'main' into sync/npu
1484693
@ver217 ver217 requested a review from a team as a code owner January 18, 2024 04:06
@FrankLeeeee FrankLeeeee merged commit d66e698 into hpcaitech:feature/npu Jan 18, 2024
15 of 22 checks passed
@ver217 ver217 deleted the sync/npu branch January 18, 2024 06:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet