Skip to content

[Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat#103

Merged
pppppM merged 5 commits intoInternLM:mainfrom
LZHgrla:lzh/add_bc2_chat
Sep 7, 2023
Merged

[Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat#103
pppppM merged 5 commits intoInternLM:mainfrom
LZHgrla:lzh/add_bc2_chat

Conversation

@LZHgrla
Copy link
Copy Markdown
Contributor

@LZHgrla LZHgrla commented Sep 6, 2023

  1. Add related configs
  2. Dispatch Baichuan flash attn
  3. Dispatch custom NormHead to prevent bugs

@LZHgrla LZHgrla changed the title [Improve] Add Baichuan2 7B-chat, 13B-base, 13B-chat [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat Sep 6, 2023
@LZHgrla LZHgrla changed the title [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat [WIP] [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat Sep 7, 2023
@LZHgrla LZHgrla changed the title [WIP] [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat Sep 7, 2023
@LZHgrla LZHgrla changed the title [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat [WIP] [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat Sep 7, 2023
@LZHgrla LZHgrla marked this pull request as draft September 7, 2023 02:53
@LZHgrla LZHgrla changed the title [WIP] [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat [Feature] Add Baichuan2 7B-chat, 13B-base, 13B-chat Sep 7, 2023
@LZHgrla LZHgrla marked this pull request as ready for review September 7, 2023 05:22
@pppppM pppppM merged commit 36cf646 into InternLM:main Sep 7, 2023
llkn-2 pushed a commit to llkn-2/xtuner that referenced this pull request Jul 31, 2024
* add Baichuan2 7b-chat, 13b-base, 13b-chat

* update readme

* Update README.md

* Update README_zh-CN.md

* add dispatch modules for baichuan flash_attn and norm_head
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants