Skip to content

[Feature] Support the fine-tuning of MSAgent dataset#156

Merged
pppppM merged 18 commits intoInternLM:mainfrom
LZHgrla:lzh/msagent
Oct 23, 2023
Merged

[Feature] Support the fine-tuning of MSAgent dataset#156
pppppM merged 18 commits intoInternLM:mainfrom
LZHgrla:lzh/msagent

Conversation

@LZHgrla
Copy link
Copy Markdown
Contributor

@LZHgrla LZHgrla commented Oct 7, 2023

No description provided.

Copy link
Copy Markdown
Collaborator

@pppppM pppppM left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do I chat with a trained model? @LZHgrla

@LZHgrla
Copy link
Copy Markdown
Contributor Author

LZHgrla commented Oct 8, 2023

@pppppM We should convert (and merge) the fine-tuned adapter, and obtain the agent LLM.

Then, we can use ReAct interfaces provided by lagent with this agent LLM:

  1. WebUI: https://github.com/InternLM/lagent/blob/main/examples/react_web_demo.py
  2. CLI: https://github.com/InternLM/lagent/#run-a-react-agent-with-internlm

@LZHgrla LZHgrla marked this pull request as draft October 11, 2023 06:47
@LZHgrla LZHgrla changed the base branch from main to lzh/refactor October 12, 2023 08:11
@LZHgrla LZHgrla changed the base branch from lzh/refactor to lzh/msagent October 12, 2023 08:25
@LZHgrla LZHgrla marked this pull request as ready for review October 12, 2023 08:25
@LZHgrla LZHgrla changed the base branch from lzh/msagent to lzh/refactor October 12, 2023 08:25
@LZHgrla LZHgrla changed the base branch from lzh/refactor to main October 12, 2023 08:30
@LZHgrla LZHgrla marked this pull request as draft October 12, 2023 08:31
@LZHgrla
Copy link
Copy Markdown
Contributor Author

LZHgrla commented Oct 13, 2023

@pppppM
Now, xtuner chat supports the chat with MSAgent model!

xtuner chat $LLM --adapter $ADAPTER --lagent

This feature relies on InternLM/lagent#44 (has been merged!)

@LZHgrla LZHgrla marked this pull request as ready for review October 13, 2023 09:14
@LZHgrla LZHgrla marked this pull request as draft October 13, 2023 09:15
@LZHgrla LZHgrla marked this pull request as ready for review October 16, 2023 04:37
@pppppM pppppM merged commit 9a8daac into InternLM:main Oct 23, 2023
llkn-2 pushed a commit to llkn-2/xtuner that referenced this pull request Jul 31, 2024
* fix bugs for invalid data

* add modelscope in requirements

* add process_ms_dataset

* add msagent dataset

* fix

* add msagent map_fn

* add cfg

* fix pre-commit

* fix eval generate input

* fix f-string bug

* modify question

* add more cfgs

* rename

* support lagent chat

* msagent uses system text

* update cfgs

* update chat

* update readme
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants