Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge N experts notebook #52

Merged
merged 7 commits into from
May 14, 2023
Merged

Merge N experts notebook #52

merged 7 commits into from
May 14, 2023

Conversation

Stillerman
Copy link
Collaborator

Added a notebook that can merge N models on colab GPU and then upload it to the hub.

For issue #36

@mrcabbage972 mrcabbage972 self-requested a review May 13, 2023 02:29
@mrcabbage972
Copy link
Collaborator

Hi @Stillerman ,
I have a couple of small requests:

  • As we run a lot of our stuff in shell environments, it could be helpful if you coudconvert the notebook to a script
  • Can you please remove the DS_store file for the PR?

Thanks!

@Stillerman
Copy link
Collaborator Author

Shell script produced this on the Redmond box with

python3 src/mdel/merge_experts.py --hf-repo Multi-Domain-Expert-Layers/merged-pubmed-freelaw -e Multi-Domain-Expert-Layers/expert-freelaw -e Multi-Domain-Expert-Layers/expert-pubmed_central

in ~2 mins

@mrcabbage972 mrcabbage972 merged commit c600808 into huu4ontocord:main May 14, 2023
1 check failed
@mrcabbage972
Copy link
Collaborator

Thanks, merging!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants