Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support for MPT #241

Closed
152334H opened this issue Jul 13, 2023 · 4 comments · Fixed by #294
Closed

support for MPT #241

152334H opened this issue Jul 13, 2023 · 4 comments · Fixed by #294
Assignees
@danieldk
Labels
feat/model Feature: models type/feature Type: Feature

Comments

@152334H
Copy link

152334H commented Jul 13, 2023

title
@danieldk
Copy link
Collaborator

We'll look into it! We checked MPS support in combination with spacy-curated-transformers. But it is possible that we broke something with the recent LLM additions.

@danieldk danieldk self-assigned this Jul 13, 2023
@shadeMe shadeMe added the feat/model Feature: models label Jul 14, 2023
@danieldk
Copy link
Collaborator

Oh, sorry, misread MPT as MPS. Our focus is on getting the 1.0.0 release out first, support for MPT is on our todo list after that.

@152334H
Copy link
Author

152334H commented Jul 14, 2023

No problem!

@shadeMe shadeMe self-assigned this Jul 14, 2023
@danieldk danieldk added the type/feature Type: Feature label Jul 26, 2023
@shadeMe shadeMe removed their assignment Aug 7, 2023
@shadeMe shadeMe linked a pull request Aug 8, 2023 that will close this issue
Add MosaicML decoder and causal LM #294
Merged
3 tasks
@danieldk
Copy link
Collaborator

danieldk commented Aug 9, 2023

MPT will be supported in Curated Transformers 1.1.0. If there are no other show-stoppers, we plan to release 1.1.0 later this week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@danieldk danieldk

Labels
feat/model Feature: models type/feature Type: Feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add MosaicML decoder and causal LM danieldk/curated-transformers
3 participants
@danieldk @shadeMe @152334H