Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update few models #50

Closed
jeff31415 opened this issue Jun 22, 2023 · 2 comments
Closed

Update few models #50

jeff31415 opened this issue Jun 22, 2023 · 2 comments

Comments

@jeff31415
Copy link

jeff31415 commented Jun 22, 2023

1:Redpajama incite now have fully trained 7B weight released.
2:StarCoder plus:https://huggingface.co/bigcode/starcoderplus
It was trained Futher on 600B additional data,Futher improving its performance.Also,I notice that it can also used as a chat bot now(thank to general English data from refined web),performing similar to llama 13b based models,and with 8192 ctx.
3:Tiger bot release it's giant 180B model.https://huggingface.co/TigerResearch/tigerbot-180b-research
Seems under Apache 2.0 license(no any other license or restriction mentioned on their repo,and every repo is shown Apache 2.0 license,but did not mention explicitly about their model license.) I hope it is truelly under Apache 2.0 license.
7B base and sft model available also.

@Muhtasham
Copy link
Collaborator

Do you want to create PR so you get credited?

@jeff31415
Copy link
Author

Do you want to create PR so you get credited?

great

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants