Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HuggingFace module #11

Closed
peregilk opened this issue Sep 5, 2021 · 3 comments
Closed

HuggingFace module #11

peregilk opened this issue Sep 5, 2021 · 3 comments

Comments

@peregilk
Copy link

peregilk commented Sep 5, 2021

I read your paper with great interest. You seem to have a lot of novel ideas about how to improve the pretraining. Some of the scores are really impressive. I would like to test some of these ideas on other corpuses.

Have you considered making the code available as a HuggingFace module (TensorFlow/PyTorch/Flax)? I think this would lead to a lot more people looking into your ideas.

@XiaoqingNLP
Copy link

@peregilk Do you try it?

@siriusctrl
Copy link

Any update on this? I notice that there is a out of box pretrain version for GLM-10B. Would like to know whether there are any future plan on uploading other pretrain model (e.g. GLM-10B-Chinese)?

@duzx16
Copy link
Member

duzx16 commented Nov 19, 2022

Any update on this? I notice that there is a out of box pretrain version for GLM-10B. Would like to know whether there are any future plan on uploading other pretrain model (e.g. GLM-10B-Chinese)?

@siriusctrl We uploaded GLM-10B-Chinese and GLM-Large Chinese. Welcome to try!
https://huggingface.co/BAAI/glm-10b-chinese
https://huggingface.co/BAAI/glm-large-chinese

@duzx16 duzx16 closed this as completed Nov 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants