Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multilingual ALBERT #91

Closed
flaviussn opened this issue Nov 5, 2019 · 5 comments
Closed

Multilingual ALBERT #91

flaviussn opened this issue Nov 5, 2019 · 5 comments

Comments

@flaviussn
Copy link

Do you plan to release multilingual pre-trained models like BERT? Would appreciate it.
@brightmart
Copy link

Is multilingual corpus available? and which languages needed most?

@flaviussn
Copy link
Author

BERT multilingual was trained with a dump of the top 100 languages with the largest Wikipedias as is detailed here:
https://github.com/google-research/bert/blob/master/multilingual.md#details

@0entr0py
Copy link

Is multilingual corpus available? and which languages needed most?

XLM also does a smaller 17 most popular languages on wiki corpus, something like that would be very useful

@roclive
Copy link

roclive commented Dec 9, 2019

waiting for multilinggual albert.

@andrewluchen andrewluchen transferred this issue from google-research/google-research Jan 6, 2020
@0x0539
Copy link
Collaborator

0x0539 commented Jan 8, 2020

Duplicate of #5

@0x0539 0x0539 marked this as a duplicate of #5 Jan 8, 2020
@0x0539 0x0539 closed this as completed Jan 8, 2020
@LysandreJik LysandreJik mentioned this issue Feb 12, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@0x0539 @0entr0py @roclive @brightmart @flaviussn