Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

detecting wrong language in case of SERBIAN,BOSNIAN #42

Open
RajatKumarTyagi opened this issue May 12, 2021 · 1 comment
Open

detecting wrong language in case of SERBIAN,BOSNIAN #42

RajatKumarTyagi opened this issue May 12, 2021 · 1 comment

Comments

@RajatKumarTyagi
Copy link

I was using pycld2.detect() method to detect languages of text.it detected wrong for serbian it detected bosnian and for bosnian it detected serbian , please provide solution if any

@mariokostelac
Copy link

@RajatKumarTyagi as somebody who speaks both languages, I can confirm that this is a really difficult problem for machine learning models, there are even datasets created to help tackling the task - http://ttg.uni-saarland.de/resources/DSLCC/. For short texts it might be difficult for humans too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants