Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Minor] Set diacritics flag for more languages #4233

Merged
merged 1 commit into from
Aug 2, 2022

Conversation

fatalbanana
Copy link
Member

No description provided.

@fatalbanana fatalbanana changed the title [Minor] Set diacritics flag for Turkish language [Minor] Set diacritics flag for more languages Aug 2, 2022
@vstakhov
Copy link
Member

vstakhov commented Aug 2, 2022

We should maybe add some sanity check that if we have diacritics in some high probability n-gramms, then this language should be considered as diacritic language. Such a check should not be hard to add. On the other hand, we have quite a small number of languages to do this check manually :)

@vstakhov vstakhov merged commit c16f8e1 into rspamd:master Aug 2, 2022
@fatalbanana fatalbanana deleted the turkish branch August 3, 2022 07:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants