Weblate not outputing Android <plurals> fields properly, causing app crashes #1550
Comments
|
../../src/main/res/values-he/strings.xml:355: For locale "he" (Hebrew) the following quantities should also be defined:
many, two352 <string name="updates__hide_updateable_apps">הסתרת יישומונים</string> 353 <string name="updates__show_updateable_apps">הצגת יישומונים</string> 354 355 <plurals name="updates__download_updates_for_apps"> 356 <item quantity="one">הורדת עדכון ליישומון אחד.</item> 357 <item quantity="other">הורדת עדכון ל־%1$d יישומונים.</item>../../src/main/res/values-iw/strings.xml:355: For locale "iw" (Hebrew) the following quantities should also be defined: many, two352 <string name="updates__hide_updateable_apps">הסתרת יישומונים</string> 353 <string name="updates__show_updateable_apps">הצגת יישומונים</string> 354 355 <plurals name="updates__download_updates_for_apps"> 356 <item quantity="one">הורדת עדכון ליישומון אחד.</item> 357 <item quantity="other">הורדת עדכון ל־%1$d יישומונים.</item>../../src/main/res/values-he/strings.xml:437: For locale "he" (Hebrew) the following quantities should also be defined: many, two434 <string name="notification_content_single_downloading_update">מתבצעת הורדת עדכון עבור „%1$s“…</string> 435 <string name="notification_content_single_installing">ההתקנה של „%1$s“ מתבצעת כעת…</string> 436 <string name="notification_content_single_installed">ההתקנה הצליחה</string> 437 <plurals name="notification_summary_updates"> 438 <item quantity="one">עדכון אחד</item> 439 <item quantity="other">%1$d עדכונים</item>../../src/main/res/values-iw/strings.xml:437: For locale "iw" (Hebrew) the following quantities should also be defined: many, two434 <string name="notification_content_single_downloading_update">מתבצעת הורדת עדכון עבור „%1$s“…</string> 435 <string name="notification_content_single_installing">ההתקנה של „%1$s“ מתבצעת כעת…</string> 436 <string name="notification_content_single_installed">ההתקנה הצליחה</string> 437 <plurals name="notification_summary_updates"> 438 <item quantity="one">עדכון אחד</item> 439 <item quantity="other">%1$d עדכונים</item>../../src/main/res/values-he/strings.xml:441: For locale "he" (Hebrew) the following quantities should also be defined: many, two438 <item quantity="one">עדכון אחד</item> 439 <item quantity="other">%1$d עדכונים</item> 440 </plurals> 441 <plurals name="notification_summary_installed"> 442 <item quantity="one">יישומון הותקן</item> 443 <item quantity="other">%1$d יישומונים הותקנו</item>+ 11 More Occurrences...
../../src/main/res/values-iw/strings.xml:441: For locale "iw" (Hebrew) the following quantities should also be defined:
many, two438 <item quantity="one">עדכון אחד</item> 439 <item quantity="other">%1$d עדכונים</item> 440 </plurals> 441 <plurals name="notification_summary_installed"> 442 <item quantity="one">יישומון הותקן</item> 443 <item quantity="other">%1$d יישומונים הותקנו</item>../../src/main/res/values-he/strings.xml:454: For locale "he" (Hebrew) the following quantities should also be defined: many, two451 <string name="notification_title_summary_installed">הותקן בהצלחה</string> 452 <string name="tts_category_name">קטגוריה %1$s</string> 453 454 <plurals name="tts_view_all_in_category"> 455 <item quantity="one">הצגת יישומון %1$d בקטגוריה %2$s</item> 456 <item quantity="other">הצגת כל %1$d היישומונים בקטגוריה %2$s</item>../../src/main/res/values-iw/strings.xml:454: For locale "iw" (Hebrew) the following quantities should also be defined: many, two451 <string name="notification_title_summary_installed">הותקן בהצלחה</string> 452 <string name="tts_category_name">קטגוריה %1$s</string> 453 454 <plurals name="tts_view_all_in_category"> 455 <item quantity="one">הצגת יישומון %1$d בקטגוריה %2$s</item> 456 <item quantity="other">הצגת כל %1$d היישומונים בקטגוריה %2$s</item>../../src/main/res/values-he/strings.xml:460: For locale "he" (Hebrew) the following quantities should also be defined: many, two457 </plurals> 458 459 <string name="details_last_updated_today">עודכן היום</string> 460 <plurals name="details_last_update_days"> 461 <item quantity="one">עודכן לפני יום</item> 462 <item quantity="other">עודכן לפני %1$d ימים</item>../../src/main/res/values-iw/strings.xml:460: For locale "iw" (Hebrew) the following quantities should also be defined: many, two457 </plurals> 458 459 <string name="details_last_updated_today">עודכן היום</string> 460 <plurals name="details_last_update_days"> 461 <item quantity="one">עודכן לפני יום</item> 462 <item quantity="other">עודכן לפני %1$d ימים</item>../../src/main/res/values-he/strings.xml:464: For locale "he" (Hebrew) the following quantities should also be defined: many, two461 <item quantity="one">עודכן לפני יום</item> 462 <item quantity="other">עודכן לפני %1$d ימים</item> 463 </plurals> 464 <plurals name="details_last_update_weeks"> 465 <item quantity="one">עודכן לפני שבוע</item> 466 <item quantity="other">עודכן לפני %1$d שבועות</item>../../src/main/res/values-iw/strings.xml:464: For locale "iw" (Hebrew) the following quantities should also be defined: many, two461 <item quantity="one">עודכן לפני יום</item> 462 <item quantity="other">עודכן לפני %1$d ימים</item> 463 </plurals> 464 <plurals name="details_last_update_weeks"> 465 <item quantity="one">עודכן לפני שבוע</item> 466 <item quantity="other">עודכן לפני %1$d שבועות</item>../../src/main/res/values-he/strings.xml:468: For locale "he" (Hebrew) the following quantities should also be defined: many, two465 <item quantity="one">עודכן לפני שבוע</item> 466 <item quantity="other">עודכן לפני %1$d שבועות</item> 467 </plurals> 468 <plurals name="details_last_update_months"> 469 <item quantity="one">עודכן לפני חודש</item> 470 <item quantity="other">עודכן לפני %1$d חודשים</item>../../src/main/res/values-iw/strings.xml:468: For locale "iw" (Hebrew) the following quantities should also be defined: many, two465 <item quantity="one">עודכן לפני שבוע</item> 466 <item quantity="other">עודכן לפני %1$d שבועות</item> 467 </plurals> 468 <plurals name="details_last_update_months"> 469 <item quantity="one">עודכן לפני חודש</item> 470 <item quantity="other">עודכן לפני %1$d חודשים</item>../../src/main/res/values-he/strings.xml:472: For locale "he" (Hebrew) the following quantities should also be defined: many, two469 <item quantity="one">עודכן לפני חודש</item> 470 <item quantity="other">עודכן לפני %1$d חודשים</item> 471 </plurals> 472 <plurals name="details_last_update_years"> 473 <item quantity="one">עודכן לפני שנה</item> 474 <item quantity="other">עודכן לפני %1$d שנים</item>../../src/main/res/values-iw/strings.xml:472: For locale "iw" (Hebrew) the following quantities should also be defined: many, two469 <item quantity="one">עודכן לפני חודש</item> 470 <item quantity="other">עודכן לפני %1$d חודשים</item> 471 </plurals> 472 <plurals name="details_last_update_years"> 473 <item quantity="one">עודכן לפני שנה</item> 474 <item quantity="other">עודכן לפני %1$d שנים</item> Priority: 8 / 10
Severity: ErrorCategory: Correctness:Messages
Explanation: Missing quantity translation.
Different languages have different rules for grammatical agreement with quantity. In English, for example, the quantity 1 is a special case. We write "1 book", but for any other quantity we'd write "n books". This distinction between singular and plural is very common, but other languages make finer distinctions.
This lint check looks at each translation of a <plural> and makes sure that all the quantity strings considered by the given language are provided by this translation.For example, an English translation must provide a string for quantity="one". Similarly, a Czech translation must provide a string for quantity="few".
To suppress this error, use the issue id "MissingQuantity" as explained in the Suppressing Warnings and Errors section. |
|
Apparently Gettext is not following CLDR plurals here and it causes problems in this case. Weblate is based on Gettext ones, where there are just two plural forms ( |
|
As a temporary workaround, maybe you could just stick the Other value into Two and Many? |
|
It seems that some languages are including more than One/Other. For example, Russian has One, Few, and Many, but is missing Other: <plurals name="details_last_update_days">
<item quantity="one">Обновлено %1$d день назад</item>
<item quantity="few">Обновлено %1$d дня назад</item>
<item quantity="many">Обновлено %1$d дней назад</item>
</plurals>And Slovak includes One, Few, Many, and Other, but Many is apparently not supposed to be there: <plurals name="updates__download_updates_for_apps">
<item quantity="one">Stiahnuť aktualizáciu pre %1$d aplikáciu.</item>
<item quantity="few">Stiahnuť aktualizácie pre %1$d aplikácie.</item>
<item quantity="many">Stiahnuť aktualizácie pre %1$d aplikácií.</item>
<item quantity="other">Stiahnuť aktualizácie pre %1$d aplikácií.</item>
</plurals> |
|
Serbian seems to have the correct plurals (One, Few, Other): <plurals name="tts_view_all_in_category">
<item quantity="one">Прикажи %1$d апликацију у категорији %2$s</item>
<item quantity="few">Прикажи све %1$d апликације у категорији %2$s</item>
<item quantity="other">Прикажи свих %1$d апликација у категорији %2$s</item>
</plurals> |
|
This is problem only for languages where CLDR plurals do not match the ones commonly used by Gettext. I guess there won't be much of such languages... PS: Slovak should have one/few/many/other, see http://www.unicode.org/cldr/charts/29/supplemental/language_plural_rules.html#sk. |
|
Thinking more about this we really have to add plural definitions per translation, which would be based on file format and fallback to language definition if nothing is defined for file format or within the file. This way we could also address different plural forms being used for one language (such as #901). |
|
Some formats will be easy to support properly:
Others might be a bit tricky and we will probably stick to current language defaults:
Note: The Babel rules are not same as Gettext ones we're currently using, so it might need some more tweaks: The variables are defined in the specification, there is also tool to convert them (written in PHP): https://github.com/mlocati/cldr-to-gettext-plural-rules |
Currently translated at 100.0% (244 of 244 strings)
Currently translated at 91.8% (224 of 244 strings)
See WeblateOrg/weblate#1550 Signed-off-by: Michal Čihař <michal@cihar.com>
|
After digging into this for few hours (trying to add CLDR plurals to Weblate), now I finally understand where the problem is - it's not that the CLDR plural rules would be that different (the differences are there, but they are limited to few languages). The problem lies a bit deeper: Translate-toolkit always adds It might sound weird, but apparently the root cause is in Babel not returning |
nijel
added
the
translate-toolkit
|
This should be fixed by following PR which replaces Babel usage in translate-toolkit by own plurals data: translate/translate#3762 It would be really great if somebody with Android knowledge (eg. @eighthave , @TobiGr, @theScrabi ) could check if the tags are correct there - I was not able to find some official docs for Android covering this and the CLDR is still a bit magic for me as a result I'm not sure if the table I've generated correct (I've checked few languages which I know were problematic and they look correct). |
It contains several cleanups to remove duplicates and to bring our data closer to CLDR. See #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
|
I don't quite understand what I should check. I looked at this diff of 5d853aa and I have no idea what that data is. I looked at translate/translate@65b4000, and I could see that some of the languages are missing "other". All languages must have at least "other", that is a hard requirement. If a language has only one plurals form, it should be "other". I would include a CI test case that checks that all languages have "other" in them. I can see that be, pl, and uk are missing "other". |
|
No, not all languages use other for integers (that's what android cares for plurals), see for example Belarusian, Polish or Russian. And yes translate/translate@65b4000 is think I'd like to get reviewed (or more precisly https://github.com/translate/translate/pull/3762/files). |
|
As far as I understand it, Android requires that "other" is always
present in the _strings.xml_ `<plurals>` blocks. Looking at your
examples, be/pl/ru use "other" for non-integers, so it is not wrong to
require an "other" block.
|
|
I agree with @eighthave. Android requires "other" and if it does not exist this can cause a crash. |
|
So far I thought that Android is simply following CLDR, but that doesn't seem to be the case, so this has to be implemented somewhere (apparently documentation doesn't seem to exist). To me it really looks weird that it would require the "other" even for languages where it won't be used - the getQuantityString used to evaluate this accepts only integers... Looking at the code I still think that "other" is not needed as long as all valid choices are there. So can somebody actually test that other is really needed in all cases? Testing simple string with one of above mentioned languages (eg. Polish) should do that. |
|
I've test it and can confirm, some languages don't require the other field, here's some tests that I did: The test consists on loop through 0 to 220 and check if the the
|
| API | 25 | 23 | 19 | 16 |
|---|---|---|---|---|
| Without field "other" | only be, pl, ru, uk |
same as 25 | same as 25, but some fallback | same as 19 |
| Without field "other" (plural deleted if empty) |
same as above, some fallback |
same as 25 | same as 25 | same as 25 |
| Following PR rules strictly | ✓ | ✓ | ✓, except bem, bez |
same as 19 |
- Exception when fail:
Resources$NotFoundException: Plural resource ID #id quantity=x item=other - You cannot have an empty plurals tag
- Deleted plurals just fallback to default
You can find the generator (to generate the strings.xml file and their contents) that follows the rules of PLURAL_TAGS that it's in your pull request (translate/translate#3762) and the app source code here:
https://github.com/mauriciocolli/LanguageTest
There's some already compiled apks if you want to test in your device.
|
@mauriciocolli Thanks for verifying this! I've just deployed this change to Hosted Weblate, so that will give these changes some more real life testing. There are still few languages whose plural rules in CLDR differ to what is usually used in Gettext, so these will need additional fixes on the Weblate side:
|
We need to support more plural rules for language and this is preparation work for this. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
This is consistent with existing code. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
This currently works only for gettext which actually stores plural formula. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
This now closer follows CLDR and alternative plurals are listed separately. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
It is now handled in separate model. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
It was just temporary for migration. Issue #1550 Signed-off-by: Michal Čihař <michal@cihar.com>
Signed-off-by: Michal Čihař <michal@cihar.com>
|
Thank you for your report, the issue you have reported has just been fixed in Weblate. The complete fix depends on translate/translate#3762 (which is already deployed in Hosted Weblate).
|
These seem to be broken as they are missing the 'other' tag. The problem is that not all languages use 'other' tag, so adding it back requires CLDR knowledge. In this case it's better to have full tags defined inside translate-toolkit than relying on broken library and fixing the data. See following issue trackers for more details: * WeblateOrg/weblate#1550 * python-babel/babel#495
This brings several important features and fixes: - fixes to the JSON storage (see WeblateOrg/weblate#1671) - Android plural fixes (see WeblateOrg/weblate#1550) - improved PHP storage - fixes to the YAML storage Signed-off-by: Michal Čihař <michal@cihar.com>
With Hebrew, the user interface shows One and Other as the options:
But the strings.xml then has One and Two filled out, then Many and Other blank:
An empty Other string can cause crashes. Especially because we remove blank strings, since they cause other problems. Weblate should ensure that if any item of
<plurals>has been translated, then<item quantity="other">must be translated. Here's the Android source reference on the requirement for other:https://android.googlesource.com/platform/frameworks/base/+/master/core/java/android/content/res/ResourcesImpl.java#268
Server configuration
https://hosted.weblate.org/translate/f-droid/f-droid
The text was updated successfully, but these errors were encountered: