Vietnamese App Store metadata invalid characters

[dpomatch]

New Issue Checklist

• [x ] Updated fastlane to the latest version
• I read the Contribution Guidelines
• I read docs.fastlane.tools
• I searched for existing GitHub issues

Issue Description

I am trying to upload localised release notes to App Store by providing a path with the metadata folders. There is an issue with uploading Vietnamese strings where it complains about invalid characters in the Vietnamese string. The string is accepted when copying it and pasting into App Store manually. I assume it has something to do with UTF-8 mangling as running hexdump on the string gives a shorter output when I copy it from the App Store rather than on the string directly. I've tried converting it with iconv -f UTF-8-MAC -t UTF-8, which reduces the amount of invalid characters but not completely. I have not found a conversion that works fully, which forces me to handle Vietnamese metadata manually.

I fetch the strings from Phrase translation tool.

Command executed

fastlane upload_to_app_store

Complete output when running fastlane, including the stack trace and command used

#<Thread:0x000000010b25f0d8 /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/fastlane_core/lib/fastlane_core/queue_worker.rb:37 run> terminated with exception (report_on_exception is true):
/usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/spaceship/lib/spaceship/connect_api/api_client.rb:204:in handle_response': An attribute value has invalid characters. - What's New in This Version can’t contain the following character(s): ́, ̃, ̣, ̉. - /data/attributes/whatsNew (Spaceship::UnexpectedResponse) from /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/spaceship/lib/spaceship/connect_api/api_client.rb:135:in patch'
from /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/spaceship/lib/spaceship/connect_api/tunes/tunes.rb:815:in patch_app_store_version_localization' from /usr/local/Cellar/ruby/3.1.2/lib/ruby/3.1.0/forwardable.rb:238:in patch_app_store_version_localization'
from /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/spaceship/lib/spaceship/connect_api/models/app_store_version_localization.rb:57:in update' from /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/deliver/lib/deliver/upload_metadata.rb:207:in block in upload'
from /usr/local/Cellar/fastlane/2.209.0/libexec/gems/fastlane-2.209.0/fastlane_core/lib/fastlane_core/queue_worker.rb:40:in `block (2 levels) in start'

Environment

Stack

Key	Value
OS	12.5.1
Ruby	3.1.2
Bundler?	false
Git	git version 2.20.1
Installation Source	/usr/local/Cellar/fastlane/2.209.0/libexec/bin/fastlane
Host	macOS 12.5.1 (21G83)
Ruby Lib Dir	/usr/local/Cellar/ruby/3.1.2/lib
OpenSSL Version	OpenSSL 1.1.1n 15 Mar 2022
Is contained	false
Is homebrew	true
Is installed via Fabric.app	false
Xcode Path	/Applications/Xcode.app/Contents/Developer/
Xcode Version	13.3.1
Swift Version	5.6

System Locale

Variable	Value
LANG	en_US.UTF-8	✅
LC_ALL
LANGUAGE

[fastlane-bot]

It seems like you have not included the output of fastlane env
To make it easier for us help you resolve this issue, please update the issue to include the output of fastlane env 👍

[fastlane-bot]

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates.

Please make sure to update to the latest fastlane version and check if that solves the issue. Let us know if that works for you by adding a comment 👍

Friendly reminder: contributions are always welcome! Check out CONTRIBUTING.md for more information on how to help with fastlane and feel free to tackle this issue yourself 💪

This issue will be auto-closed if there is no reply within 1 month.

[fastlane-bot]

This issue will be auto-closed because there hasn't been any activity for a few months. Feel free to open a new one if you still experience this problem 👍