non-ASCII character corruption in shapefile

[qgib]

Author Name: Leyan Ouyang (Leyan Ouyang)
Original Redmine Issue: 6327
Affected QGIS version: master

---

The non-ASCII characters seem to be corrupted on a new shapefile. Steps to reproduce:

• Create a shapefile, choosing UTF8 and adding a text attribute
• Create a feature and fill the text attribute with non-ASCII text (for example 汉字)
• Save the shapefile.

The text of the attribute is replaced by "??"

This does not happen when loading an existing UTF8 shapefile, it can even be modified and saved. "Save as", however, is also affected.

I use QGis master and latest GDAL build from SVN. I am using ArchLinux with a en_US.UTF-8 locale.

I am aware of the previous issues between QGIS and GDAL, but Alexander Bruy told me they were mostly solved now and this problem looks different, hence this new bug report.

[qgib]

Author Name: Leyan Ouyang (Leyan Ouyang)

---

Everything seems to work much better if I choose the option "Ignore shapefile encoding". What does this new option do exactly ?

[qgib]

Author Name: Alexander Bruy (@alexbruy)

---

Should be fixed in master, see 75dc85b.

---

• operating_system was changed from ArchLinux to
• status_id was changed from Open to Feedback

[qgib]

Author Name: Leyan Ouyang (Leyan Ouyang)

---

This is the option "Ignore shapefile encoding" I mentioned in the first comment, and it does seem to solve the issue. However, the bug is not fixed in my opinion as the default setting will lead to loss of data. This option should be checked by default while the issues with GDAL are not sorted out.

[qgib]

Author Name: Giovanni Manghi (@gioman)

---

• priority_id was changed from High to Normal

[qgib]

Author Name: Borys Jurgiel (@borysiasty)

---

Fixed in 4fb9879

---

• resolution was changed from to fixed
• status_id was changed from Feedback to Closed