4 byte unicode in comments

[karlitschek]

We should make sure that we support 3 byte unicode also in comments with databases that only support 3byte like mysql.
For example by an additional manual php encoding step of the affected characters without encoding the complete string.

@blizzz @PVince81 @cmonteroluque

[DeepDiver1975]

@dragotin already reported this

[SergioBertolinSG]

Related: #17978

[DeepDiver1975]

we support 3 byte unicode

@karlitschek 4 byte I assume?

[ghost]

I presume this is for old versions of MySQL before utf8mb4 support?

[DeepDiver1975]

utf8mb4 support?

we do not support utf8mb4 yet - there are many issues related - see #17978

[ghost]

right, I thought the idea was to resolve that for MySQL 5.5 and above, or did I get the point of this issue wrong?

[DeepDiver1975]

We are facing many issues with mysql regarding 4 bytes ....

• index length are different which has to be addressed by special mysql config options
• some tables are exceeding the max size - we know at least of the activities table

[nickvergessen]

I tested the following apps, only activity needed a fix for now:

  - activity: 2.3.2
  - admin_audit: true
  - announcementcenter: 1.2.0
  - calendar: 1.1
  - comments: 0.3.0
  - dav: 0.2.3
  - encryption: 1.3.0
  - enterprise_key: true
  - federatedfilesharing: 0.2.0
  - federation: 0.1.0
  - files: 1.5.1
  - files_antivirus: true
  - files_drop: 0.5.0
  - files_external: 0.6.0
  - files_ldap_home: true
  - files_pdfviewer: 0.8
  - files_sharing: 0.10.0
  - files_texteditor: 2.1
  - files_trashbin: 0.9.0
  - files_versions: 1.3.0
  - firewall: 2.4.0
  - firstrunwizard: 1.1
  - mail: 0.4.2
  - notifications: 0.3.0
  - password_policy: true
  - provisioning_api: 0.5.0
  - search_lucene: true
  - sharepoint: true
  - systemtags: 0.3.0
  - systemtags_management: 0.2.0
  - templateeditor: 0.1
  - testing: 0.1.0
  - updatenotification: 0.2.0
  - user_ldap: 0.9.0
  - windows_network_drive: 0.2.33
  - workflow: 0.2.2

[DeepDiver1975]

I tested the following apps, only activity needed a fix for now:

@nickvergessen thanks a lot!

[PVince81]

Closing as duplicate of #4513

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.