Emoji totally breaks comments

[steveklabnik]

See here: https://lobste.rs/s/mycvzo/learning_to_program_and_when_to_start_building_your_own_app/comments/mppo6p

[steveklabnik]

This comment has 👍 in it.

[steveklabnik]

This comment has 👍 in it.

[rjsamson]

I was actually just about to post the same issue. Interestingly enough the full text of your reply showed up just fine in the email reply notification that I received when you replied to my comment:
So it seems to be something that happens after reply notifications are sent.

[rjsamson]

I was actually just about to post the same issue. Interestingly enough the full text of your reply showed up just fine in the email reply notification that I received when you replied to my comment:
So it seems to be something that happens after reply notifications are sent.

[jcs]

I just looked in the database and there are no characters in the table after "A big ".

 mysql> select comment, length(comment) from comments where short_id = 'mppo6p';
 +-------------+-----------------+
 | comment     | length(comment) |
 +-------------+-----------------+
 | Yep. A big  |              11 |
 +-------------+-----------------+

I can see the full text of the comment in the production.log, and it's obviously making its way to the e-mail notification, but getting truncated at the point where \xf0\x9f\x91\x8d begins when writing to MySQL.

It's MySQL 5.1 with a utf8 table (encoding: utf8 in database.yml) and Rails/AR 3.2.6 (mysql2 0.3.11 gem) if you want to figure it out.

[jcs]

I just looked in the database and there are no characters in the table after "A big ".

 mysql> select comment, length(comment) from comments where short_id = 'mppo6p';
 +-------------+-----------------+
 | comment     | length(comment) |
 +-------------+-----------------+
 | Yep. A big  |              11 |
 +-------------+-----------------+

I can see the full text of the comment in the production.log, and it's obviously making its way to the e-mail notification, but getting truncated at the point where \xf0\x9f\x91\x8d begins when writing to MySQL.

It's MySQL 5.1 with a utf8 table (encoding: utf8 in database.yml) and Rails/AR 3.2.6 (mysql2 0.3.11 gem) if you want to figure it out.

[jcs]

I can also reproduce this on my Mac with a MySQL 5.5 server, same DB structure.

[jcs]

I can also reproduce this on my Mac with a MySQL 5.5 server, same DB structure.

[jcs]

Committed hack in 9ece666 to temporarily work around this problem by stripping out emoji.

[jcs]

Committed hack in 9ece666 to temporarily work around this problem by stripping out emoji.

[jcs]

upgraded server to mariadb, changed tables to utf8mb4, using git version of mysql2 gem, emoji works now

https://lobste.rs/s/mycvzo/learning_to_program_and_when_to_start_building_your_own_app/comments/fhc74c

[jcs]

upgraded server to mariadb, changed tables to utf8mb4, using git version of mysql2 gem, emoji works now

https://lobste.rs/s/mycvzo/learning_to_program_and_when_to_start_building_your_own_app/comments/fhc74c

[steveklabnik]

I can confirm that this totally works. 🤘

[steveklabnik]

I can confirm that this totally works. 🤘