Encoding problem with emacs 26.0.50 when sending message with accents

[tofgarion]

Hello,

I have a problem with messages in which accentuated characters appears. Even if the buffer is UTF-8 encoded, when sending the message there is an encoding error. This behavior appeared when I updated my version of emacs to a recent commit of emacs 26.0.50.

Expected or desired behavior

Sending a message with accentuated characters (like "é" for instance).

Actual behavior

When writing a message with the "é" character for instance, the following buffer arise when sending the message:

These default coding systems were tried to encode text
in the buffer ‘1494793945.eff2586f7c6405cc.XXX:2,S’:
  (utf-8-unix (293 . 4194243) (294 . 4194217) (295 . 4194243) (296
  . 4194217) (297 . 4194243) (298 . 4194217) (299 . 4194243) (300
  . 4194217))
However, each of them encountered characters it couldn’t encode:
  utf-8-unix cannot encode these:        

Click on a character (or switch to this window by ‘C-x o’
and select the characters by RET) to jump to the place it appears,
where ‘C-u C-x =’ will give information about it.

Select one of the safe coding systems listed below,
or cancel the writing with C-g and edit the buffer
   to remove or modify the problematic characters,
or specify any other coding system (and risk losing
   the problematic characters).

  raw-text no-conversion

Selecting utf-8 as coding system works: the message is correctly encoded and the "é" character is correctly interpreted when receiving it.

Steps to reproduce

Start emacs 26 with -Q option. Load mu4e library. Write a message with "é" in the body. Send it.

Versions of mu, mu4e/emacs, operating system etc.

I am currently using Debian with

• a recent version of emacs 26.0.50 (commit 10037e4be2)
• a version of mu from commit 34d5c61

Any other detail

This behavior happened few weeks ago when I updated my emacs local copy. I have quickly tried to git blame message.el and some files related to it without finding any significant change wrt the problem.

Thanks in advance,

Christophe

[tmalsburg]

FWIW, I have the same problem and I saw similar reports on stackexchange: https://emacs.stackexchange.com/questions/7946/using-utf8-encoding-as-default-when-writing-emails

I, too, started to experience this problem after updating emacs (a few months back). The mode line indicates that the buffer encoding is Unicode and as long as the context of the message is ASCII, there is no problem, but when I type umlauts (for example), I get the error message. I tried the following settings but none of that helped:

(prefer-coding-system 'utf-8)
(set-default-coding-systems 'utf-8)
(set-terminal-coding-system 'utf-8)
(set-keyboard-coding-system 'utf-8)
(set-language-environment 'utf-8)
(setq mm-coding-system-priorities '(utf-8))

Here is the error message, I received when I typed öüä into the message:

These default coding systems were tried to encode text
in the buffer ‘1505902295.ea5544bf07aad58e.florida:2,S’:
  (utf-8 (318 . 4194243) (319 . 4194230) (320 . 4194243) (321
  . 4194236) (322 . 4194243) (323 . 4194212))
However, each of them encountered characters it couldn’t encode:
  utf-8 cannot encode these:      

Click on a character (or switch to this window by ‘C-x o’
and select the characters by RET) to jump to the place it appears,
where ‘C-u C-x =’ will give information about it.

Select one of the safe coding systems listed below,
or cancel the writing with C-g and edit the buffer
   to remove or modify the problematic characters,
or specify any other coding system (and risk losing
   the problematic characters).

  raw-text no-conversion

At this point (but not before C-c C-c) the buffer shows the following instead of öüä:

\303\266\303\274\303244

When I choose utf-8-unix as the encoding the email in my sent folder looks correct.

[stsquad]

As off http://git.savannah.gnu.org/cgit/emacs.git/commit/?h=emacs-26&id=aca5f0072b531d9621b0ff90e656e589281c8155 this is hopefully fixed.

[tmalsburg]

Confirmed. Just built the latest development version and the problem is gone. About time. On the other had, I got really really good at typing "utf-8-unix".

[tofgarion]

Also confirmed with emacs-26 branch of the emacs Git repository.

[stsquad]

@djcb I guess we can close this issue out with "Fixed Upstream" now? Is it worth a note anywhere else or do we expect people tracking emacs-26 to update fairly frequently?

[djcb]

Okay, yeah. This is fixed upstream in emacs now.