Mail.new fails to parse UTF-8 characters in to: field

[jurezove]

mail = Mail.new(to: "Jure Žove <jure.pase.kure@gmail.com>")
mail[:to]

 => #<Mail::Field:0x007fe5ef506f90 @field=#<Mail::UnstructuredField:0x007fe5ef4ef520 @errors=[["to", "Jure Žove <jure.pase.kure@gmail.com>", #<Mail::Field::ParseError: Mail::AddressListsParser can not parse |Jure Žove <jure.pase.kure@gmail.com>|
Reason was: Expected one of 
, (, !, #, $, %, &, ', *, +, -, /, =, ?, ^, _, `, {, |, }, ~, ", ., @, :, <, ,, ; at line 1, column 6 (byte 6) after >]], @charset=#<Encoding:UTF-8>, @name="to", @length=nil, @tree=nil, @element=nil, @value="Jure Žove <jure.pase.kure@gmail.com>">> 

[carsonreinke]

Mail::Address.new("Jure Žove <jure.pase.kure@gmail.com>")
Mail::Field::ParseError: Mail::AddressListsParser can not parse |Jure Žove <jure.pase.kure@gmail.com>|

Mail::Address.new("=?UTF-8?B?SnVyZSDFvW92ZQ==?= <jure.pase.kure@gmail.com>")
 => #<Mail::Address:70093092354000 Address: |"Jure Žove" <jure.pase.kure@gmail.com>| > 

Maybe this is expected, since the display name must be encoded.

[jurezove]

Thanks, can you please provide a way how I could encode it and still preserve the character?

[carsonreinke]

$ > addr = Mail::Address.new('jure.pase.kure@gmail.com')
 => #<Mail::Address:70197914477980 Address: |jure.pase.kure@gmail.com| > 
$ > addr.display_name = 'Jure Žove'
 => "Jure Žove" 
$ > addr.encoded()
 => "=?UTF-8?B?SnVyZSDFvW92ZQ==?= <jure.pase.kure@gmail.com>" 
$ > addr.decoded()
 => "\"Jure Žove\" <jure.pase.kure@gmail.com>" 

[jurezove]

What about if I already receive a mail want get the display name of the to or from fields? I would probably need to encode the string ("Jure Žove email@email.com") before I try to parse it?

[carsonreinke]

Look at the original unmodified email, the UTF-8 characters should be encoded.

Like I received an email notification from GitHub and it had this From: =?UTF-8?B?SnVyZSDFvW92ZQ==?= <notifications@github.com>

[jurezove]

The thing is I'm getting this through a JSON request from Mailgun which is already in UTF-8 (not encoded).

[carsonreinke]

Ultimately, the decoded address would have to be parsed. The Mail::Address comments state "Mail::Address requires a correctly formatted email address per RFC2822 or RFC822."

[jurezove]

Okay, thanks! Will look into that.

[carsonreinke]

Related to #39

[sk-]

Why was this issue closed? I'm also having troubles parsing these malformed headers.

One of the offending headers I'm getting is: From: ÁREA DE DEPORTES Y RECREACIÓN<foo@foo.com>

Note that Gmail is able to correctly parse this header, and that it is not encoded.

[adamsanderson]

@sk- If you are trying to use Mail::Address.new(addr), it will fail on non ascii characters.
Instead, try calling encoded = Mail::Encodings.address_encode(addr) and then use that with Mail::Address.new(addr). That will base64 encode the address with the string encoding embedded.

[jeremy]

These are fixed by #1103:

>> Mail.new(to: "Jure Žove <jure.pase.kure@gmail.com>").to
=> ["jure.pase.kure@gmail.com"]
>> Mail.new("From: ÁREA DE DEPORTES Y RECREACIÓN<foo@foo.com>").from
=> ["foo@foo.com"]