Question about extended characters

[boydkelly]

Hi,
Thanks for this project! I'm just testing a few things, and since I am dealing with a lanugage with extended latin characters I noticed that libasciidoc converts them with these codes as such:

Mɔgɔkɔrɔbaw ya kuman ka kan ka to denminsɛnw hakili la

Whereas asciidoctor will preserve the charcters in the html output:

Mɔgɔkɔrɔbaw ya kuman ka kan ka to denminsɛnw hakili la

Is this something that can be tweaked with go on my end? Thanks for any pointers!

[pjanx]

I've also noticed that libasciidoc converts everything non-ASCII into HTML entities, unlike Asciidoctor:

Путин — хуйло!

is transformed into:

<div class="paragraph">
<p>&#1055;&#1091;&#1090;&#1080;&#1085; &#8212; &#1093;&#1091;&#1081;&#1083;&#1086;!</p>
</div>

Note that libasciidoc already uses <meta charset="utf-8"> in its template.

It may still be theoretically useful to "entitify" the output, though I wouldn't have this behaviour as the default, and it's something a post-processing filter can do, anyway, should such a need arise.

[xcoulon]

I'll see what I can do about it. Maybe there's call to html.EscapeString that we can get rid of.
Could you open an issue about it, please?

[pjanx]

Done. html.EscapeString doesn't create entities like that.

[xcoulon]

cool, thanks for taking time to open an issue!

html.EscapeString doesn't create entities like that.

oh, ok. I'll need to dig a little, then ;)

[pjanx]

The behaviour has been aligned for 0.7.0.