Feature Request: Unicode Normalization

[zedseven]

Working with a lot of Unicode characters from potentially many sources, I've lately found myself performing Unicode normalization on text a lot.

It would be useful to be able to perform the various Unicode normalization forms on text directly in-editor, without having to copy it elsewhere then paste in the normalized version. In my particular case this is Form D, but I can see uses for all 4 forms.

This isn't a pressing matter by any means but I thought I'd suggest it since there seems to be a built-in method group for this exact purpose in Java already.

[krasa]

Convert Diacritics (Accents) to ASCII is not doing what you need?

[zedseven]

Ah, no - Unicode normalization does things like decompose characters into their component parts:
á (U+E1) -> á (U+61 U+0301)
and converting characters into their canonical forms if necessary:
ʹ (U+0374) -> ʹ (U+02B9)

[krasa]

I see. Adding a new action would be fine. Althought I am thinking that it could be a good idea to use icu4j (unfortunately 13MB jar) beucase JRE 11 Unicode support is limited. https://youtrack.jetbrains.com/issue/JBR-2875

[krasa]

I do not really work with unicode that often, so it seems to me useful to see what happens exactly. What do you say to this?

[krasa]

For your example:

[zedseven]

That looks fantastic. From what I can see, everything looks good there.

[krasa]

You can try it:
StringManipulation.zip

Btw is your IDE version 2020.3+?

[zedseven]

This is fantastic!
I just tried it with Rider EAP 4 2021.1, and everything seems to be working perfectly.
Thank you so much.