Skip to content

v1.0 Demicode Is All Grown Up 馃帀

Choose a tag to compare

@apparebit apparebit released this 19 Sep 16:13
· 226 commits to boss since this release
605f42a

This version adds support for Unicode 15.1. Notably, it incorporates the changes to the grapheme cluster breaking algorithm, which changed substantially since Unicode 15.0. The changes are automatically activated when UnicodeCharacterDatabase is instantiated with 15.1 and they are effectively no-ops for 15.0 and earlier.

The --stats option now prints the bit-width for Unicode properties, too. It also includes data on code points that have non-default values for both the Indic_Conjunct_Break and Grapheme_Cluster_Break properties. Such overlap matters because both properties help determine grapheme cluster breaks. If feasible, integrating both into the same enumeration with single letter enumeration constant values simplifies the implementation of the break algorithm significantly.