Unicode Grapheme Cluster Boundary detection
Perl6 Makefile
Switch branches/tags
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
lib/Unicode
t
.gitignore
.travis.yml
LICENSE
META6.json
Makefile
README.md

README.md

Unicode::GCB Build Status

Unicode grapheme cluster boundary detection

Synopsis

    use Unicode::GCB;

    say GCB.always(0x600, 0x30);
    say GCB.maybe(
        "\c[REGIONAL INDICATOR SYMBOL LETTER G]".ord,
        "\c[REGIONAL INDICATOR SYMBOL LETTER B]".ord);

    say GCB.clusters("äöü".NFD);

Description

Implements the Unicode 9.0 grapheme cluster boundary rules.

In contrast to earlier versions of the standard, it is no longer possible to unambiguously decide if there's a cluster break between two Unicode characters by looking at just these two characters.

In particular, there's a break between a pair of regional indicator symbols only if the first symbol has already been paired up with another indicator and there's no break between extension characters and emoji modifiers if the current cluster forms an emoji sequence.

Therefore, the module provides two different methods GCB.always() and GCB.maybe() which both expect two Unicode codepoints as arguments.

The method GCB.clusters() expects a Uni object as argument and returns a sequence of such objects split along cluster boundaries.

Bugs and Development

Development happens at GitHub. If you found a bug or have a feature request, use the issue tracker over there.

Copyright and License

Copyright (C) 2016 by cygx@cpan.org

Distributed under the Boost Software License, Version 1.0