Repository navigation
Codename: [<control>]
Added
- Elixir: a
mojibakeMix package insrc/elixirthat compiles the C library into a NIF, with
normalization (including NFKC_Casefold) and quick checks, locale-aware upper, lower, and
titlecase, full and simple case folding, caseless matching, grapheme, word, and sentence
segmentation, line-break opportunities, counts and prefixes, and terminal width and truncation.
It passes the Unicode normalization, segmentation, and line-break conformance tests make test-elixir,make vendor-elixir, andmake package-elixir, and an Elixir CI job- Elixir: character data.
Mojibake.Charreturns names, categories, combining and bidi classes,
decomposition types, numeric values, simple case mappings, blocks, scripts and
Script_Extensions, East Asian width, emoji properties, and every stored binary and enumerated
property, as atoms.Mojibake.Script,Mojibake.Block,Mojibake.Plane, and
Mojibake.Propertydescribe their values,Mojibake.Emojiclassifies emoji sequences, and
Mojibake.Hangulcomposes and decomposes syllables. The atom tables are generated by
make generateintosrc/elixir/lib/mojibake/unicode_data.ex - Elixir:
Mojibake.Collation(UCA comparison, sorting, and sort keys),Mojibake.IDNA(UTS #46
ToASCII and ToUnicode),Mojibake.Security(confusable skeletons and matching, resolved script
sets),Mojibake.Identifier(UAX #31),Mojibake.Encoding(UTF-8, UTF-16, and UTF-32
detection, validation, and conversion), andMojibake.LanguageTag(strict BCP 47 parsing and
formatting). They pass the Unicode collation and IDNA conformance tests - Elixir:
Mojibake.Bidi, the Unicode Bidirectional Algorithm.resolve/2returns a paragraph
whose levels the NIF keeps, andlevels/1,chars/1,reorder/2,runs/2, andvisual/2
lay out its lines. It passesBidiCharacterTest.txt - An Elixir example in
examples/elixir, run withmake -C examples example-elixir - Elixir: precompiled NIFs for Linux (x86_64 and aarch64, glibc), macOS (x86_64 and arm64), and
Windows (x86_64), downloaded from the GitHub release and checked againstchecksum.exs, so
that installing the package needs no compiler there. Other platforms, and packages built with
fewer features orMOJIBAKE_BUILD=1, compile from source. TheElixir precompiled NIFs
workflow builds, checks, and uploads them - Elixir: Windows support with MSVC, through
Makefile.winandnmake, tested in CI Makefile.nmakegainstest-elixir,vendor-elixir, andpackage-elixir, which the Windows
Elixir CI job runs
Changed
- Updated Attractor to 1.1.0
- Moved
src/apitosrc/wasm
Fixed
mjb_codepoint_inforeturns a record for surrogates (U+D800 to U+DFFF, category Cs) and
private-use characters (U+E000 to U+F8FF, U+F0000 to U+FFFFD, and U+100000 to U+10FFFD,
category Co) instead ofMJB_STATUS_NOT_FOUND, with no name and default properties as in
UnicodeData.txt. As a resultmjb_for_each_codepoint,mjb_filter, and the CLIcharand
codepointcommands no longer drop private-use charactersmjb_codepoint_inforeturns a record (category Lo) for every Unicode 18 ideograph range listed
in UnicodeData.txt: Tangut Ideograph now ends at U+187FF and Tangut Ideograph Supplement at
U+18D20 (MJB_TANGUT_IDEOGRAPH_ENDandMJB_TANGUT_IDEOGRAPH_SUPPLEMENT_END), and the new
Jurchen Character (U+18E00 to U+19191, "JURCHEN CHARACTER-") and Seal Character (U+3D000 to
U+3FC3F, "SMALL SEAL CHARACTER-") ranges are handled, with the new
MJB_JURCHEN_CHARACTER_START/_ENDandMJB_SEAL_CHARACTER_START/_ENDlimitsmjb_codepoint_inforeturnsMJB_STATUS_NOT_FOUNDfor the unassigned U+18CDB to U+18CFE
instead of a "KHITAN SMALL SCRIPT CHARACTER-*" recordMJB_FILTER_LIMIT_COMBININGno longer restarts its count at a Default_Ignorable_Code_Point
character, so inserting U+200D ZERO WIDTH JOINER between runs of marks cannot stack more than
MJB_FILTER_MAX_COMBINING_MARKSmarks on one letter- Documented that
MJB_FILTER_LIMIT_COMBININGcounts every combining mark (Mn, Mc, and Me) in
any block, so a mark outside U+0300 to U+036F, such as U+0489, does not restart the count