Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to Unicode 15.0.0 #107

Merged
merged 1 commit into from
Sep 13, 2022
Merged

Upgrade to Unicode 15.0.0 #107

merged 1 commit into from
Sep 13, 2022

Conversation

syvb
Copy link
Contributor

@syvb syvb commented Sep 12, 2022

Unicode 15 will be released tomorrow on Sept. 13. This updates the Unicode tables to the latest version.

Change notes:

  • The {Grapheme,Word,Sentence}BreakTest.txt files are unchanged (except for the file header), so no change is needed to testdata.rs
  • Changes to UAX#29 (Unicode Text Segmentation):
    • Revision 41 doesn't make any substantive changes
    • Revision 40 adds "four postbase Kawi characters to the SpacingMark exceptions" (U+11F03, U+11F34, U+11F35, U+11F41). Currently it looks like none of the 24 SpacingMark exceptions are implemented (although the impact of this is very minor, it only affects word breaking in extended mode), so this should be fixed in a separate PR

Unicode 15 will be released on Sept. 13: https://unicode.org/versions/Unicode15.0.0/
This updates the Unicode tables to the latest version.

The {Grapheme,Word,Sentence}BreakTest.txt files are unchanged (except
for the file header), so no change is needed to testdata.rs.
@Manishearth Manishearth merged commit 8afd198 into unicode-rs:master Sep 13, 2022
@Manishearth
Copy link
Member

Thanks! File a followup about the exceptions?

@syvb syvb deleted the unicode-15 branch September 13, 2022 22:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants