Skip to content

UNIHAN: 11.0.0 -> 15.1.0 (2019 -> 2023) #309

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tony merged 28 commits into from
Feb 4, 2024
Merged

UNIHAN: 11.0.0 -> 15.1.0 (2019 -> 2023) #309

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
f8db868
chore: Remove kRSJapanese (13.0.0)
tony Feb 3, 2024
4fcec21
chore: Remove kRSKanWa (13.0.0)
tony Feb 3, 2024
faab82f
chore: Remove kRSKorean (13.0.0)
tony Feb 3, 2024
06ea783
chore: Add kIRG_SSource (13.0.0)
tony Feb 3, 2024
9fd78cd
tests: Add doctest for _expand_kIRG_GenericSource
tony Feb 3, 2024
7c73a14
chore: Add kIRG_UKSource (13.0.0)
tony Feb 3, 2024
434015f
chore(kIRG-USource): Remove UCI-\d{5} prefix (removed revision 28)
tony Feb 3, 2024
d02c0a6
chore: Add kSpoofingVariant (13.0.0)
tony Feb 3, 2024
189798f
chore: Add kTGHZ2013 (13.0.0)
tony Feb 3, 2024
d63dd34
chore: Add kUnihanCore2020 (13.0.0)
tony Feb 3, 2024
6c5a8ec
chore: Add kStrange (14.0.0)
tony Feb 4, 2024
e05f2c0
chore(kStrange): Typed literal for property type
tony Feb 4, 2024
65d6e64
chore: Add kAlternateTotalStrokes (15.0.0)
tony Feb 4, 2024
8ab81c1
chore: Add kJapanese (15.1.0)
tony Feb 4, 2024
ad67183
chore: Add kMojoJoho (15.1.0)
tony Feb 4, 2024
acd1f5b
chore: Add kSMSZD2003Index (15.1.0)
tony Feb 4, 2024
519e845
chore: Add kSMSZD2003Readings (15.1.0)
tony Feb 4, 2024
a07894e
chore: Add kVietnameseNumeric (15.1.0)
tony Feb 4, 2024
b699f9f
chore: Add kZhuangNumeric (15.1.0)
tony Feb 4, 2024
70ae128
chore: Remove kHKSCS (removed in 15.1.0)
tony Feb 4, 2024
101889c
chore: kIRGDaiKanwaZiten (removed in 15.1.0)
tony Feb 4, 2024
27cbf58
chore: kKPS0 (removed in 15.1.0)
tony Feb 4, 2024
485d670
chore: Add kKPS1 (15.1.0)
tony Feb 4, 2024
65111d7
chore: Add kKSC0 (15.1.0)
tony Feb 4, 2024
f8cd6c8
chore: Add kKSC1 (15.1.0)
tony Feb 4, 2024
f3408dd
chore: Add kRSKangXi (15.1.0)
tony Feb 4, 2024
438ea25
chore(pytest plugin): Loosen fixture size for removed fields
tony Feb 4, 2024
af468b9
docs(CHANGES): Note UNIHAN 15.1.0 updates
tony Feb 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 36 additions & 0 deletions CHANGES
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,42 @@ $ pipx install --suffix=@next unihan-etl --pip-args '\--pre' --force

<!-- Maintainers, insert changes / features for the next release here -->

### Breaking: UNIHAN upgrades (#305)

#### Removed fields

- 15.1.0: [kHKSCS](https://www.unicode.org/L2/L2023/23005.htm#174-C10),
[kIRGDaiKanwaZiten](https://www.unicode.org/L2/L2022/22241.htm#173-C9),
[kKPS0](https://www.unicode.org/L2/L2023/23005.htm#174-C11),
[kKPS1](https://www.unicode.org/L2/L2023/23005.htm#174-C11),
[kKSC0](https://www.unicode.org/L2/L2023/23005.htm#174-C9),
[kKSC1](https://www.unicode.org/L2/L2023/23005.htm#174-C9),
[kRSKangXi](https://www.unicode.org/L2/L2022/22241.htm#173-C12)
- 13.0.0:
[kRSJapanese](https://www.unicode.org/cgi-bin/GetDocumentLink?L2/19-209),
[kRSKanWa](https://www.unicode.org/cgi-bin/GetDocumentLink?L2/19-209),
[kRSKorean](https://www.unicode.org/cgi-bin/GetDocumentLink?L2/19-209)
- 12.0.0:
[kDefaultSortKey](https://www.unicode.org/cgi-bin/GetDocumentLink?L2/18-118)
(private property)

#### New fields

- 15.1.0: [kJapanese](https://www.unicode.org/reports/tr38/#kJapanese),
[kMojiJoho](https://www.unicode.org/reports/tr38/#kMojiJoho),
[kSMSZD2003Index](https://www.unicode.org/reports/tr38/#kSMSZD2003Index),
[kSMSZD2003Readings](https://www.unicode.org/reports/tr38/#kSMSZD2003Readings),
[kVietnameseNumeric](https://www.unicode.org/reports/tr38/#kVietnameseNumeric),
[kZhuangNumeric](https://www.unicode.org/reports/tr38/#kZhuangNumeric)
- 15.0.0:
[kAlternateTotalStrokes](https://www.unicode.org/reports/tr38/#kAlternateTotalStrokes)
- 14.0.0: [kStrange ](https://www.unicode.org/reports/tr38/#kStrange)
- 13.0.0: [kIRG_SSource](https://www.unicode.org/reports/tr38/#kIRG_SSource),
[kIRG_UKSource](https://www.unicode.org/reports/tr38/#kIRG_UKSource),
[kSpoofingVariant](https://www.unicode.org/reports/tr38/#kSpoofingVariant),
[kTGHZ2013](https://www.unicode.org/reports/tr38/#kTGHZ2013),
[kUnihanCore2020](https://www.unicode.org/reports/tr38/#kUnihanCore2020)

### Development

- Quiet pytest tracebacks (#310)
Expand Down
104 changes: 59 additions & 45 deletions datapackage.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,13 @@
"type": "string",
"format": "default"
},
{
"name": "kAlternateTotalStrokes",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kBigFive",
"title": "",
Expand Down Expand Up @@ -234,13 +241,6 @@
"type": "string",
"format": "default"
},
{
"name": "kHKSCS",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kHanYu",
"title": "",
Expand Down Expand Up @@ -290,13 +290,6 @@
"type": "string",
"format": "default"
},
{
"name": "kIRGDaiKanwaZiten",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kIRGHanyuDaZidian",
"title": "",
Expand Down Expand Up @@ -354,112 +347,105 @@
"format": "default"
},
{
"name": "kIRG_TSource",
"name": "kIRG_SSource",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kIRG_USource",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kIRG_VSource",
"name": "kIRG_TSource",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kJIS0213",
"name": "kIRG_USource",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kJapaneseKun",
"name": "kIRG_VSource",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kJapaneseOn",
"name": "kJapanese0213",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kJis0",
"name": "kJIS0213",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kJis1",
"name": "kJapaneseKun",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKPS0",
"name": "kJapaneseOn",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKPS1",
"name": "kJis0",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKSC0",
"name": "kJis1",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKSC1",
"name": "kKangXi",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKangXi",
"name": "kKarlgren",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKarlgren",
"name": "kKorean",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kKorean",
"name": "kLau",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kLau",
"name": "kMojiJoho",
"title": "",
"description": "",
"type": "string",
Expand Down Expand Up @@ -543,63 +529,63 @@
"format": "default"
},
{
"name": "kRSJapanese",
"name": "kRSUnicode",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kRSKanWa",
"name": "kSBGY",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kRSKangXi",
"name": "kSemanticVariant",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kRSKorean",
"name": "kSimplifiedVariant",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kRSUnicode",
"name": "kSMSZD2003Index",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kSBGY",
"name": "kSMSZD2003Readings",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kSemanticVariant",
"name": "kSpecializedSemanticVariant",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kSimplifiedVariant",
"name": "kSpoofingVariant",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kSpecializedSemanticVariant",
"name": "kStrange",
"title": "",
"description": "",
"type": "string",
Expand All @@ -619,6 +605,13 @@
"type": "string",
"format": "default"
},
{
"name": "kTGHZ2013",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kTotalStrokes",
"title": "",
Expand All @@ -633,13 +626,27 @@
"type": "string",
"format": "default"
},
{
"name": "kUnihanCore2020",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kVietnamese",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kVietnameseNumeric",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kXHC1983",
"title": "",
Expand All @@ -654,6 +661,13 @@
"type": "string",
"format": "default"
},
{
"name": "kZhuangNumeric",
"title": "",
"description": "",
"type": "string",
"format": "default"
},
{
"name": "kZVariant",
"title": "",
Expand Down
Loading