You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
polanon --version prints the installed version. Contributed by barkya28 in #29.
An eleventh benchmark document, a monthly roster of surnames and periods, which keeps names
beside ordinary numbers masked without a language model. The corpus now has 169 annotated
values: the rules alone fully mask 86% of them and the rules with pl_core_news_md 98%.
Fixed
E-mail addresses with Polish letters are masked whole: zofia.żak@example.com was masked
as a name and half an address, and an address on an internationalised domain not at all.
Contributed by ShahadatTest in #14.
A phone number after "tel." is labelled a phone, not a REGON: one nine-digit number in ten
passes the REGON checksum, and the model was told it was a company's register number.
Contributed by ShahadatTest in #22; "kom."
counts as a phone label as well, and "hotel" no longer does.
A phone number written with a bare 48 in front is masked whole: 48123456789, as SMS
gateways and CRM exports write it, went out unmasked, and in 48 123 456 789 the country code
stayed in the clear. A valid PESEL that starts with 48 keeps its type, and the minutes of a time
such as 10:48 are not pulled into the phone. Contributed by Aaqibhafeezkhan in #26.
A restored name with a case ending is not reported as new: "dla <OSOBA_1>a" restored as
"Jan Kowalskia" was flagged by the output sweep as personal data the model made up. A person,
company or place known from the conversation now covers its Polish case endings, while a longer
different name, letters glued on the left, and other types such as an address with a letter
added are still reported. Contributed by bfs2021 in #25.
A month spelled like a first name is left alone in a date written with dashes, slashes or
dots: "Jan" in 15-Jan-2024, 2024/Jan/15 or 15.Jan.2024 was masked as a person. The same
separator has to stand on both sides, so a name beside an ordinary number, as in Nowak Anna 03/2024, is still masked. Contributed by ShahadatTest in #23.