Skip to content

v0.2.1

Choose a tag to compare

@github-actions github-actions released this 08 Nov 20:21
· 123 commits to main since this release

Added

  • polanon --version prints the installed version. Contributed by barkya28 in
    #29.
  • An eleventh benchmark document, a monthly roster of surnames and periods, which keeps names
    beside ordinary numbers masked without a language model. The corpus now has 169 annotated
    values: the rules alone fully mask 86% of them and the rules with pl_core_news_md 98%.

Fixed

  • E-mail addresses with Polish letters are masked whole: zofia.żak@example.com was masked
    as a name and half an address, and an address on an internationalised domain not at all.
    Contributed by ShahadatTest in #14.
  • A phone number after "tel." is labelled a phone, not a REGON: one nine-digit number in ten
    passes the REGON checksum, and the model was told it was a company's register number.
    Contributed by ShahadatTest in #22; "kom."
    counts as a phone label as well, and "hotel" no longer does.
  • A phone number written with a bare 48 in front is masked whole: 48123456789, as SMS
    gateways and CRM exports write it, went out unmasked, and in 48 123 456 789 the country code
    stayed in the clear. A valid PESEL that starts with 48 keeps its type, and the minutes of a time
    such as 10:48 are not pulled into the phone. Contributed by Aaqibhafeezkhan in
    #26.
  • A restored name with a case ending is not reported as new: "dla <OSOBA_1>a" restored as
    "Jan Kowalskia" was flagged by the output sweep as personal data the model made up. A person,
    company or place known from the conversation now covers its Polish case endings, while a longer
    different name, letters glued on the left, and other types such as an address with a letter
    added are still reported. Contributed by bfs2021 in
    #25.
  • A month spelled like a first name is left alone in a date written with dashes, slashes or
    dots: "Jan" in 15-Jan-2024, 2024/Jan/15 or 15.Jan.2024 was masked as a person. The same
    separator has to stand on both sides, so a name beside an ordinary number, as in
    Nowak Anna 03/2024, is still masked. Contributed by ShahadatTest in
    #23.