Skip to content

v2.0.0

Choose a tag to compare

@jacksonllee jacksonllee released this 23 May 20:02
· 2 commits to master since this release
1b6fce9

This release has incremented the major version number to v2
due to the breaking change of replacing the configuration
arguments --skip-parens/--no-skip-parens with --parens (#577).

Under data/

  • Updates the following languages (#590):
    • Afar (aar)
    • Abkhazian (abk)
    • Hijazi Arabic (acw)
    • Gulf Arabic (afb)
    • Afrikaans (afr)
    • Assyrian Neo-Aramaic (aii)
    • South Levantine Arabic (ajp)
    • Akkadian (akk)
    • Aleut (ale)
    • Amharic (amh)
    • Old English (ca. 450-1100) (ang)
    • Arabic (ara)
    • Official Aramaic (700-300 BCE) (arc)
    • Aragonese (arg)
    • Moroccan Arabic (ary)
    • Egyptian Arabic (arz)
    • Assamese (asm)
    • Asturian (ast)
    • Libyan Arabic (ayl)
    • Azerbaijani (aze)
    • Bashkir (bak)
    • Balinese (ban)
    • Bavarian (bar)
    • Bats (bbl)
    • Uneapa (bbn)
    • Bahnar (bdq)
    • Belarusian (bel)
    • Bengali (ben)
    • Tai Dam (blt)
    • Tibetan (bod)
    • Breton (bre)
    • Buriat (bua)
    • Cebuano (ceb)
    • Chibcha (chb)
    • Chechen (che)
    • Choctaw (cho)
    • Cherokee (chr)
    • Chickasaw (cic)
    • Central Kurdish (ckb)
    • Coptic (cop)
    • Cornish (cor)
    • Corsican (cos)
    • Plains Cree (crk)
    • Kashubian (csb)
    • Welsh (cym)
    • Danish (dan)
    • Dhivehi (div)
    • Dalmatian (dlm)
    • Dungan (dng)
    • Lower Sorbian (dsb)
    • Middle Dutch (ca. 1050-1350) (dum)
    • Dzongkha (dzo)
    • Egyptian (Ancient) (egy)
    • Modern Greek (1453-) (ell)
    • Middle English (1100-1500) (enm)
    • Esperanto (epo)
    • Estonian (est)
    • Etruscan (ett)
    • Basque (eus)
    • Evenki (evn)
    • Ewe (ewe)
    • Faroese (fao)
    • Persian (fas)
    • Fala (fax)
    • Old French (842-ca. 1400) (fro)
    • Northern Frisian (frr)
    • Western Frisian (fry)
    • Scottish Gaelic (gla)
    • Irish (gle)
    • Galician (glg)
    • Manx (glv)
    • Middle Low German (gml)
    • Old High German (ca. 750-1050) (goh)
    • Gothic (got)
    • Swiss German (gsw)
    • Gujarati (guj)
    • Farefare (gur)
    • Gun (guw)
    • Haitian (hat)
    • Hausa (hau)
    • Hawaiian (haw)
    • Serbo-Croatian (hbs)
    • Hebrew (heb)
    • Hiligaynon (hil)
    • Hindi (hin)
    • Hunsrik (hrx)
    • Upper Sorbian (hsb)
    • Hadza (hts)
    • Murui Huitoto (huu)
    • Armenian (hye)
    • Iban (iba)
    • Ido (ido)
    • Iloko (ilo)
    • Interlingua (International Auxiliary Language Association) (ina)
    • Indonesian (ind)
    • Ingush (inh)
    • Icelandic (isl)
    • Ingrian (izh)
    • Jamaican Creole English (jam)
    • Javanese (jav)
    • Jejueo (jje)
    • Japanese (jpn)
    • Kalaallisut (kal)
    • Kannada (kan)
    • Kashmiri (kas)
    • Georgian (kat)
    • Kawi (kaw)
    • Kazakh (kaz)
    • Lü (khb)
    • Khmer (khm)
    • Kikuyu (kik)
    • Kirghiz (kir)
    • Khiamniungan Naga (kix)
    • Gamilaraay (kld)
    • Khalaj (klj)
    • Northern Kurdish (kmr)
    • Komi-Permyak (koi)
    • Konkani (macrolanguage) (kok)
    • Korean (kor)
    • Komi-Zyrian (kpv)
    • Karelian (krl)
    • S'gaw Karen (ksw)
    • Juǀʼhoan (ktz)
    • Kwakiutl (kwk)
    • Brunei (kxd)
    • Ladino (lad)
    • Lao (lao)
    • Latvian (lav)
    • Ligurian (lij)
    • Limburgan (lim)
    • Lithuanian (lit)
    • Liv (liv)
    • Lombard (lmo)
    • Lamboya (lmy)
    • Louisiana Creole (lou)
    • Lashi (lsi)
    • Latgalian (ltg)
    • Luxembourgish (ltz)
    • Lushootseed (lut)
    • Laz (lzz)
    • Marshallese (mah)
    • Maithili (mai)
    • Makasar (mak)
    • Malayalam (mal)
    • Marathi (mar)
    • Moksha (mdf)
    • Morisyen (mfe)
    • Middle Irish (900-1200) (mga)
    • Mi'kmaq (mic)
    • Malagasy (mlg)
    • Maltese (mlt)
    • Manchu (mnc)
    • Mon (mnw)
    • Mongolian (mon)
    • West Makian (mqs)
    • Malay (macrolanguage) (msa)
    • Muong (mtq)
    • Hmong Daw (mww)
    • Burmese (mya)
    • Neapolitan (nap)
    • Navajo (nav)
    • Classical Nahuatl (nci)
    • Low German (nds)
    • Nepali (macrolanguage) (nep)
    • Newari (new)
    • Central Nahuatl (nhn)
    • Gilyak (niv)
    • Dutch (nld)
    • Namuyi (nmy)
    • Norwegian Nynorsk (nno)
    • Norwegian Bokmål (nob)
    • Old Norse (non)
    • Norwegian (nor)
    • Jèrriais (nrf)
    • Nupe-Nupe-Tako (nup)
    • Nyanja (nya)
    • Occitan (post 1500) (oci)
    • Old Frisian (ofs)
    • Middle Korean (10th-16th cent.) (okm)
    • Livvi (olo)
    • Old Russian (orv)
    • Old Spanish (osp)
    • Old Saxon (osx)
    • Ottoman Turkish (1500-1928) (ota)
    • Pangasinan (pag)
    • Pampanga (pam)
    • Panjabi (pan)
    • Bouyei (pcc)
    • Pennsylvania German (pdc)
    • Pitjantjatjara (pjt)
    • Piemontese (pms)
    • Polabian (pox)
    • Pipil (ppl)
    • Malecite-Passamaquoddy (pqm)
    • Pushto (pus)
    • Romagnol (rgn)
    • Romany (rom)
    • Romanian (ron)
    • Macedo-Romanian (rup)
    • Yakut (sah)
    • Sanskrit (san)
    • Dongxiang (sce)
    • Sicilian (scn)
    • Scots (sco)
    • Sassarese Sardinian (sdc)
    • Old Irish (to 900) (sga)
    • Shan (shn)
    • Akkala Sami (sia)
    • Sidamo (sid)
    • Sinhala (sin)
    • Kildin Sami (sjd)
    • Saraiki (skr)
    • Slovak (slk)
    • Salar (slr)
    • Slovenian (slv)
    • Northern Sami (sme)
    • Skolt Sami (sms)
    • Sindhi (snd)
    • Albanian (sqi)
    • Sardinian (srd)
    • Sranan Tongo (srn)
    • Saterfriesisch (stq)
    • Swahili (macrolanguage) (swa)
    • Swedish (swe)
    • Classical Syriac (syc)
    • Sylheti (syl)
    • Silesian (szl)
    • Tamil (tam)
    • Telugu (tel)
    • Ternate (tft)
    • Tajik (tgk)
    • Tagalog (tgl)
    • Thai (tha)
    • Tokelau (tkl)
    • Tonga (Tonga Islands) (ton)
    • Tupí (tpw)
    • Turoyo (tru)
    • Turkmen (tuk)
    • Turkish (tur)
    • Tuvinian (tyv)
    • Central Atlas Tamazight (tzm)
    • Ubykh (uby)
    • Uighur (uig)
    • Ukrainian (ukr)
    • Urdu (urd)
    • Urak Lawoi' (urk)
    • Uzbek (uzb)
    • Vietnamese (vie)
    • Volapük (vol)
    • Votic (vot)
    • Waurá (wau)
    • Waigali (wbk)
    • Wiyot (wiy)
    • Middle Welsh (wlm)
    • Walloon (wln)
    • Kalmyk (xal)
    • Xhosa (xho)
    • South Slavey (xsl)
    • Yamphu (ybi)
    • Lolopo (ycl)
    • Yiddish (yid)
    • Yoruba (yor)
    • Nenets (yrk)
    • Southern Yukaghir (yux)
    • Zhuang (zha)
    • Zou (zom)
    • Zulu (zul)
    • Zaza (zza)
  • Removes the following languages (#590):
    • Guarani (grn), which has been replaced by Paraguayan Guaraní (gug).
    • Tabaru (tby). Updated upstream data no longer makes the 100-item threshold.
  • Updates the following languages (#589):
    • Bulgarian (bul)
    • Catalan (cat)
    • Czech (ces)
    • German (deu)
    • French (fra)
    • Ancient Greek (grc)
    • Hungarian (hun)
    • Italian (ita)
    • Macedonian (mkd)
    • Polish (pol)
  • Updates the following languages (#588):
    • English (eng)
    • Finnish (fin)
    • Portuguese (por)
    • Spanish (spa)
  • Updates Russian (rus). (#586)
  • Adds the following new languages (#585):
    • Achinese (ace)
    • Mesopotamian Arabic (acm)
    • Levantine Arabic (apc)
    • Galibi Carib (car)
    • Fernando Po Creole English (fpe)
    • Arpitan (frp)
    • Middle High German (gmh)
    • Paraguayan Guaraní (gug)
    • Sea Island Creole English (gul)
    • Gawri (gwc)
    • Kurukh (kru)
    • Maquiritari (mch)
    • Maguindanaon (mdh)
    • Maori (mri)
    • Nǁng (ngh)
    • Ojibwa (oji)
    • Iron Ossetic (oss)
    • Sudanese Creole Arabic (pga)
    • Pwo Western Karen (pwo)
    • Ruthenian (rsk)
    • Rusyn (rue)
    • Tachelhit (shi)
    • Senhaja De Srair (sjs)
    • Ulwa (ulw)
    • Venetian (vec)
    • Waray (war)
    • Kurtokha (xkz)
    • Yola (yol)
    • Nhengatu (yrl)
  • Updates the following new languages (#585):
    • Adyghe (ady)
    • Central Bikol (bcl)
    • Kabardian (kbd)
    • Phalura (phl)
  • Adds Chinese varieties (zho). (#584)
  • Sorts languages.json and unmatched_languages.json by keys alphabetically. (#582)
  • Updates Latin (lat). (#581)
  • Implements multi-config scraping, avoiding redundant HTTP requests for the same
    Wiktionary page for all combinations of broad/narrow transcriptions and dialects. (#581)
  • Updates English (eng). (#568)
  • Adds Uzbek (uzb). (#565)
  • Adds custom English extractor to increase the consistency of English r. (#561)
  • Updated English data and made corrections to the pronunciation transcriptions,
    removing ɾ, tʰ, y where needed. (#555)
  • Rescrapes General American and UK Received Pronunciation data. (#555)

Under src/ and elsewhere

  • Optimizes scraping with exponential backoff, session reuse, and API timeout. (#579)
  • Replaces the unmaintained requests_html package with requests and lxml. (#579)
  • Drops Python 3.10 support. (#579)
  • Updates Latin XPath selectors. (#578)
  • Replaces --skip-parens/--no-skip-parens with --parens accepting
    skip, show, or expand. The expand option generates all
    pronunciation variants from parenthesized content and is the new
    default. This is a breaking change for a v2 release. (#577)
  • Drops Python 3.9 support and adds Python 3.14 support. (#576)
  • Drops Python 3.8 support and adds Python 3.13 support. (#562)
  • Updated dialect selector to use contains logic rather than exact match (#557)
  • Updated XPath selectors to use contains for the IPA class to accommodate Wikipedia CSS changes.
  • Updated Received Pronunciation for "Likert" in tests to match current Wiktionary data.