Skip to content

Nannan-Liu/Multidimensional-Analysis-Tagger-of-Mandarin-Chinese

Repository files navigation

Multidimensional-Analysis-Tagger-of-Mandarin-Chinese

MulDi Chinese (IPA: [ˌmʌl'daɪ] [ˌtʃaɪˈniːz]) is a multidimensional analysis tagger of Mandarin Chinese.

  • Installation: pip install muldichinese

About

Check the names of your input files, segment and pos tag the texts, and get the distribution of linguistic features and dimension scores of register variation
from muldichinese.MulDiChinese import MulDiChinese
mdc=MulDiChinese('/write/path/to/your/file(s)/')
mdc.files()
#print a list of your input files
mdc.tag()
#Segmentation and pos tagging completed.
mdc.features()
#Standardised frequencies of all 60 features written.
mdc.dimensions()
#Dimension scores written.

Reference the tagger

Liu, N. (2021). Multidimensional Analysis Tagger of Mandarin Chinese (Version 0.3.2). doi: 10.5281/zenodo.5220449.

This programme is based on the ICTCLAS, and it is advised to reference ICTCLAS when MulDi Chinese is used. Please refer to https://dl.acm.org/citation.cfm?id=1119280.

Requirements

Python packages needed are:

  1. PyNLPIR
  2. NLTK
  3. Pandas
  4. scikit learn
  5. NumPy

See MulDi Chinese manual.pdf for more details

The manual contains a detailed description of the 60 features.