A Python wrapper around the NLPIR/ICTCLAS Chinese segmentation software.
Clone or download
tsroten Merge pull request #88 from tsroten/user_pos_tags
Add user part of speech tags.
Latest commit 8d5e994 Aug 17, 2017

README.rst

PyNLPIR

Build Status Latest Version

PyNLPIR is a Python wrapper around the NLPIR/ICTCLAS Chinese segmentation software.

About

Easily segment text using NLPIR, one of the most widely-regarded Chinese text analyzers:

import pynlpir
pynlpir.open()

s = '欢迎科研人员、技术工程师、企事业单位与个人参与NLPIR平台的建设工作。'
pynlpir.segment(s)

[('欢迎', 'verb'), ('科研', 'noun'), ('人员', 'noun'), ('', 'punctuation mark'), ('技术', 'noun'), ('工程师', 'noun'), ('', 'punctuation mark'), ('企事业', 'noun'), ('单位', 'noun'), ('', 'conjunction'), ('个人', 'noun'), ('参与', 'verb'), ('NLPIR', 'noun'), ('平台', 'noun'), ('', 'particle'), ('建设', 'verb'), ('工作', 'verb'), ('', 'punctuation mark')]

Features

  • Helper functions for common use cases
  • English/Chinese part of speech mapping
  • Support for UTF-8, GBK, and BIG5 encoded strings (and unicode of course!)
  • Access to NLPIR's C functions via ctypes
  • Includes a copy of NLPIR
  • Runs on Python 2.7 and 3
  • Supports macOS, Linux, and Windows

Getting Started