Ruby Splitta

• README: https://github.com/david-mccullars/ruby-splitta
• Documentation: http://www.rubydoc.info/github/david-mccullars/ruby-splitta
• Bug Reports: https://github.com/david-mccullars/ruby-splitta/issues

Status

Description

Splitta Includes proper tokenization and models for very high accuracy sentence boundary detection (English only for now). The models are trained from Wall Street Journal news combined with the Brown Corpus which is intended to be widely representative of written English. Error rates on test news data are near 0.25%.

Installation

gem install splitta

Requirements

• Ruby 2.5.1 or higher

Usage

require 'splitta'

Splitta.sentences("Some text goes here.")

License

MIT. See the LICENSE file.

References

Dan Gillick, “Sentence Boundary Detection and the Problem with the U.S.” at NAACL 2009, http://dgillick.com/resource/sbd_naacl_2009.pdf