Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add parameter for punctuation used by Latin punkt sentence tokenizer #944

Merged
merged 8 commits into from Oct 7, 2019
Merged

Add parameter for punctuation used by Latin punkt sentence tokenizer #944

merged 8 commits into from Oct 7, 2019

Commits on Oct 6, 2019

  1. Update Latin punc params

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    5b5c5aa View commit details
    Browse the repository at this point in the history

  2. Add strict punctuation to sentence tokenizer

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    61573ed View commit details
    Browse the repository at this point in the history

  3. Clean up module

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    d599593 View commit details
    Browse the repository at this point in the history

  4. Fix & clean up test

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    e5327b2 View commit details
    Browse the repository at this point in the history

  5. Update tests

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    d39ce03 View commit details
    Browse the repository at this point in the history

  6. Remove main function

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    2a832c3 View commit details
    Browse the repository at this point in the history

  7. Update docs

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    9ddc24b View commit details
    Browse the repository at this point in the history

  8. Add strict to generic sentence tokenizer

    @diyclassics
    diyclassics committed Oct 6, 2019
    Copy the full SHA
    b934a02 View commit details
    Browse the repository at this point in the history