Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SentenceTokenizer doesn't split by three dots symbol #648

Closed
satyrius opened this issue May 3, 2022 · 1 comment
Closed

SentenceTokenizer doesn't split by three dots symbol #648

satyrius opened this issue May 3, 2022 · 1 comment

Comments

@satyrius
Copy link

satyrius commented May 3, 2022

SentenceTokenizer doesn't split by this symbol . Here is the example of the content.

const { SentenceTokenizerNew } = require('natural')
const content = `We’re heading for a catastrophic global temperature rise… Fires are blazing from the Amazon to the Arctic`
const tokenizer = new SentenceTokenizer()
tokenizer.tokenize(content) // returns one sentence, while two is expected
@Hugo-ter-Doest
Copy link
Collaborator

Solved in #687

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants