Skip to content

Sentence splitter based on Google Natural Language API for tokenization

Notifications You must be signed in to change notification settings

alainrk/sentence-splitter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Sentence splitter

js-standard-style

Best-effort sentence splitter, based on Google Text Analysis API and verb-conjuction utterance aggregation.

Configure

  • GCP Console => Activate Natural Language API => Create Service Account => Create JSON key
  • Put the key.json into config/

Run

npm start "I am hungry but I am also tired and I want to skate"
>> [ 'I am hungry', 'but I am also tired', 'and I want to skate' ]

Print tokenization info

DEBUG=true npm start "I am hungry but I am also tired and I want to skate"

Official Doc

Google Text Analysis

About

Sentence splitter based on Google Natural Language API for tokenization

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published