Skip to content

Commit

Permalink
fix #9 - quiet nltk.download
Browse files Browse the repository at this point in the history
  • Loading branch information
windj007 authored and rsuvorov committed May 3, 2018
1 parent a7e586f commit 45e59fb
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions vecto/corpus/tokenization.py
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@

from vecto.utils.metadata import WithMetaData, get_full_typename

nltk.download('punkt')
nltk.download('stopwords')
nltk.download('punkt', quiet=True)
nltk.download('stopwords', quiet=True)

_DEFAULT_WORD_SPLITTER = nltk.tokenize.WordPunctTokenizer().tokenize
_WHITESPACE_TOKEN_SPLITTER = re.compile(r'[^\s]+').findall
Expand Down

0 comments on commit 45e59fb

Please sign in to comment.