GitHub - dakrone/corpus: a tool used to train a detokenization library

dakrone / corpus Public

Notifications You must be signed in to change notification settings
Fork 3
Star 2

a tool used to train a detokenization library

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
data		data
models		models
src/corpus		src/corpus
test/corpus/test		test/corpus/test
.gitignore		.gitignore
README		README
project.clj		project.clj

Repository files navigation

# corpus

A tool used to train detokenization libraries

## Usage

(use 'corpus.core)
(def w (corpus-file "data/alice-in-wonderland.txt"))
(count w)

## License

Copyright (C) 2010 Lee Hinman

Distributed under the Eclipse Public License, the same as Clojure.