Skip to content

tokenizers-clj 0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@jsavyasachi jsavyasachi released this 23 Jun 05:25
· 1 commit to main since this release
0.1.0
acc7b9d

Initial release. Idiomatic Clojure wrapper over DJL's HuggingFace tokenizers (native Rust tokenizers via JNI): encode/decode/count-tokens/batch-encode returning Clojure maps.

Install: [net.clojars.savya/tokenizers-clj "0.1.0"]

https://clojars.org/net.clojars.savya/tokenizers-clj

Assets 2
Loading