Create your own GitHub profile
Sign up for your own profile on GitHub, the best place to host code, manage projects, and build software alongside 40 million developers.
Sign up
-
Hugging Face
- New York
- Sign in to view email
- https://twitter.com/moi_anthony
Pinned
1,317 contributions in the last year
Contribution activity
January 2020
- n1t0/tokio Rust
- n1t0/pyo3 Rust
Created a pull request in huggingface/tokenizers that received 2 comments
Improve truncation
Applying truncation on an Encoding will now produce an output Encoding and populate its overflowing property with as many other Encoding as needed …
+216
−86
•
2
comments
- node: add tests + linting
- Github action for node release
- Fix a few python stuff
- Added SentencePiece and YouTokenToMe model extractors.
- alternate builder pattern
- update models API and documentation
- small wording changes
- Update benchmarks
- make cache optional
- avoid unnecessary write locks in the BPE cache
- set capacity on BPE cache, change Mutex to RwLock, create BpeBuilder
- Add benchmark framework and benches for BPE (GPT2)
Created an issue in huggingface/tokenizers that received 1 comment
4
contributions
in private repositories
Jan 1 – Jan 3