This repository is primarily a modified version based on the following repositories:
We would like to express our gratitude to the authors of these repositories for their contributions.
This repository contains the following components:
- Tokenizer: A module responsible for handling text tokenization.
- Proxy: A component that serves as a proxy for network requests.