New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FYI: Rust Implementation Available #16

Open

mush42 opened this issue Jul 16, 2024 · 1 comment

mush42 commented Jul 16, 2024

Hello

FYI: I ported the code to Rust,. Rust implementation passes all the tests the current implementation passes.

https://github.com/mush42/tqsm

This unlocks a lot of speedups and use cases:

Moderate speedup (since REGEX engine is the bottleneck anyways)
True parallelism
The ability to compile to WASM and use from JavaScript
The ability to create a statically-linked command line wrapper

Currently, I have the following available in the repo:

Core implementation
Command line wrapper
Python bindings

Best
Musharraf

Member

santhoshtr commented Jul 17, 2024

Thanks a lot for this initiative. ❤️

FYI, The js port is available at https://github.com/wikimedia/sentencex-js - (I should update the docs with link to this)

What is the meaning of tqsm ? is it based on the naming of tqdm? :)

As per the performance table, it shows the same number for sentencex and tqsm - Is it so or table yet to be updated?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment