Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove the Tokio dependency #164

Merged
merged 5 commits into from
Mar 22, 2022

Conversation

Kerollmops
Copy link
Contributor

This PR removes the dependency to tokio, reqwest, h2 and hyper in the build script and replaces them by ureq which is way simpler and is largely sufficient to download one file at compile time.

Doing this shrinks down the total number of dependencies from 172 to 117 and reduces the compilation time of lindera-ipadic from 1m 24s to 1m 17s on my Macbook Pro m1.

This PR also marked the HTTP client and compression libraries as optional for when they will not be used by the build script. This shrinks down the compilation time from 12.76s to 10.23s when the feature e.g. ipadic is not set. And that is only for one sub-crate, I have done that on all of them.

@CLAassistant
Copy link

CLAassistant commented Mar 22, 2022

CLA assistant check
All committers have signed the CLA.

bors bot added a commit to meilisearch/milli that referenced this pull request Mar 22, 2022
476: Rollback meilisearch-tokenizer version r=Kerollmops a=irevoire

Lindera often fails to download some data from google drive we can’t compile consistently meilisearch / milli.
We can’t bump to the latest version (that moved out of google drive) either because lindera uses reqwest with openssl with no way of configuring it our benchmarks were not able to run. The latter issue should be fixed by lindera-morphology/lindera#164.

Co-authored-by: Irevoire <tamo@meilisearch.com>
@mosuka mosuka self-requested a review March 22, 2022 14:14
@mosuka mosuka merged commit 28182e3 into lindera-morphology:main Mar 22, 2022
@mosuka
Copy link
Member

mosuka commented Mar 22, 2022

@Kerollmops
Thank you for your contribution! 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants