Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide node-nlp via https://deno.land --> deno-nlp #510

Closed
michael-spengler opened this issue Jul 23, 2020 · 6 comments
Closed

Provide node-nlp via https://deno.land --> deno-nlp #510

michael-spengler opened this issue Jul 23, 2020 · 6 comments

Comments

@michael-spengler
Copy link

Is your feature request related to a problem? Please describe.
A rapidly growing number of developers uses https://deno.land - I would love if node-nlp was there as a third party module.
I created several third party modules for deno but I'm not as much inside node-nlp that I could do this on my own.

Describe the solution you'd like
Adding a third party module is in general simple - see https://deno.land/x

Describe alternatives you've considered
I could stick with NodeJS but I want to build services that will be also up and running and evolving in 10 years.

Additional context
Currently there seems to be no NLP Third Party module at all in https://deno.land. So it would be cool if node-nlp gets to be the first one. I say this because I'm a fan of the node-nlp features.

@michael-spengler
Copy link
Author

I created the following frame in the meantime: https://deno.land/x/nlp

Feel free to create pull requests on the corresponding repository if you would like to develop it towards a purely deno based solution (without the need for an API call).

For my personal use case this already serves as a valid workaround as it makes sure I can use the node-nlp features in a deno runtime environment / program.

@jesus-seijas-sp
Copy link
Contributor

Hello,
I did my first test with deno converting the NeuralNetwork (fast way... not really typed):
https://github.com/jesus-seijas-sp/neural-network-deno

This demo try the neural-network at really low level to classify a corpus, but using only tokenizer and not stem, so the precision is not only 79% in the corpus, but we can compare with other NLPs training and testing exactly with the same corpus (included in the demo):

image

As we can see it have better precision than the other NLPs that use only tokenizing, but is worst that those that use stemmers.

Also in console we will see the results of the performance:

image

Is able to run about 105.000 utterances per second, that's basically the same obtained with the same code in javascript in Node.js.

The problem or moving to deno is to convert the stemmers of all the languages... it's a lot of work.

@michael-spengler
Copy link
Author

michael-spengler commented Jul 27, 2020

@jesus-seijas-sp thank you very much for starting this.

I just invited you as a collaborator for the repo: https://github.com/michael-spengler/nlp which represents https://deno.land/x/nlp.

Feel free to update things there if you think it's the appropriate place.

If you would like to create a separate deno module it's of course also fine from my perspective.

@ravimashru
Copy link

@jesus-seijas-sp The move to deno looks promising... Would it be possible to show me how to convert the stemmer of any one language to a deno-friendly format? I have a bunch of highly motivated colleagues that can help push this over the finish line after that. 😉

@michael-spengler
Copy link
Author

michael-spengler commented Sep 4, 2020

Here a general tool which might be helpful for Deno Enablement: https://www.skypack.dev/

https://docs.skypack.dev/code/deno

@aigloss
Copy link
Contributor

aigloss commented Nov 24, 2022

Closing due to inactivity

@aigloss aigloss closed this as completed Nov 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants