Use machine learning when searching emojilib

[Jolg42]

Hi!

I think that an offline version would be great! 😃

[sindresorhus]

That would be very cool, but not easy to do, as you would have to gather a lot of data, train a model, for a neural network. Not something I'm going to work on, but happy to receive a pull request if anyone wanna take the challenge.

[Jolg42]

@sindresorhus You're right! Not super easy…!

[sotojuan]

Perhaps some basic caching for repeated entries? Though it'd get memory-heavy.

[matchai]

The Dango website seems to reference an "Offline Predictions SDK".
http://getdango.com/api/#offline-predictions-sdk

[Richienb]

We could alternatively use https://github.com/bfelbo/DeepMoji

[Richienb]

@sindresorhus I'm much more concerned about distribution. That is, the pre-trained model is probably going to be a bit to large for npm (many megabytes at least, probably).
Perhaps we could upload them to GitHub releases?

[sindresorhus]

I think a better solution is to let users opt into using the ChatGPT API by providing their own OpenAI API key. It will return much better results than whatever we can do here.

Example prompt:

Give me the 10 most relevant emojis for this text as a newline list: hungry

[Richienb]

Oh I see. Tragically though, the ChatGPT API has no free plan. Is this a problem?
Locally running a large language model remains on the table, but not if for space concerns. Also am thinking about: using predictions from the large language model as the dataset for training a smaller one.

[sindresorhus]

Tragically though, the ChatGPT API has no free plan. Is this a problem?

No. It would be opt-in anyway. The paid plan is not expensive. It would be almost nothing to simply fetch emojis.

Locally running a large language model remains on the table, but not if for space concerns. Also am thinking about: using predictions from the large language model as the dataset for training a smaller one.

I don't see it being worth the effort.

[Richienb]

note to self: https://github.com/microsoft/guidance https://github.com/microsoft/guidance/blob/main/notebooks/chat.ipynb