how to use FastTextWikipedia300D

[WEMAPP]

Hi if I wanted to use a pre-trained file, for example Wiki word vectors by fasttext is it possible? and how?

[mstfbl]

Hi @WEMAPP ,

Thank you for your question. It is indeed possible to use pre-trained models for word-embedding tasks. Please take a look here:
https://docs.microsoft.com/en-us/dotnet/api/microsoft.ml.transforms.text.wordembeddingestimator.pretrainedmodelkind?view=ml-dotnet

To use FastTextWikipedia300D, you would do: WordEmbeddingEstimator.PretrainedModelKind.FastTextWikipedia300D.

[WEMAPP]

thanks for the reply, i can't understand how to specify the language.
I also have another problem. if I use
[...]
.Append(mlContext.Transforms.Text.TokenizeIntoWords("TokenizedMessage", "NormalizedMessage"))
.Append(mlContext.Transforms.Text.ApplyWordEmbedding("Embeddings", "TokenizedMessage",WordEmbeddingEstimator.PretrainedModelKind.FastTextWikipedia300D))
I get this error

AggregateException: One or more errors occurred. (The response ended prematurely, with at least 5446786349 additional bytes expected.)
IOException: The response ended prematurely, with at least 5446786349 additional bytes expected.

thank you