Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error in _read_tsv when trying to read in the data #48

Closed
jfritsche1 opened this issue May 25, 2021 · 3 comments
Closed

Error in _read_tsv when trying to read in the data #48

jfritsche1 opened this issue May 25, 2021 · 3 comments

Comments

@jfritsche1
Copy link

jfritsche1 commented May 25, 2021

Hey there!
I found that when trying to train the model there was an error, because the _read_tsv's call to open on line 63 in Utils.py didn't have the encoding specified.

To fix it I changed it from:
def _read_tsv(cls, input_file): with open(input_file, "r") as f:
To:
def _read_tsv(cls, input_file): with open(input_file, "r",encoding='utf-8') as f:
Now it works great! Thanks!

@mahmuduzzaman
Copy link

While using a model from path, it is asking for a config.json file. If i use the config file from this project i get the following error:

raise ValueError(

ValueError: Unrecognized model in ../models/en/. Should have a model_type key in its config.json, or contain one of the following strings in its name: speech_to_text, wav2vec2, m2m_100, convbert, led, blenderbot-small, retribert, ibert, mt5, t5, mobilebert, distilbert, albert, bert-generation, camembert, xlm-roberta, pegasus, marian, mbart, mpnet, bart, blenderbot, reformer, longformer, roberta, deberta-v2, deberta, flaubert, fsmt, squeezebert, bert, openai-gpt, gpt2, transfo-xl, xlnet, xlm-prophetnet, prophetnet, xlm, ctrl, electra, encoder-decoder, funnel, lxmert, dpr, layoutlm, rag, tapas
Cuda is available: True
Running train for en

@doguaraci
Copy link
Member

@mahmuduzzaman which version of the transformers library do you have installed?

@sathyarr
Copy link

While using a model from path, it is asking for a config.json file. If i use the config file from this project i get the following error:

raise ValueError(

ValueError: Unrecognized model in ../models/en/. Should have a model_type key in its config.json, or contain one of the following strings in its name: speech_to_text, wav2vec2, m2m_100, convbert, led, blenderbot-small, retribert, ibert, mt5, t5, mobilebert, distilbert, albert, bert-generation, camembert, xlm-roberta, pegasus, marian, mbart, mpnet, bart, blenderbot, reformer, longformer, roberta, deberta-v2, deberta, flaubert, fsmt, squeezebert, bert, openai-gpt, gpt2, transfo-xl, xlnet, xlm-prophetnet, prophetnet, xlm, ctrl, electra, encoder-decoder, funnel, lxmert, dpr, layoutlm, rag, tapas Cuda is available: True Running train for en

what's the resolution for this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants