We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
tokenizer_name is not defined in tokenize. AttributeError Traceback (most recent call last) in () ----> 1 tokenizedX = nlp.tokenize(cleanX.values)
/usr/local/lib/python3.6/dist-packages/GML/NLP.py in tokenize(self, text) 580 Return: Tokenized 581 """ --> 582 tokenizer = AutoTokenizer.from_pretrained(self.tokenizer_name) 583 encoded = tokenizer.batch_encode_plus( 584 text,
AttributeError: 'AutoNLP' object has no attribute 'tokenizer_name'
The text was updated successfully, but these errors were encountered:
Please make sure you called the set_params() function before tokenizing or modeling.
Just like in this notebook: https://github.com/Muhammad4hmed/GML/blob/master/DEMO/AutoTextClassification.ipynb
Sorry, something went wrong.
Closing this issue assuming it's solved. if not, feel free to reopen.
No branches or pull requests
tokenizer_name is not defined in tokenize.
AttributeError Traceback (most recent call last)
in ()
----> 1 tokenizedX = nlp.tokenize(cleanX.values)
/usr/local/lib/python3.6/dist-packages/GML/NLP.py in tokenize(self, text)
580 Return: Tokenized
581 """
--> 582 tokenizer = AutoTokenizer.from_pretrained(self.tokenizer_name)
583 encoded = tokenizer.batch_encode_plus(
584 text,
AttributeError: 'AutoNLP' object has no attribute 'tokenizer_name'
The text was updated successfully, but these errors were encountered: