-
Notifications
You must be signed in to change notification settings - Fork 703
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No Operation named [init_all_tables] in the Graph when using GPT2Transformer #14110
Comments
Hi, I have the exact same issue. My environment:Databricks runtime version 14.0 ML (includes Apache Spark 3.5.0, Scala 2.12) |
I tried to reproduce it, but there isn't an issue with my side. Can you perhaps detail your steps to recreate this issue? Additionally, can you perhaps try just to update Spark NLP to the latest version and see if there is any difference? I tried these following combinations of settings:
But in all of them, I get the results without any problems. Thanks for reporting! |
Hi @DevinTDHa, Thanks for your reply. I just tried to run the first task ( I had updated both, pypi spark-nlp and the maven library. This is my current environment:
However, I still get the same error: I attach my notebook GPT2Transformer_ OpenAI Text-To-Text Transformer.zip to reproduce the error. |
Hi @mdrobena, Thanks for the thorough description! I was able to reproduce it with your instructions. Important is also that it needs to be run on a muli-node setup. I am looking into this problem. |
Is there an existing issue for this?
What are you working on?
I followed 14.0.GPT2_Transformer_In_SparkNLP.ipynb. However it threw
Current Behavior
Expected Behavior
should print the content of
generation.result
just like the example output of 14.0.GPT2_Transformer_In_SparkNLP.ipynbSteps To Reproduce
run 14.0.GPT2_Transformer_In_SparkNLP.ipynb with following Spark config
Spark NLP version and Apache Spark
Spark NLP: 5.2.0
Spark: 3.3.0
pyspark: 3.3.1
Type of Spark Application
spark-shell
Java Version
openjdk version "1.8.0_392"
Java Home Directory
/usr/lib/jvm/java-1.8.0-openjdk-amd64
Setup and installation
pip install spark-nlp==5.2.0
Operating System and Version
Ubuntu 20.04
Link to your project (if available)
No response
Additional Information
spark-nlp-assembly-5.2.0.jar is put under SPARK_HOME/jars
The text was updated successfully, but these errors were encountered: