RuntimeError: Java gateway process exited before sending its port number #14443
Description
Is there an existing issue for this?
- I have searched the existing issues and did not find a match.
Who can help?
@maziyarpana
What are you working on?
Current Behavior
With latest 5.5.1 version unable to start spark session. Seems spark package for v 5.5.1 hasn't published yet.
Expected Behavior
Spark session should be started.
Steps To Reproduce
Run this colab: https://github.com/JohnSnowLabs/spark-nlp/blob/master/examples/python/llama.cpp/PromptAssember_with_AutoGGUFModel.ipynb
Spark NLP version and Apache Spark
SPARKNLP="5.5.1"
PYSPARK="3.2.3"
Type of Spark Application
Python Application
Java Version
No response
Java Home Directory
No response
Setup and installation
No response
Operating System and Version
No response
Link to your project (if available)
No response
Additional Information
error:
RuntimeError Traceback (most recent call last)
in <cell line: 4>()
2
3 # let's start Spark with Spark NLP with GPU enabled. If you don't have GPUs available remove this parameter.
----> 4 spark = sparknlp.start()
5 print(sparknlp.version())
6 frames
/usr/local/lib/python3.10/dist-packages/pyspark/java_gateway.py in launch_gateway(conf, popen_kwargs)
106
107 if not os.path.isfile(conn_info_file):
--> 108 raise RuntimeError("Java gateway process exited before sending its port number")
109
110 with open(conn_info_file, "rb") as info:
RuntimeError: Java gateway process exited before sending its port number
