Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Onnx models fail when saving transformer #14194

Closed
1 task done
mehmetbutgul opened this issue Mar 4, 2024 · 0 comments · Fixed by #14199 or #14227
Closed
1 task done

Onnx models fail when saving transformer #14194

mehmetbutgul opened this issue Mar 4, 2024 · 0 comments · Fixed by #14199 or #14227
Assignees
Labels

Comments

@mehmetbutgul
Copy link
Contributor

mehmetbutgul commented Mar 4, 2024

Is there an existing issue for this?

  • I have searched the existing issues and did not find a match.

Who can help?

@maziyarpanahi

What are you working on?

I am working on the Colab and local.
I want to save a transformer that pretrained the Onnx model. But, I have faced an error.
When I investigate the error, I have noticed that the main problem is serializing a onnx model -->

Current Behavior

Error while saving the transformer,
This error applies to most ONNX based annotators

Expected Behavior

writing the transformer stage to file

Steps To Reproduce

DeBertaEmbeddings.pretrained("deberta_embeddings_erlangshen_v2_chinese_sentencepiece","zh") \
     .write().overwrite().save("models/deberta_model")

Colab notebook: https://colab.research.google.com/drive/119u6hXoT1PRB9F38InuEV-bm4g1uu9UH?usp=sharing

Spark NLP version and Apache Spark

spark-nlp==5.3.1
pyspark

Type of Spark Application

No response

Java Version

No response

Java Home Directory

No response

Setup and installation

No response

Operating System and Version

No response

Link to your project (if available)

No response

Additional Information

No response

@maziyarpanahi maziyarpanahi linked a pull request Mar 11, 2024 that will close this issue
10 tasks
@maziyarpanahi maziyarpanahi linked a pull request Apr 5, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
2 participants