-
Notifications
You must be signed in to change notification settings - Fork 62
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
custom model upload + some documenation. #10
Conversation
Signed-off-by: Dhrubo Saha <dhrubo@amazon.com>
Class for uploading model using ml-commons apis in opensearch cluster. | ||
""" | ||
|
||
META_API_ENDPOINT = "models/meta" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Suggest also generate model file sha256 hash value and save in model meta doc. When ml-commons load model, it will use the hash value to verify model chunks. If can't match, will stop and throw error.
opensearch_py_ml/ml_commons_integration/upload/ml_common_upload_model.py
Outdated
Show resolved
Hide resolved
Signed-off-by: Dhrubo Saha <dhrubo@amazon.com>
Signed-off-by: Dhrubo Saha <dhrubo@amazon.com>
opensearch_py_ml/ml_commons_integration/upload/ml_common_model_uploader.py
Outdated
Show resolved
Hide resolved
Signed-off-by: Dhrubo Saha <dhrubo@amazon.com>
Signed-off-by: Dhrubo Saha <dhrubo@amazon.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thanks for the change!
Signed-off-by: Dhrubo Saha dhrubo@amazon.com
Description
Through this commit customers of Opensearch will be able to upload custom model to opensearch index using mlcommons upload api.
Issues Resolved
List any issues this PR will resolve, e.g. Closes [...].
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.