[AQUA][Multi-Model] Improved multi model metadata storage

[lu-ohai]

Improved multi model metadata storage

• Applied create_custom_metadata_artifact to store multi model metadata in model catalog while creating the aqua model.
• Applied get_custom_metadata_artifact to get multi model metadata in model catalog while fetching the aqua deployment.

Unit tests

=============================================== test session starts ===============================================
platform darwin -- Python 3.13.0, pytest-8.3.4, pluggy-1.5.0 -- /usr/local/opt/python@3.13/bin/python3.13
cachedir: .pytest_cache
rootdir: /Users/Downloads/fix_logic/accelerated-data-science
configfile: pytest.ini
plugins: anyio-4.7.0
collected 37 items                                                                                                

tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_create_deployment_for_fine_tuned_model PASSED [  2%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_create_deployment_for_foundation_model PASSED [  5%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_create_deployment_for_gguf_model PASSED [  8%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_create_deployment_for_multi_model PASSED [ 10%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_create_deployment_for_tei_byoc_embedding_model PASSED [ 13%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment PASSED           [ 16%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_config PASSED    [ 18%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_default_params_0_VLLM_PARAMS <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 21%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_default_params_1_VLLM_PARAMS <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 24%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_default_params_2_TGI_PARAMS <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 27%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_default_params_3_CUSTOM_PARAMS <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 29%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_deployment_missing_tags PASSED [ 32%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_multi_model_deployment PASSED [ 35%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_multimodel_compatible_shapes_invalid_config_0_shape <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 37%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_multimodel_compatible_shapes_invalid_config_1_configuration <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 40%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_get_multimodel_deployment_config PASSED [ 43%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_list_deployments PASSED         [ 45%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_0_odsc_vllm_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 48%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_1_odsc_vllm_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 51%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_2_odsc_tgi_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 54%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_3_custom_container_key <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 56%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_4_odsc_vllm_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 59%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_5_odsc_tgi_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 62%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_for_unverified_models_0_odsc_vllm_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 64%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_for_unverified_models_1_odsc_tgi_serving <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 67%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_validate_deployment_params_for_unverified_models_2_ <- ../../../../../usr/local/Cellar/python@3.13/3.13.0_1/Frameworks/Python.framework/Versions/3.13/lib/python3.13/unittest/mock.py PASSED [ 70%]
tests/unitary/with_extras/aqua/test_deployment.py::TestAquaDeployment::test_verify_compatibility PASSED     [ 72%]
tests/unitary/with_extras/aqua/test_deployment.py::TestMDInferenceResponse::test_get_model_deployment_response PASSED [ 75%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_positive[models0-BM.GPU.H100.8-test_a-8] PASSED [ 78%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_positive[models1-BM.GPU.H100.8-test_a-8] PASSED [ 81%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_positive[models2-BM.GPU.H100.8-test_a-8] PASSED [ 83%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[None-BM.GPU.H100.8-test_a-8-Multi-model deployment requires at least one model, but none were provided. Please add one or more models to the model group to proceed.] PASSED [ 86%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[models1-invalid_shape-test_a-8-The model group is not compatible with the selected instance shape 'invalid_shape'. Select a different instance shape.] PASSED [ 89%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[models2-BM.GPU.H100.8-test_a-8-One or more selected models are missing from the configuration, preventing validation for deployment on the given shape.] PASSED [ 91%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[models3-BM.GPU.H100.8-test_a-8-Change the GPU count for one or more models in the model group. Adjust GPU allocations per model or choose a larger instance shape.] PASSED [ 94%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[models4-BM.GPU.A100-v2.8-test_a-8-Select a different instance shape. One or more models in the group are incompatible with the selected instance shape.] PASSED [ 97%]
tests/unitary/with_extras/aqua/test_deployment.py::TestCreateModelDeploymentDetails::test_validate_multimodel_deployment_feasibility_negative[models5-BM.GPU.H100.8-test_a-8-Total requested GPU count exceeds the available GPU capacity for the selected instance shape. Adjust GPU allocations per model or choose a larger instance shape.] PASSED [100%]

=============================================== 37 passed in 13.31s ===============================================

================================================ test session starts ================================================
platform darwin -- Python 3.13.0, pytest-8.3.4, pluggy-1.5.0 -- /usr/local/opt/python@3.13/bin/python3.13
cachedir: .pytest_cache
rootdir: /Users/Downloads/fix_logic/accelerated-data-science
configfile: pytest.ini
plugins: anyio-4.7.0
collected 31 items                                                                                                  

tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_cancel_and_delete_failed_0 PASSED [  3%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_cancel_and_delete_failed_1 PASSED [  6%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_cancel_evaluation PASSED          [  9%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_create_evaluation PASSED          [ 12%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_delete_evaluation PASSED          [ 16%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_download_report PASSED            [ 19%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_extract_job_lifecycle_details_0_Job_run_artifact_execution_failed_with_exit_code_16 PASSED [ 22%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_extract_job_lifecycle_details_1_Job_completed_successfully_ PASSED [ 25%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_0 PASSED                      [ 29%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_1 PASSED                      [ 32%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_fail PASSED                   [ 35%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_service_model_name PASSED     [ 38%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_status PASSED                 [ 41%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_status_failed PASSED          [ 45%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_status_when_missing_jobrun_0_artifact_exist PASSED [ 48%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_status_when_missing_jobrun_1_artifact_missing PASSED [ 51%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_get_supported_metrics PASSED      [ 54%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_list PASSED                       [ 58%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_load_evaluation_config PASSED     [ 61%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_load_metrics PASSED               [ 64%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_load_metrics_fail PASSED          [ 67%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_load_metrics_missing_json PASSED  [ 70%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_validate_model_name_0 PASSED      [ 74%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluation::test_validate_model_name_1 PASSED      [ 77%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluationList::test_error_in_fetch_job PASSED     [ 80%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluationList::test_missing_info_in_custometadata PASSED [ 83%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestAquaEvaluationList::test_skipping_fetch_jobrun PASSED  [ 87%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestCancelDeleteEvaluation::test_cancel PASSED             [ 90%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestCancelDeleteEvaluation::test_cancel_exception PASSED   [ 93%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestCancelDeleteEvaluation::test_delete PASSED             [ 96%]
tests/unitary/with_extras/aqua/test_evaluation.py::TestCancelDeleteEvaluation::test_delete_exception PASSED   [100%]

================================================ 31 passed in 14.02s ================================================

Notebook

[github-actions]

⚠️ This PR changed pyproject.toml file. ⚠️

• PR Creator must update 📃 THIRD_PARTY_LICENSES.txt, if any 📚 library added/removed in pyproject.toml.
• PR Approver must confirm 📃 THIRD_PARTY_LICENSES.txt updated, if any 📚 library added/removed in pyproject.toml.

[lu-ohai]

Closing this PR as there are so many conflicts. New PR: #1112