diff --git a/sdk/ml/azure-ai-ml/CHANGELOG.md b/sdk/ml/azure-ai-ml/CHANGELOG.md index fc5254361744..31e3c939f2da 100644 --- a/sdk/ml/azure-ai-ml/CHANGELOG.md +++ b/sdk/ml/azure-ai-ml/CHANGELOG.md @@ -6,30 +6,42 @@ ### Bugs Fixed + +## 1.21.1 (2024-10-21) + + +### Bugs Fixed + +- **#37857** - Fix online deployment registry issue + + ## 1.21.0 (2024-09-30) ### Features Added - - Cross subscription storage account support for workspace and feature store. Developer can provide a storage account from another subscription while creating a workspace or storage account. + +- Cross subscription storage account support for workspace and feature store. Developer can provide a storage account from another subscription while creating a workspace or storage account. ### Bugs Fixed - - #35820 - using compute location attribute to fill compute location to align the experience with UI. - +- #35820 - using compute location attribute to fill compute location to align the experience with UI. + ## 1.20.0 (2024-09-10) ### Features Added - - When a workspace is created with `managed_network` enabled or has `public_network_access` set to disabled, the resources created with the workspace (Key Vault, Storage Account) will be set to have restricted network access settings. This is only applicable when the user does not specify existing resources. - - Added support of `fqdns` property for managed network `PrivateEndpointDestination` outbound rule objects. Enabling the support of Application Gateway as a Private Endpoint target in the workspace managed network. - - Added support of `address_prefixes` property for managed network `ServiceTagDestination` outbound rule objects. - - Removed experimental tag from `managed_network` which is a GA feature. + +- When a workspace is created with `managed_network` enabled or has `public_network_access` set to disabled, the resources created with the workspace (Key Vault, Storage Account) will be set to have restricted network access settings. This is only applicable when the user does not specify existing resources. +- Added support of `fqdns` property for managed network `PrivateEndpointDestination` outbound rule objects. Enabling the support of Application Gateway as a Private Endpoint target in the workspace managed network. +- Added support of `address_prefixes` property for managed network `ServiceTagDestination` outbound rule objects. +- Removed experimental tag from `managed_network` which is a GA feature. ## 1.19.0 (2024-07-29) ### Feature Added - - Added enable_sso operation under compute operation that will allow user to enable sso setting of a compute instance without any write permission set on compute. - +- Added enable_sso operation under compute operation that will allow user to enable sso setting of a compute instance without any write permission set on compute. + ### Bugs Fixed + - Workspace update no longer broken for older workspaces due to deprecated tags. - Support credential-less fileshare datastore @@ -37,23 +49,25 @@ ### Features Added - - Expose `public_ip_address` in `AmlComputeNodeInfo`, to get the public ip address with the ssh port when calling `ml_client.compute.list_nodes` - - Uploads to account key access datastores will be authorized via a SAS token retrieved from a call to `DatastoreOperations._list_secrets`. Key-based authentication for uploads for such datastores is no longer used. Identity-based datastores will use user identity authentication retrieved from the MLClient. +- Expose `public_ip_address` in `AmlComputeNodeInfo`, to get the public ip address with the ssh port when calling `ml_client.compute.list_nodes` +- Uploads to account key access datastores will be authorized via a SAS token retrieved from a call to `DatastoreOperations._list_secrets`. Key-based authentication for uploads for such datastores is no longer used. Identity-based datastores will use user identity authentication retrieved from the MLClient. - Support `update_sso_settings` in `ComputeOperations`, to enable or disable single sign-on settings of a compute instance. ### Bugs Fixed + - InputTypes exported in constants module - WorkspaceConnection tags are now listed as deprecated, and the erroneously-deprecated metadata field has been un-deprecated and added as a initialization field. These two fields still point to the same underlying object property, and actual API usage of this value is unchanged. - Workspace Create operation works without an application insights being provided, and creates a default appIn resource for normal workspaces in that case. - Project create operations works in general. - ### Other Changes + - WorkspaceConnections are officially GA'd and no longer experimental. But its much newer subclasses remain experimental. ## 1.17.1 (2024-07-04) ### Bugs Fixed + - Workspace Create operation works without an application insights being provided, and creates a default appIn resource for normal workspaces in that case. - Project create operations works in general. @@ -62,6 +76,7 @@ ## 1.16.0 (2024-05-14) ### Features Added + - Add experimental support for working with Promptflow evaluators: `ml_client.evaluators`. - Many changes to the Connection entity class and its associated operations. - Workspace Connection `list`, `get`, and `create_or_update` operations now include an optional `populate_secrets` input, which causes the operations to try making a secondary call to fill in the returned connections' credential info if possible. Only works with api key-based credentials for now. @@ -121,6 +136,7 @@ ## 1.14.0 (2024-03-11) ### Features Added + - Remove `experimental` tag for `ml_client.jobs.validate`. - Workspace Connection has new read-only subclass: AzureBlobStoreWorkspaceConnectionSchema. - Workspace Connection supports 2 new types under main class: gen 2 and azure_one_lake. @@ -128,6 +144,7 @@ - Support `ml_client.schedules.trigger(name='my_schedule')` function to trigger a schedule once. ### Bugs Fixed + - Fix pipeline job `outputs` not load correctly when `component: ` exists in pipeline job yaml. - Workspace ListKey operation serialization issue fixed. - Workspace Diagnose result now can be print in to Json format. @@ -151,11 +168,12 @@ ## 1.12.0 (2023-11-13) ### Features Added + - Workspace Connections had 3 child classes added for open AI, cog search, and cog service connections. - Workspace Connections replaced metadata with tags, and surfaced api_version, api_type, and kind for certain connection types. - ### Bugs Fixed + - Workspace Hubs now properly create various endpoints, and surface a variable to select the resource they connect to via the 'endpoint_resource_id' kwarg. @@ -166,34 +184,40 @@ ## 1.11.1 (2023-10-13) ### Bugs Fixed - - pydash dependency version was upgraded to >=6.0.0 to patch [security vulnerability in versions below 6.0.0](https://github.com/advisories/GHSA-8mjr-6c96-39w8) - - Workspace hub deletion no longer fails if delete_dependent_resources is true. + +- pydash dependency version was upgraded to >=6.0.0 to patch [security vulnerability in versions below 6.0.0](https://github.com/advisories/GHSA-8mjr-6c96-39w8) +- Workspace hub deletion no longer fails if delete_dependent_resources is true. ## 1.11.0 (2023-10-04) ### Features Added + - Now, when you specify `delete_dependent_resources` as True when deleting a workspace, the log analytics resource associated with the workspace application insights resource will also be deleted. - Now, when creating or updating a workspace, you can provide a `serverless_compute` configuration object. This allows configuring a custom subnet in which all Serverless computes will be created. You can also specify whether or not these Serverless computes will have public IP addresses or not. ### Breaking Changes - - [Python 3.7 reached end-of-life on June 27th 2023](https://devguide.python.org/versions/). Consequently, 3.7 will be deprecated in azure-ai-ml starting in October 2023 and azure-ai-ml will end support for 3.7 in February 2024. + +- [Python 3.7 reached end-of-life on June 27th 2023](https://devguide.python.org/versions/). Consequently, 3.7 will be deprecated in azure-ai-ml starting in October 2023 and azure-ai-ml will end support for 3.7 in February 2024. ## 1.10.1 (2023-09-17) ### Bugs Fixed + - Feature sets can now be registers after being dumped and reloaded. - SDK feature store create/update can now assign materialization identities to cross RG offline stores and online stores. ## 1.10.0 (2023-09-07) ### Features Added + - Added support of features that are known into the future/at forecast time for dnn in AutoML Forecasting jobs. - Added support for new workspace connection types: azure_open_ai, cognitive_search, and cognitive_service. - Added support for new credential type: ApiKeyConfiguration. - Added support of `download` for component operations. ### Bugs Fixed + - Local job runs will no longer fail if Docker registry has no username/password - Fixed an issue that code asset doesn't work with relative symbol links. - Fixed [Issue 31319](https://github.com/Azure/azure-sdk-for-python/issues/31319): can't accept `PathLike` for `CommandComponent.code`. @@ -207,15 +231,18 @@ ## 1.9.0 (2023-07-25) ### Features Added + - Added support to enable gpu access (local_enable_gpu) for local deployment. ### Other Changes - Improved the output when printing a workspace object to be more clean and readable. - Log level of unknown field notifications for pipeline nodes raised from INFO to WARNING. + ## 1.8.0 (2023-06-12) ### Features Added + - Added support to enable set workspace connection secret expiry time. - Added support for `stage` on model version @@ -227,18 +254,19 @@ ## 1.7.2 (2023-05-18) ### Features Added -- Public preview support for new schedule type `MonitorSchedule` +- Public preview support for new schedule type `MonitorSchedule` ## 1.7.1 (2023-05-17) ### Bugs Fixed -- Fixed an issue where `OnlineDeployment.provisioning_state` was incorrectly deserialized and set as `None` +- Fixed an issue where `OnlineDeployment.provisioning_state` was incorrectly deserialized and set as `None` ## 1.7.0 (2023-05-15) ### Features Added + - Added data import schedule. The class added is `ImportDataSchedule`. - Added support to enable data isolation feature at workspace creation stage. - Added auto_delete_setting support for asset version in data import job. @@ -250,10 +278,10 @@ ### Other Changes - ## 1.6.0 (2023-05-01) ### Features Added + - Added experimental scatter gather node to DSL package. This node has a unique mldesigner dependency. - Added support to make JobService and ServiceInstance objects serializable when printed - Support Singularity compute in pipeline job @@ -281,6 +309,7 @@ ## 1.5.0 (2023-03-20) ### Features Added + - Added support for `tags` on Compute Resources. - Added support for promoting data asset from a workspace to a registry - Added support for registering named asset from job output or node output by specifying name and version settings. @@ -315,12 +344,14 @@ ## 1.4.0 (2023-02-07) ### Features Added + - Added dedicated classes for each type of job service and updated the docstrings. The classes added are `JupyterLabJobService, SshJobService, TensorBoardJobService, VsCodeJobService` with a few properties specific to the type. - Added Custom Applications Support to Compute Instances. - Update data asset list, show and create operations to support data assets in registry. - Added Managed Network features to workspace to include `ManagedNetwork`, `FqdnDestination`, `PrivateEndpointDestination`, `ServiceTagDestination` as well as relevant schema. ### Bugs Fixed + - Fixed an issue where the ordering of `.amlignore` and `.gitignore` files are not respected. - Fixed an issue that attributes with a value of `False` in `PipelineJobSettings` are not respected. - Fixed an issue where ignore files weren't considered during upload directory size calculations. @@ -328,17 +359,20 @@ - Fixes a bug where enable_node_public_ip returned an improper value when fetching a Compute. ### Other Changes + - Update workspace creation to use Log Analytics-Based Application Insights when the user does not specify/bring their own App Insights. - Upgraded minimum azure-core version to 1.23.0. ## 1.3.0 (2023-01-13) ### Features Added + - Change print behavior of entity classes to show object yaml in notebooks, can be configured on in other contexts. - Added property to enable/disable public ip addresses to Compute Instances and AML Computes. - `Deployment` and `ScheduleOperations` added to public interface. ### Bugs Fixed + - Fixed issue with date-time format for utc_time_created field when creating models. - Added stricter behavior for ArmStr schemas when parsing 'azureml:' prefix. - Fixed issue where AmlComputes could only be created in a workspace's default region. @@ -351,15 +385,18 @@ - Fixed issue where `SasTokenConfiguration` cannot be used as credential for `WorkspaceConnection` ### Other Changes + - Removed dependency on API version 2021-10-01 and 2022-06-01-preview to reduce side of azure-ai-ml package. ## 1.2.0 (2022-12-05) ### Breaking Changes + - Removed description from Registry. - Disable sdk telemetry logging ### Features Added + - Enable updating the CMK encryption key (workspace.encryption.keyVaultProperties.keyIdentifier) for a workspace. - Mark JobService class and services param to command() as experimental. - Added a replication_count value to the schema of SystemCreatedStorageAccount in Registry. @@ -368,6 +405,7 @@ - Added OS Patching Parameters to Compute Instance. ### Bugs Fixed + - Update the upper bound dependencies version for tqdm, strictyaml, colorama and opencensus-ext-azure. - Added missing "properties" to batch deployment. - Retain the cases for the names of system job services (Tracking and Studio). @@ -380,24 +418,29 @@ ## 1.1.2 (2022-11-21) ### Features Added + - Restored idle_time_before_shutdown property for Compute Instances. - Deprecated idle_time_before_shutdown property in favor of idle_time_before_shutdown_minutes. ### Bugs Fixed + - Fixed idle_time_before_shutdown appearing as None for Compute Instances returned by `show` or `list`. - Fixed idle_time_before_shutdown_minutes preventing creation of Compute Instances when set to None. ## 1.1.1 (2022-11-15) ### Breaking Changes + - Renamed idle_time_before_shutdown to idle_time_before_shutdown_minutes and changed input type to int. ### Bugs Fixed + - Fixed idle_time_before_shutdown_minutes not appearing in GET calls for Compute Instances. ## 1.1.0 (2022-11-07) ### Features Added + - Registry list operation now accepts scope value to allow subscription-only based requests. - Most configuration classes from the entity package now implement the standard mapping protocol. - Add registry delete operation. @@ -405,6 +448,7 @@ - Command function now accepts services param of type Dict[str, JobService] instead of dict. ### Bugs Fixed + - MLClient.from_config can now find the default config.json on Compute Instance when running sample notebooks. - Fixed job inputs not accepting datastores or job inputs. - Registries now assign managed tags to match registry's tags. @@ -415,79 +459,88 @@ - Fix ARM ID logic for passing models and environments with ID (ex: Creating endpoint deployment for a registry model should return said model's ID immediately) ### Other Changes + - Switched compute operations to go through 2022-10-01-preview API version. ## 1.0.0 (2022-10-10) + - GA release - Dropped support for Python 3.6. The Python versions supported for this release are 3.7-3.10. ### Features Added ### Breaking Changes + - OnlineDeploymentOperations.delete has been renamed to begin_delete. - Datastore credentials are switched to use unified credential configuration classes. - UserAssignedIdentity is replaced by ManagedIdentityConfiguration - Endpoint and Job use unified identity classes. - Workspace ManagedServiceIdentity has been replaced by IdentityConfiguration. - ### Other Changes - - Switched Compute operations to use Oct preview API version. - - Updated batch deployment/endpoint invoke and list-jobs function signatures with curated BatchJob class. + +- Switched Compute operations to use Oct preview API version. +- Updated batch deployment/endpoint invoke and list-jobs function signatures with curated BatchJob class. ## 0.1.0b8 (2022-10-07) ### Features Added - - Support passing JobService as argument to Command() - - Added support for custom setup scripts on compute instances. - - Added a `show_progress` parameter to MLClient for enable/disable progress bars of long running operations. - - Support `month_days` in `RecurrencePattern` when using `RecurrenceSchedule`. - - Support `ml_client.schedules.list` with `list_view_type`, default to `ENABLED_ONLY`. - - Add support for model sweeping and hyperparameter tuning in AutoML NLP jobs. - - Added `ml_client.jobs.show_services()` operation. + +- Support passing JobService as argument to Command() +- Added support for custom setup scripts on compute instances. +- Added a `show_progress` parameter to MLClient for enable/disable progress bars of long running operations. +- Support `month_days` in `RecurrencePattern` when using `RecurrenceSchedule`. +- Support `ml_client.schedules.list` with `list_view_type`, default to `ENABLED_ONLY`. +- Add support for model sweeping and hyperparameter tuning in AutoML NLP jobs. +- Added `ml_client.jobs.show_services()` operation. ### Breaking Changes + - ComputeOperations.attach has been renamed to begin_attach. - Deprecated parameter path has been removed from load and dump methods. - JobOperations.cancel() is renamed to JobOperations.begin_cancel() and it returns LROPoller - Workspace.list_keys renamed to Workspace.get_keys. ### Bugs Fixed + - Fix identity passthrough job with single file code - MLClient.from_config can now find the default config.json on Compute Instance when running sample notebooks. ### Other Changes - - Removed declaration on Python 3.6 support - - Added support for custom setup scripts on compute instances. - - Updated dependencies upper bounds to be major versions. + +- Removed declaration on Python 3.6 support +- Added support for custom setup scripts on compute instances. +- Updated dependencies upper bounds to be major versions. ## 0.1.0b7 (2022-09-22) ### Features Added - - Spark job submission. - - Command and sweep job docker config (shmSize and dockerArgs) spec support. - - Entity load and dump now also accept a file pointer as input. - - Load and dump input names changed from path to 'source' and 'dest', respectively. - - Load and dump 'path' input still works, but is deprecated and emits a warning. - - Managed Identity Support for Compute Instance (experimental). - - Enable using @dsl.pipeline without brackets when no additional parameters. - - Expose Azure subscription Id and resource group name from MLClient objects. - - Added Idle Shutdown support for Compute Instances, allowing instances to shutdown after a set period of inactivity. - - Online Deployment Data Collection for eventhub and data storage will be supported. - - Syntax validation on scoring scripts of Batch Deployment and Online Deployment will prevent the user from submitting bad deployments. + +- Spark job submission. +- Command and sweep job docker config (shmSize and dockerArgs) spec support. +- Entity load and dump now also accept a file pointer as input. +- Load and dump input names changed from path to 'source' and 'dest', respectively. +- Load and dump 'path' input still works, but is deprecated and emits a warning. +- Managed Identity Support for Compute Instance (experimental). +- Enable using @dsl.pipeline without brackets when no additional parameters. +- Expose Azure subscription Id and resource group name from MLClient objects. +- Added Idle Shutdown support for Compute Instances, allowing instances to shutdown after a set period of inactivity. +- Online Deployment Data Collection for eventhub and data storage will be supported. +- Syntax validation on scoring scripts of Batch Deployment and Online Deployment will prevent the user from submitting bad deployments. ### Breaking Changes - - Change (begin_)create_or_update typehints to use generics. - - Remove invalid option from create_or_update typehints. - - Change error returned by (begin_)create_or_update invalid input to TypeError. - - Rename set_image_model APIs for all vision tasks to set_training_parameters - - JobOperations.download defaults to "." instead of Path.cwd() + +- Change (begin_)create_or_update typehints to use generics. +- Remove invalid option from create_or_update typehints. +- Change error returned by (begin_)create_or_update invalid input to TypeError. +- Rename set_image_model APIs for all vision tasks to set_training_parameters +- JobOperations.download defaults to "." instead of Path.cwd() ### Bugs Fixed ### Other Changes - - Show 'properties' on data assets +- Show 'properties' on data assets ## 0.1.0b6 (2022-08-09) @@ -517,7 +570,6 @@ - Added end_time to job schedule. - MIR and pipeline job now support registry assets. - ### Bugs Fixed - Have mldesigner use argparser to parse incoming args. @@ -534,3 +586,4 @@ ### Features Added - First preview. +