Azure Machine Learning reinforcement learning via the azureml.contrib.train.rl package is retiring on 30 June 2022

[azure-deprecation-automation]

Azure Machine Learning reinforcement learning via the azureml.contrib.train.rl package is retiring on 30 June 2022

Deadline: Jun 30, 2022
Impacted Services:

• Azure Machine Learning

More information:

• https://azure.microsoft.com/updates/azure-machine-learning-reinforcement-learning-preview-will-be-retired-after-june-2022/

Notice

Here's the official report from Microsoft:

Azure Machine Learning reinforcement learning via the azureml.contrib.train.rl package will be retired on 30 June 2022. Before that date, please use the Ray on Azure Machine Learning Library for reinforcement learning experiments with Azure Machine Learning. For example, see the notebook Reinforcement Learning in Azure Machine Learning - Pong problem.

Ray on Azure Machine Learning Library gives you the same level of integration for reinforcement learning experiments plus enhancements such as:

• Ability to simplify cluster management.
• Ease of converting Azure Machine Learning compute instance and compute cluster into Ray and Dask cluster.
• Ability to complete all the complex wirings and setup of a Ray cluster with Dask behind the scene while exposing a simple Ray context object for users perform parallel Python computing tasks.

Timeline

Phase	Date	Description
Announcement	Apr 29, 2022	Deprecation was announced
Deprecation	Jun 30, 2022	Package will be retired and service interuptions may occur

Impact

Azure Machine Learning reinforcement learning via the azureml.contrib.train.rl package is retiring on 30 June 2022 and customers should use the Ray on Azure Machine Learning Library package instead.

Required Action

A migration guide is provided here.

Here's the official report from Microsoft:

To avoid service disruptions, update the experiments and pipelines using azureml.contrib.train.rl and update them to follow a similar pattern as this notebook Reinforcement Learning in Azure Machine Learning - Pong problem.

Contact

Contact Azure support (link).

[azure-deprecation-automation]

This issue is automatically managed and suggest to use GitHub Discussions to discuss this deprecation.