Implement Azure ML Service tasks

CHANGELOG.md

@@ -21,8 +21,9 @@ These changes are available in the [master branch](https://github.com/PrefectHQ/
 
 ### Task Library
 
-- Add `BlobStorageDownload` and `BlobStorageUpload` for interacting with data stored on Azure Blob Storage - [#692](https://github.com/PrefectHQ/prefect/pull/1538)
+- Add `BlobStorageDownload` and `BlobStorageUpload` for interacting with data stored on Azure Blob Storage - [#1538](https://github.com/PrefectHQ/prefect/pull/1538)
 - Loosen Kubernetes Tasks' requirement of an API secret key - [#1559](https://github.com/PrefectHQ/prefect/pull/1559)
+- Add tasks for working in Azure Machine Learning Serviec with Datastores and Datasets - [#1590](https://github.com/PrefectHQ/prefect/pull/1590)
 
 ### Fixes
 

docs/core/task_library/azureml.md

@@ -0,0 +1,52 @@
+---
+title: Azure ML Service
+---
+
+# Microsoft Azure Machine Learning Service
+
+A collection of tasks for interacting with Azure Machine Learning Service resources.
+
+## DatasetCreateFromDelimitedFiles <Badge text="task"/>
+
+Task for creating a TabularDataset from delimited files for use in a Azure Machine Learning service Workspace.
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-dataset-datasetcreatefromdelimitedfiles)
+
+## DatasetCreateFromParquetFiles <Badge text="task"/>
+
+Task for creating a TabularDataset from Parquet files for use in a Azure Machine Learning service Workspace. 
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-dataset-datasetcreatefromparquetfiles)
+
+## DatasetCreateFromFiles <Badge text="task"/>
+
+Task for creating a FileDataset from files for use in a Azure Machine Learning service Workspace.
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-dataset-datasetcreatefromfiles)
+
+
+## DatastoreRegisterBlobContainer <Badge text="task"/>
+
+Task for registering Azure Blob Storage container as a Datastore in a Azure ML service Workspace. 
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-datastore-datastoreregisterblobcontainer)
+
+
+## DatastoreList <Badge text="task"/>
+
+Task for listing the Datastores in a Workspace.
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-datastore-datastorelist)
+
+## DatastoreGet <Badge text="task"/>
+
+Task for getting a Datastore registered to a given Workspace.
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-datastore-datastoreget)
+
+
+## DatastoreUpload <Badge text="task"/>
+
+Task for uploading local files to a Datastore.
+
+[API Reference](/api/unreleased/tasks/azureml.html#prefect-tasks-azureml-datastore-datastoreupload)

docs/outline.toml

@@ -199,6 +199,17 @@ title = "Azure Tasks"
 module = "prefect.tasks.azure"
 classes = ["BlobStorageDownload", "BlobStorageUpload"]
 
+[pages.tasks.azureml]
+title = "Azure ML Service Tasks"
+module = "prefect.tasks.azureml"
+classes = ["DatasetCreateFromDelimitedFiles",
+           "DatasetCreateFromParquetFiles",
+           "DatasetCreateFromFiles",
+           "DatastoreRegisterBlobContainer",
+           "DatastoreList",
+           "DatastoreGet",
+           "DatastoreUpload"]
+
 [pages.tasks.github]
 title = "GitHub Tasks"
 module = "prefect.tasks.github"

setup.py

@@ -11,7 +11,7 @@
 extras = {
     "airtable": ["airtable-python-wrapper >= 0.11, < 0.12"],
     "aws": ["boto3 >= 1.9, < 2.0"],
-    "azure": ["azure-storage-blob >= 2.1.0, < 3.0"],
+    "azure": ["azure-storage-blob >= 2.1.0, < 3.0", "azureml-sdk >= 1.0.65, < 1.1"],
     "dev": dev_requires,
     "dropbox": ["dropbox ~= 9.0"],
     "google": [

src/prefect/tasks/azureml/__init__.py

@@ -0,0 +1,22 @@
+"""
+This module contains a collection of tasks for interacting with Azure Machine Learning Service resources.
+"""
+
+try:
+    from prefect.tasks.azureml.dataset import (
+        DatasetCreateFromDelimitedFiles,
+        DatasetCreateFromParquetFiles,
+        DatasetCreateFromFiles,
+    )
+
+    from prefect.tasks.azureml.datastore import (
+        DatastoreRegisterBlobContainer,
+        DatastoreList,
+        DatastoreGet,
+        DatastoreUpload,
+    )
+
+except ImportError:
+    raise ImportError(
+        'Using `prefect.tasks.azureml` requires Prefect to be installed with the "azure" extra.'
+    )