[Synapse]-Transition task about Synapse from Preview Extension to Preview Module

[sunsw1994]

Resource Provider

• Synapse Analytics

Description of Feature or Work Requested

• management：
  • workspace CURD
  • sqlpool CURD
  • sparkpool CURD
  • firewall-rule CURD
• data-plane：based on track2 python SDK
  • spark-job
  • access-control

We have released CLI Extension for Synapse, and now we plan to move it to CLI module. There are some changes between the Preview Extension to the Preview Module:

1. For data plane cmdlets, we use new track 2 python SDK instead of track 1. That means we need to change the package requirements.
2. We add new cmdlets about access-control, that belong to data-plane. These cmdlets did not exist in the CLI Extension.
3. Get Synapse endpoint and suffix from cloud.py when creating client. Endpoint and suffix have been added in cloud.py in this PR.
4. Split custom functions from custom.py into multi pyfiles according to their namespace or operation type.
5. Fix bug from Synapses Creating Big Data Pool validation error: Parameter 'BigDataPoolResourceInfo.node_count' failed to meet validation requirement. #14708 by adding type=int for node_count

Minimum API Version Required

azure-mgmt-synapse==0.3.0
azure-synapse-accesscontrol==0.2.0
azure-synapse-spark==0.2.0

Swagger Link

• management: https://github.com/Azure/azure-rest-api-specs/tree/master/specification/synapse/resource-manager
• spark-job : https://github.com/Azure/azure-rest-api-specs/blob/master/specification/synapse/data-plane/Microsoft.Synapse/preview/2019-11-01-preview/sparkJob.json
• access-control : https://github.com/Azure/azure-rest-api-specs/tree/master/specification/synapse/data-plane/Microsoft.Synapse/preview/2020-02-01-preview

Target Date

[yonzhan]

Synapse

[ghost]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @aim-for-better, @idear1203.

[sunsw1994]

The task will be divided into three PR:

1. management commands that moved from CLI Extension(PR reviewing[Synapse] Add workspace, sparkpool, sqlpool related cmdlets #14755)
   • workspace CURD
   • sqlpool CURD
   • sparkpool CURD
   • firewall-rule CURD
2. dataplane commands that using track2 sdk instead of track (Proposed)
   • spark job
3. dataplane commands that is new feature (Proposed)
   • access control