When working with cluster policies, sometimes it's quirky to specify all the fixed fields in the deployment configuration.
To make this simpler, a new functionality is introduced - this functionality is called "property propagation".
- Specify
policy_name
property in thenew_cluster
section dbx
will automatically fetch the policy definition using Cluster Policies API- Job cluster definition will be updated accordingly with all fixed properties provided from the policy definition during the
dbx deploy
step - There is no need to specify
policy_id
manually, it will be automatically added to the cluster definition
policy_name
shall exist in your Cluster Policies- If there are any conflicting configurations provided (i.e. deployment configuration has value provided, and this value is not the same as in the policy) - deployment will fail
- Job properties adjustment happens only during the
dbx deploy
step, and it's applied only when there is anew_cluster
withpolicy_name
property specified - Only the fixed properties will be automatically propagated