Skip to content

jackdellyd/databricksfeature

Repository files navigation

PT-databricksFeature

Instruction on how to recreate workflows in another databricks instance

There are 2 options to download job from workflows

  1. By simply copy the json file from the workflow portal/UI
  2. By running downloader.py file from "https://github.inc.com/plan/ap-setup/tree/master/scripts/job_setting_saver-----" and ensure the config.json file is configured

When promoting to next environment: job_id, creator_user_name, run_as_user_name, run_as_owner, and settings should be removed from the json file. Sample below

    "job_id": 158276608323381,
    "creator_user_name": "..m",
    "run_as_user_name": "...",
    "run_as_owner": true,
    "settings": 

Ensure it is a well formed json.

Run below command in databricks cli:

databricksjobs create --json-file directory/filename.json

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published