Processing and completion of positional args to bundle run

[pietern]

Changes

With this change, both job parameters and task parameters can be specified as positional arguments to bundle run. How the positional arguments are interpreted depends on the configuration of the job.

Examples:

For a job that has job parameters configured a user can specify:

databricks bundle run my_job -- --param1=value1 --param2=value2

And the run is kicked off with job parameters set to:

{
  "param1": "value1",
  "param2": "value2"
}

Similarly, for a job that doesn't use job parameters and only has notebook_task tasks, a user can specify:

databricks bundle run my_notebook_job -- --param1=value1 --param2=value2

And the run is kicked off with task level notebook_params configured as:

{
  "param1": "value1",
  "param2": "value2"
}

For a job that doesn't doesn't use job parameters and only has either spark_python_task or python_wheel_task tasks, a user can specify:

databricks bundle run my_python_file_job -- --flag=value other arguments

And the run is kicked off with task level python_params configured as:

[
  "--flag=value",
  "other",
  "arguments"
]

The same is applied to jobs with only spark_jar_task or spark_submit_task tasks.

Tests

Unit tests. Tested the completions manually.

[codecov-commenter]

Codecov Report

Attention: 64 lines in your changes are missing coverage. Please review.

Comparison is base (0b22965) 49.52% compared to head (8cec15f) 49.43%.

Files	Patch %	Lines
bundle/run/job_args.go	40.50%	47 Missing ⚠️
cmd/bundle/run.go	0.00%	11 Missing ⚠️
bundle/run/pipeline.go	0.00%	4 Missing ⚠️
bundle/run/job.go	0.00%	2 Missing ⚠️

Additional details and impacted files

@@                Coverage Diff                 @@
##           run-job-params    #1120      +/-   ##
==================================================
- Coverage           49.52%   49.43%   -0.10%     
==================================================
  Files                 275      274       -1     
  Lines               10591    10704     +113     
==================================================
+ Hits                 5245     5291      +46     
- Misses               4790     4858      +68     
+ Partials              556      555       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[pietern]

Thanks, @juliacrawf-db !

Addressed concerns