Flowx release - #1
Merged
Merged
Conversation
* Update documentation * Restore docs navigation entries Co-authored-by: ghanse <163584195+ghanse@users.noreply.github.com> * Fix docs guide navigation links Co-authored-by: ghanse <163584195+ghanse@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
* Vendor workspace artifacts into prepared bundles Lets the prepare phase download notebook source (and existing JAR/Python support) from a Databricks workspace so the generated DAB is self-contained and deployable across environments without depending on the source workspace holding the original notebook tree. * Opt-in toggle in `workspace_downloader` (`enable_workspace_downloads()` / `workspace_downloads_enabled()`) so library callers preserve current behavior; the CLI flips it on by default. * Pre-flight auth gate: `auth_available()` checks `.databrickscfg`, `DATABRICKS_CONFIG_PROFILE`, and `DATABRICKS_HOST`+`DATABRICKS_TOKEN`. `prompt_for_auth_if_missing()` surfaces an interactive prompt with explicit `databricks auth login` instructions before the prepare pass runs. * `dab_writer` walks the report ahead of time, collects workspace-resident paths from nested control-flow activities, prompts (and aborts on `n`), then enables downloads. New CLI flags: `--profile`, `--no-vendor-workspace-files`. * `NotebookActivity` preparer downloads the workspace source on hit, vendors to `src/notebooks/<basename>.py`, rewrites `notebook_task.notebook_path` to the bundle-relative path, and binds `job_cluster_key=default_cluster` so the downloaded code keeps classic-compute parity (the post-process bind step skips `../src/` paths reserved for orchestra-generated serverless notebooks). * `workspace_notebook_filename()` preserves the workspace basename verbatim (case, underscores, digits); falls back to `notebook_filename()` only when the path yields no usable segment. Strips `.py`, folds other extensions into the stem to avoid collisions between e.g. `runner.sql` and `runner.py`. * `write_notebooks` now coalesces identical writes, disambiguates content collisions with a `__N` suffix, and logs a warning so users know two workspace paths share a basename rather than silently overwriting one. * SKILL.md documents the new behavior, the auth prompt, and the two flags. * Tests: new `test_naming.py`, `test_notebook_writer.py`; updated `test_preparers.py` and `test_workspace_downloader.py` to cover the toggle, auth helpers, vendor-success branch, in-place fallback, basename preservation, and the verbatim test_notebook_001 case. Co-authored-by: Isaac * Format
* Add user-interface for specifying options * Fix docs rendering
This reverts commit f6b98ec.
# Conflicts: # .gitignore # README.md
ghanse
added a commit
that referenced
this pull request
Jun 29, 2026
* Refactor expression parsing (#1) * Improve control flow conversion (#2) Improves conversion of control flow, expression-based parameters, and schedule triggers. Co-authored-by: Isaac * docs: update README install and usage for marketplace + setup Updates README.md to align with new installation and usage patterns. Co-authored-by: Isaac * Remove legacy files
ghanse
added a commit
that referenced
this pull request
Jul 6, 2026
* Refactor expression parsing (#1) * Improve control flow conversion (#2) Improves conversion of control flow, expression-based parameters, and schedule triggers. Co-authored-by: Isaac * Merge external (#3) * Revert "Update GitHub actions (#10)" This reverts commit f6b98ec. * Improve expression resolution, control flow parsing, and setup (#11) * Refactor expression parsing (#1) * Improve control flow conversion (#2) * Update repo structure * Format modules * Initial commit * Initial release * Improve preparer coverage for managed ingestion pipelines (#2) * Lakeflow connect ingestion pipeline handling * Add required connection parameters * Add marketplace file (#3) --------- Co-authored-by: Greg Hansen <163584195+ghanse@users.noreply.github.com> Co-authored-by: service-jira-pub-repo-auto <service.jira-pub-repo-auto@databricks.com> * Add SDK-based installation --------- Co-authored-by: service-jira-pub-repo-auto <service.jira-pub-repo-auto@databricks.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes
Initial release of flowx