Skip to content

Conversation

@JCZuurmond
Copy link
Contributor

Resolves #219

@JCZuurmond JCZuurmond requested a review from nfx July 23, 2024 06:27
@JCZuurmond JCZuurmond self-assigned this Jul 23, 2024
@github-actions
Copy link

github-actions bot commented Jul 23, 2024

✅ 35/35 passed, 7 flaky, 2 skipped, 9m18s total

Flaky tests:

  • 🤪 test_dashboard_deploys_dashboard_with_counter_variation (8.401s)
  • 🤪 test_dashboard_deploys_dashboard_with_display_name (11.286s)
  • 🤪 test_dashboard_deploys_dashboard_the_same_as_created_dashboard (12.337s)
  • 🤪 test_dashboards_creates_dashboard_with_order_overwrite_in_dashboard_yaml (10.036s)
  • 🤪 test_dashboard_deploys_dashboard_with_table (9.186s)
  • 🤪 test_dashboards_creates_dashboard_from_query_with_cte (7.234s)
  • 🤪 test_dashboard_deploys_dashboard_with_big_widget (9.275s)

Running from acceptance #328

Copy link
Collaborator

@nfx nfx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@nfx nfx merged commit 5971fb5 into main Jul 23, 2024
@nfx nfx deleted the feat/add-publish-flag branch July 23, 2024 09:17
Copy link
Contributor Author

@JCZuurmond JCZuurmond left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comment

description: |
Overwrite the database in the queries' `FROM` clauses with given value.
Useful when developing with seperated databases, for example, for production and development.
- name: publish
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nfx: How do make this a boolean flag? This is not passed to the cli correctly, it is always None

nfx added a commit that referenced this pull request Jul 25, 2024
* Added publish flag to `Dashboards.create_dashboard` ([#233](#233)). In this release, we have added a `publish` flag to the `Dashboards.create_dashboard` method, allowing users to publish the dashboard upon creation, thereby resolving issue [#219](#219). This flag is included in the `labs.yml` file with a description of its functionality. Additionally, the `no-open` flag's description has been updated to specify that it prevents the dashboard from opening in the browser after creation. The `create_dashboard` function in the `cli.py` and `dashboards.py` files has been updated to include the new `publish` flag, allowing for more flexibility in how users create and manage their dashboards. The `Dashboards.create_dashboard` method now calls the `WorkspaceClient.lakeview.publish` method when the `publish` flag is set to `True`, which publishes the created dashboard. This behavior is covered in the updated tests for the method.
* Fixed boolean cli flags ([#235](#235)). In this release, we have improved the handling of command-line interface (CLI) flags in the `databricks labs` command. Specifically, we have addressed the limitation that pure boolean flags are not supported. Now, when using boolean flags, the user will be prompted to confirm with a `y` or 'yes'. We have modified the `create_dashboard` command to accept string inputs for the `publish` and `no_open` flags, which are then converted to boolean values for internal use. Additionally, we have introduced a new `open-browser` command, which will open the dashboard in the browser after creating when set to `y` or 'yes'. These changes have been tested manually to ensure correct behavior. This improvement provides a more flexible input experience and better handling of boolean flags in the CLI command for software engineers using the open-source library.
* Fixed format breaks widget ([#238](#238)). In this release, we've made significant changes to the 'databricks/labs/lsql' directory's 'dashboards.py' file to address formatting breaks in the widget that could occur with Call to Action (CTA) presence in a query. These changes include the addition of new class variables, including _SQL_DIALECT and _DIALECT, and their integration into existing methods such as _parse_header, validate, format, _get_abstract_syntax_tree, and replace_catalog_and_database_in_query. Furthermore, we have developed new methods for creating and deleting schemas and getting the current test purge time. We have also implemented new integration tests to demonstrate the fix for the formatting issue and added new test cases for the query handler's header-splitting functionality, query formatting, and CTE handling. These enhancements improve the library's handling of SQL queries and query tiles in the context of dashboard creation, ensuring proper parsing, formatting, and metadata extraction for a wide range of query scenarios.
* Fixed replace database when catalog or database is None ([#237](#237)). In this release, we have addressed an issue where system tables disappeared in ucx dashboards when replacing the placeholder database. To rectify this, we have developed a new method, `replace_catalog_and_database_in_query`, in the `dashboards.py` file's `replace_database` function. This method checks if the catalog or database in a query match the ones to be replaced and replaces them with new ones, ensuring that system tables are not lost during the replacement process. Additionally, we have introduced new unit tests in `test_dashboards.py` to verify that queries are correctly transformed when replacing the database or catalog in the query. These tests include various scenarios, using two parametrized test functions, to ensure the correct functioning of the feature. This change provides a more robust and reliable dashboard display when replacing the placeholder database in the system.
@nfx nfx mentioned this pull request Jul 25, 2024
nfx added a commit that referenced this pull request Jul 25, 2024
* Added publish flag to `Dashboards.create_dashboard`
([#233](#233)). In this
release, we have added a `publish` flag to the
`Dashboards.create_dashboard` method, allowing users to publish the
dashboard upon creation, thereby resolving issue
[#219](#219). This flag is
included in the `labs.yml` file with a description of its functionality.
Additionally, the `no-open` flag's description has been updated to
specify that it prevents the dashboard from opening in the browser after
creation. The `create_dashboard` function in the `cli.py` and
`dashboards.py` files has been updated to include the new `publish`
flag, allowing for more flexibility in how users create and manage their
dashboards. The `Dashboards.create_dashboard` method now calls the
`WorkspaceClient.lakeview.publish` method when the `publish` flag is set
to `True`, which publishes the created dashboard. This behavior is
covered in the updated tests for the method.
* Fixed boolean cli flags
([#235](#235)). In this
release, we have improved the handling of command-line interface (CLI)
flags in the `databricks labs` command. Specifically, we have addressed
the limitation that pure boolean flags are not supported. Now, when
using boolean flags, the user will be prompted to confirm with a `y` or
'yes'. We have modified the `create_dashboard` command to accept string
inputs for the `publish` and `no_open` flags, which are then converted
to boolean values for internal use. Additionally, we have introduced a
new `open-browser` command, which will open the dashboard in the browser
after creating when set to `y` or 'yes'. These changes have been tested
manually to ensure correct behavior. This improvement provides a more
flexible input experience and better handling of boolean flags in the
CLI command for software engineers using the open-source library.
* Fixed format breaks widget
([#238](#238)). In this
release, we've made significant changes to the 'databricks/labs/lsql'
directory's 'dashboards.py' file to address formatting breaks in the
widget that could occur with Call to Action (CTA) presence in a query.
These changes include the addition of new class variables, including
_SQL_DIALECT and _DIALECT, and their integration into existing methods
such as _parse_header, validate, format, _get_abstract_syntax_tree, and
replace_catalog_and_database_in_query. Furthermore, we have developed
new methods for creating and deleting schemas and getting the current
test purge time. We have also implemented new integration tests to
demonstrate the fix for the formatting issue and added new test cases
for the query handler's header-splitting functionality, query
formatting, and CTE handling. These enhancements improve the library's
handling of SQL queries and query tiles in the context of dashboard
creation, ensuring proper parsing, formatting, and metadata extraction
for a wide range of query scenarios.
* Fixed replace database when catalog or database is None
([#237](#237)). In this
release, we have addressed an issue where system tables disappeared in
ucx dashboards when replacing the placeholder database. To rectify this,
we have developed a new method, `replace_catalog_and_database_in_query`,
in the `dashboards.py` file's `replace_database` function. This method
checks if the catalog or database in a query match the ones to be
replaced and replaces them with new ones, ensuring that system tables
are not lost during the replacement process. Additionally, we have
introduced new unit tests in `test_dashboards.py` to verify that queries
are correctly transformed when replacing the database or catalog in the
query. These tests include various scenarios, using two parametrized
test functions, to ensure the correct functioning of the feature. This
change provides a more robust and reliable dashboard display when
replacing the placeholder database in the system.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Add publish flag to deploy_dashboard

3 participants