Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removed experimental redacting logger filter for dbutils.secrets.get('scope', 'key') #92

Merged
merged 1 commit into from
May 5, 2023

Conversation

nfx
Copy link
Contributor

@nfx nfx commented May 4, 2023

Changes

It seems that dbutils.secrets.get('scope', 'key') is conflicting with internal working of Jupyter Kernel.

This PR removing experimental basic, best-effort, logging filter to redact secrets from accidental logging. sys.stdout, sys.stderr, and print() statements are not handled.

This won't work anymore:

databricks-sdk-py_–_test_dbutils_py

Tests

  • make test run locally
  • make fmt applied
  • relevant integration tests applied

This PR removing experimental basic, best-effort, logging filter to redact secrets from accidental logging. `sys.stdout`, `sys.stderr`, and `print()` statements are not handled.

This won't work anymore:
<img width="1083" alt="databricks-sdk-py_–_test_dbutils_py" src="https://user-images.githubusercontent.com/259697/227218521-0a4f14f8-8445-4a6b-9f6f-ecc073e43524.png">
@codecov-commenter
Copy link

Codecov Report

Patch coverage has no change and project coverage change: -0.09 ⚠️

Comparison is base (c578001) 52.80% compared to head (d05ed86) 52.72%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #92      +/-   ##
==========================================
- Coverage   52.80%   52.72%   -0.09%     
==========================================
  Files          29       29              
  Lines       17103    17065      -38     
==========================================
- Hits         9032     8998      -34     
+ Misses       8071     8067       -4     
Impacted Files Coverage Δ
databricks/sdk/dbutils.py 92.48% <ø> (+0.66%) ⬆️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@nfx nfx changed the title Remove experimental redacting logger filter Removed experimental redacting logger filter for dbutils.secrets.get('scope', 'key') May 5, 2023
@nfx nfx merged commit c6eab45 into main May 5, 2023
@nfx nfx deleted the remove-log-redaction branch May 5, 2023 10:43
@nfx nfx mentioned this pull request May 5, 2023
nfx added a commit that referenced this pull request May 5, 2023
# Version changelog

## 0.1.4

* Removed experimental redacting logger filter for
`dbutils.secrets.get('scope', 'key')`, that was causing Jupyter Kernels
to hang
([#92](#92)).
* Fixed error handling for SCIM and CommandExecution APIs
([#94](#94)).
* Created `dependabot.yml`
([#89](#89)).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants