Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Hash transformer implementation and validation warning fixes #11

Merged
merged 1 commit into from
Feb 12, 2024

Conversation

wwoytenko
Copy link
Contributor

@wwoytenko wwoytenko commented Feb 10, 2024

New Hash transformer implementation and validation warning fixes

  • New Hash transformer uses sha1 hash by default.
  • Added parameter function that can provide a choice of possible hash algorithms md5, sha1, sha256, sha512.
  • Added max_length parameter allowing to truncate hash tail higher than provided length. The default value is 0 - meaning "do not truncate"
  • Fixed metadata enrichment for validation warnings caused by RawValueValidator

Example:

- schema: "humanresources"
  name: "employee"
  transformers:
    - name: "Hash"
      params:
        column: "loginid"
        function: "sha1"
        max_length: 10

Additional changes:

  • Added Error severity for Cmd parameter validator

Closes #8

* New `Hash` transformer uses `sha1` hash by default.
* Added parameter `function` that can provide a choice of possible hash algorithms `md5, sha1, sha256, sha512`.
* Added `max_length` parameter allowing to truncate hash tail higher than provided length. The default value is `0` - meaning "do not truncate"
* Fixed metadata enrichment for validation warnings caused by `RawValueValidator`

Additional changes:
* Added Error severity for Cmd parameter validator

Closes #8
@wwoytenko wwoytenko self-assigned this Feb 10, 2024
@wwoytenko wwoytenko linked an issue Feb 10, 2024 that may be closed by this pull request
@wwoytenko wwoytenko added bug Something isn't working enhancement New feature or request labels Feb 10, 2024
@gracingpro gracingpro merged commit 09a026d into release_0_1_5 Feb 12, 2024
14 checks passed
@wwoytenko wwoytenko deleted the hash_transformer_v2 branch February 16, 2024 19:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Hash transformer is too slow
2 participants