Skip to content

v0.2.0 - Initial Release

Choose a tag to compare

View all tags
@ckwonc ckwonc released this 12 Dec 19:05
· 7 commits to main since this release
v0.2.0
2a47031
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Smart Data Quality Plugin v0.2.0

Initial release of the Smart Data Quality plugin for Dataiku DSS.

Features

Smart DQ Rules Generator (Macro)

  • Automatically generates 50+ data quality rules from statistical profiling
  • Supports single, multiple, or all datasets in a project
  • Three strictness levels: lenient, balanced, strict
  • Intelligent handling of ID columns, year columns, and categorical fields

Create Business Rules (Agent Tool)

  • Natural language interface for creating custom data quality rules
  • Impact analysis with violation counts before rule creation
  • Rules tagged with [BR] and include business justification metadata

Installation

Download the ZIP file and install via Plugins > Add Plugin > Upload in Dataiku DSS.

See README for usage instructions.

Requirements

  • Dataiku DSS 12.0+
  • Python 3.7+

Known Limitations

  • String length and date validation rules not yet supported by Dataiku API
  • S3/Spark datasets support dataset-level rules only
  • Agent tool currently supports single dataset (multi-dataset support planned)
Assets 3
Loading