v0.2.2 - Tool Gives Agent Dataset Schema and Metadata Info

The Business Rule Creator agent now automatically loads dataset schema and metadata, enabling it to map business terms to column names without asking users for technical details. Additionally, the tool now properly handles type conversions in pandas conditions.

v0.2.1 - Metadata Documentation Update

What's Changed

• Added AI-generated metadata disclosure to business rule documentation
• Improved transparency for AI-generated business justifications

Full Changelog

v0.2.0...v0.2.1

v0.2.0 - Initial Release

Smart Data Quality Plugin v0.2.0

Initial release of the Smart Data Quality plugin for Dataiku DSS.

Features

Smart DQ Rules Generator (Macro)

• Automatically generates 50+ data quality rules from statistical profiling
• Supports single, multiple, or all datasets in a project
• Three strictness levels: lenient, balanced, strict
• Intelligent handling of ID columns, year columns, and categorical fields

Create Business Rules (Agent Tool)

• Natural language interface for creating custom data quality rules
• Impact analysis with violation counts before rule creation
• Rules tagged with [BR] and include business justification metadata

Installation

Download the ZIP file and install via Plugins > Add Plugin > Upload in Dataiku DSS.

See README for usage instructions.

Requirements

• Dataiku DSS 12.0+
• Python 3.7+

Known Limitations

• String length and date validation rules not yet supported by Dataiku API
• S3/Spark datasets support dataset-level rules only
• Agent tool currently supports single dataset (multi-dataset support planned)