Skip to content

[FEATURE] Configurable Ignore Lists #25

@iamvirul

Description

@iamvirul

Feature Description

Configurable ignore lists that allow excluding specific tables and columns from schema and data comparison, useful for excluding audit logs, timestamps, and other non-critical data.

Status

Implemented in: v0.1
Status: Completed

Implementation Details

Configuration

  • YAML-based configuration
  • Table-level ignore lists
  • Column-level ignore patterns
  • Wildcard support for columns

Ignore Patterns

  • Exact table name matching
  • Column pattern matching (e.g., *.updated_at)
  • Case-insensitive matching
  • Multiple patterns supported

Application

  • Schema comparison ignores
  • Data comparison ignores
  • Hash computation ignores
  • Report generation ignores

Configuration Example

ignore:
  tables:
    - "logs"
    - "audit"
    - "temp_*"
  columns:
    - "*.updated_at"
    - "*.created_at"
    - "users.last_login"

Database Support

  • MySQL
  • PostgreSQL
  • SQLite

Technical Implementation

  • Pattern matching engine
  • Ignore list parsing
  • Integration with comparison logic
  • Efficient filtering

Features

  • Table-level exclusion
  • Column-level exclusion
  • Pattern matching
  • Wildcard support
  • Case-insensitive matching

Use Cases

  1. Audit Tables:

    • Exclude log and audit tables
    • Focus on business data
    • Reduce noise in comparisons
  2. Timestamp Columns:

    • Ignore auto-updated timestamps
    • Focus on meaningful changes
    • Prevent false positives
  3. Temporary Data:

    • Exclude temporary tables
    • Ignore test data
    • Focus on production data

Impact

  • Reduces comparison noise
  • Improves focus on important changes
  • Enables flexible comparison strategies

Related Features

  • Schema drift detection
  • Data comparison
  • Configuration management

Metadata

Metadata

Assignees

Labels

enhancementNew feature or requestv0.1version 0.1

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions