Roadmap

Roadmap

The roadmap keeps schema-based lower-environment generation at the center.

Completed contract foundation

• canonical contract model
• parse_ddl(...) for documented SQL CREATE TABLE ingestion
• stable contract hashing
• strict and permissive parser diagnostics
• single-table contract generation through generate_from_schema(...)

Schema ingestion

• rich inline schema metadata
• additional SQL dialect coverage beyond the documented ANSI/Spark/Databricks subset
• JSON Schema, dbt schema files, Avro, OpenAPI, and catalog metadata ingestion
• JSON Schema and schema files
• YAML schema profiles
• column-list inference
• SQLAlchemy models
• Pydantic models
• Python dataclasses
• richer nested object, array, map, and struct support

Generation and scale

• Spark-native arbitrary-schema generation
• chunked Pandas generation
• explicit reference date for time-stable reproducibility
• generation manifests with schema, rules, counts, and lineage metadata

Data quality

• richer quality profiling
• relationship validation reports
• configurable uniqueness and regex constraints
• named edge-case scenarios
• anomaly labels for Spark outputs

Platform and community

• more tested storage recipes
• additional domain packs and lifecycle state machines
• versioned recipe schema
• streaming and Kafka-oriented output adapters

Planned items are not documented as supported until their behavior and tests land in the library.