Repository navigation
v0.10.0
What's Changed
Features
- feat: add orphan record identification and removal by @georgeRobertson in #150
- feat: group rejections for mandatory primary keys by @georgeRobertson in #152
- feat: add orphan and group rejections to spark backend by @georgeRobertson in #174
- feat: add facility to add additional checks at end of file transforma… by @stevenhsd in #165
- feat: add error_report config to toggle record rejection reporting by @vaibhavtiwari16 in #189
Fixes
- fix: add user feedback message for unsupported file type by @georgeRobertson in #142
- fix: change record rej ct to be eq to records processed when file rejected by @georgeRobertson in #154
- fix: ensure missing parent and group rejection records are being remo… by @stevenhsd in #160
- fix: add message templating to error messages on orph+group rej by @georgeRobertson in #161
- fix: raise processing error where filter is materialising null values by @stevenhsd in #162
- fix: ensure network and load_dtd are disabled in xml reading by @georgeRobertson in #167
- fix: exit processing xml files that fail XSD by @georgeRobertson in #171
- fix: group rejection not filtering out invalid records correctly by @georgeRobertson in #175
- fix: refactor the join_header method in duckdb to deal with out of bound date values by @georgeRobertson in #177
- fix: total no records rejected showing when it shouldn't by @georgeRobertson in #194
- fix: ensure error summary sheet populates entities in deterministic way by @stevenhsd in #191
Refactors
- refactor: remove original entities by @georgeRobertson in #164
- refactor: tweak hierarchy node design to allow iteration both directi… by @stevenhsd in #155
- refactor: rename of error code and messages related to empty entities… by @stevenhsd in #187
- refactor: uppercase all entity names in error report by @georgeRobertson in #190
Dependencies
- ci: lock poetry install to binary only for most deps by @georgeRobertson in #139
- build: upgrade duckdb to v1.4 by @georgeRobertson in #147
- build: upgrade urllib3 from 2.7 to 2.8 by @georgeRobertson in #178
- build: upgrade java runtime for dev by @georgeRobertson in #158
- build: bump virtualenv version to 21.7.13 to resolve vulns by @georgeRobertson in #179
- build: update various packages for security patching by @georgeRobertson in #193
- build: bump pypi publish action to latest release by @stevenhsd in #196
Docs
- docs: fix json schema definitions by @georgeRobertson in #140
- docs: add entity relationships detail to docs by @stevenhsd in #157
- docs: update docs around entity relationships for root entities by @georgeRobertson in #169
- docs: add udfs to docs by @georgeRobertson in #183
- docs: update docs related to v0.10.0 release by @georgeRobertson in #195
Full Changelog: v0.9.0...v0.10.0