TRAC D.A.P. 0.5.3

TRAC D.A.P. 0.5.3 adds alternate mechanisms for supplying S3 credentials on AWS.

Version 0.5.3 is metadata-compatible with versions 0.5.0 through 0.5.2.

TRAC D.A.P. 0.5.2

TRAC D.A.P. 0.5.2 includes the base storage plugin for S3 storage on AWS.

Version 0.5.2 is metadata-compatible with versions 0.5.0 and 0.5.1.

TRAC D.A.P. 0.5.1

TRAC D.A.P. 0.5.1 is a patch release that adds a number of small fixes to 0.5.0. It also includes internal work needed to set up features scheduled for the 0.5.x release series.

Version 0.5.1 is metadata-compatible with version 0.5.0.

TRAC D.A.P. 0.5.0

TRAC D.A.P. 0.5.0 marks a new release series, adding significant features and updates to the previous 0.4.x series.

• New data pipeline framework to better integrate with Apache Arrow
• Authentication framework with two new authentication provider plugins
• Simplified metadata for FLOW objects with improved validation
• Two new platform APIs: listTenants() and platformInfo()
• Simplified configuration layout to allow generic handling of plugin configuration
• Support for in-place metadata upgrades across platform versions

TRAC 0.5.0 breaks metadata compatibility with the 0.4.x series. The metadata database can be upgraded in place using the deploy-metadb tool, however FLOW objects created in 0.4.x will not work with 0.5.0. All other metadata objects are unchanged and will work normally after an in-place upgrade.

TRAC D.A.P. 0.5.0 RC 4

RC 4 adds two major features to the 0.5 candidate series:

• Authentication framework, including local authentication provider plugins
• Flow simplification

TRAC D.A.P. RC 4 is not metadata compatible with RC 3 or any previous versions. Use the deploy-metadb tool to upgrade the metadata database.

TRAC D.A.P. 0.4.10

TRAC D.A.P. 0.4.10 is a maintenance release, to bring fixes from the upcoming 0.5 version to the 0.4.x series. The fixes included are:

• Improved error messages for model loading
• Fix a potential overflow in the local file writer
• Fix error handling for flows in the runtime, when there are errors in multiple models
• Fix data conformance logic when using inferred type hints from Pandas
• Fix UTF-8 encoding for metadata passing between the platform and the runtime
• Update GitHub workflows in light of recent GitHub deprecation warnings
• Update Python build dependencies to meet compliance rules

Version 0.4.10 is metadata-compatible with versions 0.4.0 through 0.4.9.

TRAC D.A.P. 0.5.0 RC 3

RC 3 adds a number of small fixes and performance improvements to the data pipeline.

TRAC D.A.P. 0.5.0 RC 3 is metadata compatible with RC 1 and 2 and the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.5.0 RC 2

RC 2 for the 0.5 series includes a second revision of the new data pipeline framework, as well as a number of bug fixes

• Enahnce and simplify the new data pipeline framework previewed in RC 1
• Imrproved error reporting in the case of multiple failures during a RUN_FLOW job
• Fix a bug in the data conformance logic when undeclared columns in model outputs are dropped with a warning
• Fix handling of UTF-8 strings passing runtime result metadata back to the platform

TRAC D.A.P. 0.5.0 RC 2 is metadata compatible with RC 1 and the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.5.0 RC 1

This release of TRAC D.A.P. introduces a new data framework designed to address the complexities of working with Apache Arrow for Java across heterogeneous data sources. The original implementation using reactive streams had some technical constraints that are intrinsic to the pattern, the solution requires a more flexible mechanism for assembling and executing data pipelines.

The new data framework is a drop-in replacement, there are no changes to metadata, APIs or configuration files. All regression and integration tests are passing on the new framework as well. We are releasing this feature as an RC for the 0.5 series.

TRAC D.A.P. 0.5.0 RC 1 is metadata compatible with the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.4.9

TRAC D.A.P. 0.4.9 includes several improvements to the model runtime and adds a secure mechanism for loading secrets in the platform configuration.

• Allow auto-wiring flows in dev mode when inputs are used multiple times
• Re-apply data conformance for every model in a chain (catches field case/order changes)
• Better error messages for model loading errors
• Define model attributes in code
• Add secret loading interface for platform config + JKS implementation

Version 0.4.9 is metadata-compatible with versions 0.4.0 through 0.4.8.