TRAC D.A.P. 0.5.0

TRAC D.A.P. 0.5.0 marks a new release series, adding significant features and updates to the previous 0.4.x series.

• New data pipeline framework to better integrate with Apache Arrow
• Authentication framework with two new authentication provider plugins
• Simplified metadata for FLOW objects with improved validation
• Two new platform APIs: listTenants() and platformInfo()
• Simplified configuration layout to allow generic handling of plugin configuration
• Support for in-place metadata upgrades across platform versions

TRAC 0.5.0 breaks metadata compatibility with the 0.4.x series. The metadata database can be upgraded in place using the deploy-metadb tool, however FLOW objects created in 0.4.x will not work with 0.5.0. All other metadata objects are unchanged and will work normally after an in-place upgrade.

TRAC D.A.P. 0.5.0 RC 4

RC 4 adds two major features to the 0.5 candidate series:

• Authentication framework, including local authentication provider plugins
• Flow simplification

TRAC D.A.P. RC 4 is not metadata compatible with RC 3 or any previous versions. Use the deploy-metadb tool to upgrade the metadata database.

TRAC D.A.P. 0.4.10

TRAC D.A.P. 0.4.10 is a maintenance release, to bring fixes from the upcoming 0.5 version to the 0.4.x series. The fixes included are:

• Improved error messages for model loading
• Fix a potential overflow in the local file writer
• Fix error handling for flows in the runtime, when there are errors in multiple models
• Fix data conformance logic when using inferred type hints from Pandas
• Fix UTF-8 encoding for metadata passing between the platform and the runtime
• Update GitHub workflows in light of recent GitHub deprecation warnings
• Update Python build dependencies to meet compliance rules

Version 0.4.10 is metadata-compatible with versions 0.4.0 through 0.4.9.

TRAC D.A.P. 0.5.0 RC 3

RC 3 adds a number of small fixes and performance improvements to the data pipeline.

TRAC D.A.P. 0.5.0 RC 3 is metadata compatible with RC 1 and 2 and the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.5.0 RC 2

RC 2 for the 0.5 series includes a second revision of the new data pipeline framework, as well as a number of bug fixes

• Enahnce and simplify the new data pipeline framework previewed in RC 1
• Imrproved error reporting in the case of multiple failures during a RUN_FLOW job
• Fix a bug in the data conformance logic when undeclared columns in model outputs are dropped with a warning
• Fix handling of UTF-8 strings passing runtime result metadata back to the platform

TRAC D.A.P. 0.5.0 RC 2 is metadata compatible with RC 1 and the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.5.0 RC 1

This release of TRAC D.A.P. introduces a new data framework designed to address the complexities of working with Apache Arrow for Java across heterogeneous data sources. The original implementation using reactive streams had some technical constraints that are intrinsic to the pattern, the solution requires a more flexible mechanism for assembling and executing data pipelines.

The new data framework is a drop-in replacement, there are no changes to metadata, APIs or configuration files. All regression and integration tests are passing on the new framework as well. We are releasing this feature as an RC for the 0.5 series.

TRAC D.A.P. 0.5.0 RC 1 is metadata compatible with the 0.4.x series. However there are likely to be metadata changes before the 0.5.0 release.

TRAC D.A.P. 0.4.9

TRAC D.A.P. 0.4.9 includes several improvements to the model runtime and adds a secure mechanism for loading secrets in the platform configuration.

• Allow auto-wiring flows in dev mode when inputs are used multiple times
• Re-apply data conformance for every model in a chain (catches field case/order changes)
• Better error messages for model loading errors
• Define model attributes in code
• Add secret loading interface for platform config + JKS implementation

Version 0.4.9 is metadata-compatible with versions 0.4.0 through 0.4.8.

TRAC D.A.P. 0.4.8

TRAC D.A.P. 0.4.8 adds a few small but helpful fixes to 0.4.7.

• Fixes in the service control scripts to make them work on RHEL
• Handling of proxied rHTTP redirect responses in the gateway
• Improved error reporting for failed jobs, including a new trac_job_error_message attribute

Version 0.4.8 is metadata-compatible with versions 0.4.0 through 0.4.7.

TRAC D.A.P. 0.4.7

TRAC D.A.P 0.4.7 includes several updates to the model runtime, as well as some minor fixes.

• Embedded API, use the TRAC runtime engine as a library to build your own executor
• Run multiple jobs in a single batch
• Query or wait for individual job statuses
• Support relative imports when loading external models
• Improved error reporting in the runtime engine
• Fix for the platform service control scripts on Linux / macOS

Version 0.4.7 is metadata-compatible with versions 0.4.0 through 0.4.6.

TRAC D.A.P. 0.4.6

Starting with TRAC D.A.P. 0.4.6, binary distributions of the platform components are available with each release on the GitHub release page. The tracdap-platform package includes distributions of all the service components and supporting tools, suitable for enterprise deployment using containers or physical or virtual hardware. The tracdap-sandbox package includes all the services and tools in a single distribution, for easy setup in development, testing or demo situations.

For more information on deploying the platform, refer to our deployment documentation.

Version 0.4.6 is metadata-compatible with versions 0.4.0 through 0.4.5.