Release 6.2

Release 6.2 brings Egeria's support for data products and data contracts up to the open standards used by the teams that build them, with support for the Bitol Open Data Contract Standard (ODCS) and Open Data Product Standard (ODPS) and an upgrade to the current OpenLineage specification. New nanny connectors maintain the data mesh from the lineage beneath it (Darwin) and resolve duplicate metadata (Mendel), and the Open Metadata Digital Product Catalog now delivers data to its subscribers end to end, with lineage.

Much of the work in this release has gone into testing. Eighteen functional verification test suites now exercise the platform, its connectors and its content packs, and the many defects they found have been fixed. The build has also moved to Java 21, Gradle 9 and Spring Boot 3.5, so check the upgrade notes at the end before moving to this release.

What's Changed

• Move to 6.2-SNAPSHOT by @mandy-chessell in #9225
• Improve special character support for PostgreSQL repository by @mandy-chessell in #9227
• Fix duplicate listener registration by @mandy-chessell in #9228
• Remove XTDB remnants and dead constraints from the Egeria BOM by @mandy-chessell in #9229
• Correct Maven Central calls by @mandy-chessell in #9230
• Complete the implementation of the open metadata relationship types by @mandy-chessell in #9231
• Add annotation types for code analysis by @mandy-chessell in #9232
• Add comprehensive support for classifications in the API by @mandy-chessell in #9233
• Alignment of types and their docs by @mandy-chessell in #9234
• Add Connector Client Context tests by @mandy-chessell in #9235
• Add server-side implementations for handling language translations by @mandy-chessell in #9236
• Test templates and fix archive creation time by @mandy-chessell in #9237
• Run the conformance suite against our own repositories, and fix what it found by @mandy-chessell in #9239
• Add messages and codes documentation by @mandy-chessell in #9240
• Fix deduplication defects in RepositoryHandler by @mandy-chessell in #9241
• Improve error handling in test cases by @mandy-chessell in #9242
• Fix inmemory repository history window by @mandy-chessell in #9243
• Fix PostgresDatabaseStatsExtractor misreading negative pg_stats.n_distinct as a raw count by @karthikchundi-commits in #9244
• Pushdown query filters to repositories by @mandy-chessell in #9246
• Add ResourceConnection, DeletingActionProcess and SubscribingActionProcess types by @mandy-chessell in #9247
• Update core content pack to use new governance action process types by @mandy-chessell in #9248
• Pushdown effectivity date queries by @mandy-chessell in #9249
• Fix Javadoc error by @mandy-chessell in #9250
• Add postgres-fvt plus fixes by @mandy-chessell in #9251
• Prevent Babbage from activating duplicate lovelace services by @mandy-chessell in #9252
• Add the Mendel Automated Duplicate Manager by @mandy-chessell in #9253
• Clean up comments by @mandy-chessell in #9254
• Clarify behaviour of endMatchCriteria by @mandy-chessell in #9255
• Fix Mendel consolidation of duplicate classifications by @mandy-chessell in #9256
• Add subscription-fvt by @mandy-chessell in #9257
• Prepare the build for the Gradle, Java and Spring upgrades (stage 1) by @mandy-chessell in #9258
• Move to Gradle 8.14.5 and clear the deprecations it surfaces (stage 2) by @mandy-chessell in #9259
• Fix Paging Stability by @mandy-chessell in #9260
• Move to Java 21 (stage 3) by @mandy-chessell in #9261
• New user directory FVT test suite by @mandy-chessell in #9262
• Repair supertype chains after a type is reparented by @mandy-chessell in #9263
• Let a caller choose how a count is arrived at, with pushDown by @mandy-chessell in #9265
• Import the Spring Boot BOM instead of hand-pinning Spring versions by @mandy-chessell in #9264
• Add files-fvt and fix bugs by @mandy-chessell in #9266
• Cover the remaining Files content pack connectors in files-fvt by @mandy-chessell in #9267
• Close the paging and classification gaps, and finish files-fvt's coverage by @mandy-chessell in #9268
• Move to Gradle 9.7.1, enable the configuration cache, and fix the packaged platform jar (stage 5) by @mandy-chessell in #9269
• Fix the broken merge workflow by @mandy-chessell in #9270
• FVT suite for Open Metadata Digital Product Catalog plus fixes by @mandy-chessell in #9271
• BOM Cleanup by @mandy-chessell in #9272
• Update PR workflow dependencies by @mandy-chessell in #9273
• CI Cleanup by @mandy-chessell in #9276
• Remove dead plugins from build by @mandy-chessell in #9277
• Upload artifact bump and dependabot config by @mandy-chessell in #9278
• Extended deduplication scenarios by @mandy-chessell in #9279
• Final dependabot for now by @mandy-chessell in #9280
• Clean up serializable build warnings by @mandy-chessell in #9281
• CTS Resillience by @mandy-chessell in #9282
• Add cataloguing and surveys to Liskov by @mandy-chessell in #9283
• Improve Kafka rejoin logic by @mandy-chessell in #9284
• Remove the plexus-utils BOM constraint by @mandy-chessell in #9285
• Make cohort event delivery deterministic, and settle what a repository count means by @mandy-chessell in #9286
• New server-fvt suite plus fixes by @mandy-chessell in #9287
• Push the engine action status filters down into the repository query by @mandy-chessell in #9288
• Restrict the default GITHUB_TOKEN scope in the CodeQL v6 workflow by @mandy-chessell in #9290
• Notification redesign and query fixes and tests by @mandy-chessell in #9289
• Pin GitHub Actions by @mandy-chessell in #9291
• Baudot becomes a dynamic integration connector by @mandy-chessell in #9292
• Speed up catalog target reads for all connectors by @mandy-chessell in #9293
• Simplify the processing of digital product families by @mandy-chessell in #9294
• Route connector audit logging through ConnectorBase, and test every message set by @mandy-chessell in #9295
• Add security-fvt and fix bugs by @mandy-chessell in #9296
• All investigators to see the server config event if the security connector is attached by @mandy-chessell in #9297
• Bitol data contract (ODCS) and data product (ODPS) support by @mandy-chessell in #9298
• Enable Bitol Connectors by @mandy-chessell in #9299
• New types for data standards by @mandy-chessell in #9300
• Add naming standards to resource use valid value by @mandy-chessell in #9301
• Upgrade Bitol to ODCS v3.2.0 and ODPS v1.1.0 by @mandy-chessell in #9302
• Add Bitol enums by @mandy-chessell in #9303
• Fix javadoc tag by @mandy-chessell in #9304
• Upgrade OpenLineage support to spec 2-0-2 and catalogue lineage, run metrics and data scope by @mandy-chessell in #9305
• Catalog Bitol Documents by @mandy-chessell in #9306
• Pass Unity Catalog Name by @mandy-chessell in #9307
• Display elements that are not solution components by @mandy-chessell in #9308
• Control the capitalization of iscQualifiedName by @mandy-chessell in #9310
• Product Manager API: create digital products and subscription types, and move Jacquard onto it by @mandy-chessell in #9311
• Add support for the Promise classification by @mandy-chessell in #9312
• Add control of bearer token timeout by @mandy-chessell in #9313
• Add Darwin nanny connector by @mandy-chessell in #9314
• Add header update calls to Metadata Expert API by @mandy-chessell in #9315
• Increase resillience of CTS test by @mandy-chessell in #9316
• Fix DB2LUWDatabaseStatsExtractor misreading COLCARD = -1 (ungathered stats) as a raw distinct-value count by @karthikchundi-commits in #9309
• Improvements to OMAGServerPlatformCataloguer (with new FVT) by @mandy-chessell in #9317
• Bean contract, toString and content pack checks - with the defects they found by @mandy-chessell in #9318
• New tests and fixes - new database schema commands by @mandy-chessell in #9319
• Update fvt tests as part of a coverage text by @mandy-chessell in #9322
• Add dynamic type APIs by @mandy-chessell in #9323
• Add an ImplementedBy relationship between the DigitalProduct and the Product Asset by @mandy-chessell in #9324
• Capture lineage during subscription provisioning by @mandy-chessell in #9325
• Link data dictionary with schemas (Liskov) by @mandy-chessell in #9326
• Support open lineage naming conventions by @mandy-chessell in #9327
• Show deployment status on information supply chain diagrams by @mandy-chessell in #9328
• Stop dropping classifications by @mandy-chessell in #9349
• Make status area optional by @mandy-chessell in #9350
• Point the sample DigitalProductDependency from the consumer to the provider by @mandy-chessell in #9351
• Adjust the shape of the Promise classification in mermaid graph by @mandy-chessell in #9352
• Escape colons in map attribute key names by @mandy-chessell in #9353
• OpenLineage cataloguing performance by @mandy-chessell in #9354
• Optimizing surveys by @mandy-chessell in #9355
• Make Liskov suvery schedule adapt to the activity in the data stores by @mandy-chessell in #9356
• Prevent deadlok at server shutdown by @mandy-chessell in #9357
• October dependabot updates plus FVT timeout on server shutdown by @mandy-chessell in #9358
• Shutdown deadlocks, a lost Kafka event and mismatched Coco guards by @mandy-chessell in #9359
• Fix issues from pyegeria team by @mandy-chessell in #9360
• Additional fixes for the pyegeria team by @mandy-chessell in #9361
• Reproducible content packs and request params for lovelace services by @mandy-chessell in #9362
• Update release name to 6.2 by @mandy-chessell in #9364

New Contributors

• @karthikchundi-commits made their first contribution in #9194

Full Changelog: V6.1...V6.2