Skip to content

Exchangis 1.1.2 Release Notes

Latest
Latest
Compare
Choose a tag to compare
@jefftlin jefftlin released this 15 Aug 13:20
release-1.1.2
f8f7f9d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Exchangis is a new data exchange tool jointly developed by WeDataSphere big data platform and community users to support the synchronization of structured and unstructured data transfer between heterogeneous data sources.
Exchangis also abstracts a unified set of data source and synchronous job definition plugins, allowing users to quickly access new data sources and use them on the page with a simple configuration in the database.
Based on the plugin framework design and computing middleware Linkis, Exchangis can quickly integrate and connect with the integrated data synchronization engine of Linkis, and convert the synchronization jobs of Exchangis into the data synchronization jobs of Linkis data synchronization engine.
With the connectivity, reuse, and simplification capabilities of Linkis computing middleware, Exchange is born with financial level data synchronization capabilities of high concurrency, high availability, multi-tenant isolation, and resource management.

Github：
https://github.com/WeBankFinTech/Exchangis

Description of the new version:

Compared with Exchangis 1.0.0, Exchangis 1.1.2 added DataX engine and supported Oracle datasource. At the same time, some common problems in project module and task module were fixed, which further improved the stability of the system.
Exchangis1.1.2 provides the following new features：
1, [Job engine plug-in module] added DATAX engine to support a variety of data derivative links.

  1. [Project management module] project authority control function, support synchronization of DSS project authority to Exchangis.

3, [Datasource module] Added Oracle data source, supported bidirectional derivatives with MySQL, Hive, MongoDB, and imported to ElasticSearch.

  1. [Datasource module] data source connection sensitive information encryption, support the owner of the connection information encryption.

  2. [Job configuration management module] Field rule mapping management function supports the management of field mapping rules and field matching strategies of different engines and different data sources, and renders at the front end when loading jobs.

6, [Job configuration management module] background storage engine configuration and mapping function, support background storage engine derivative configuration and task field mapping function list storage.

Features:

  • [Exchangis Plugin Management Module] Add the DataX engine.

  • [Exchangis Project Module] Adds the project permission synchronization function to synchronize DSS project permissions.

  • [Exchangis Datasource Server Module] Add an Oracle data source.

  • [Exchangis Datasource Server Module] Add encryption of sensitive data source connection information.

  • [Exchangis Job Builder Module] Add field rule mapping management.

  • [Exchangis Job Builder Module] Add the background storage engine configuration and mapping function list.

Enhancements:

  • [Exchangis Project Module] Sets Project Name to uneditable when modifying a project on the front-end page.

  • [Exchangis Project Module] Checks whether tasks exist when deleting an item. If yes, the item cannot be deleted.

  • [Exchangis Job Execution Module] Optimizes subtask execution schedule statistics during task execution to ensure consistency of schedule data.

  • [DSS Dependency] Upgrade the DataSphereStudio (DSS) version to 1.1.2.

  • [Linkis Dependency] Upgraded Linkis version to 1.4.0, addressing some issues with concurrent execution of the engine.

Bug Fix:

  • [Exchangis Job Info Module] The Execute User value is automatically displayed during task editing.

  • [Exchangis Job Builder Module] Fixed an issue where the name of a subtask is too long to run a task for a long time.

  • [Exchangis Job Log Query Module] Fixed system exceptions when viewing non-current day logs.

  • [Exchangis Job Log Query Module] Fixed an error message displayed on the log TAB page after a log query is abnormal.

Contributors:

Exchange 1.1.2 can't be released without the contributors of the Exchange community. Thank you to all the contributors!

Install packages:

Exchangis 1.1.2 Installation package: Click Me to download

DSS1.1.2&Linkis1.4.0 One-click installation package: Click Me to download

Assets 2