Dinky v1.0.0-rc4

Feature:

• Realize the synchronization of the entire database and orderly data under multiple degrees of parallelism
• Implement HDFS HA in the resource center
• Implement permission control for global configuration in the configuration center
• Implement configurable alarm anti retransmission function
• Implement DB SQL that can be scheduled by DolphinSchedule
• New resource center synchronization directory based on configured resource storage type (currently implemented as oss)

Fix:

• Fix the issue of incorrect heartbeat detection in cluster instances
• Fix delimiter issues
• Fix the issue of Jar task submission not being able to use set syntax
• Fix the issue of NPE when obtaining user related information through LDAP
• Fix the issue of being unable to carry the higher-level ID when assigning menu permissions
• Fix the issue of version history not being updated properly when switching keys in data development
• Fix some default value issues in PG SQL files
• Fix Dinky's inability to start due to resource configuration errors
• Fix the issue of default route redirection in permission control
• Fix the issue of data development ->task list section not being able to fold
• Fix the issue of duplicate sending of alarm information under multithreading
• Fix the issue of tag height in data development ->open job
• Fix authentication related issues when integrating Gitlab
• Fix the issue where jobmanager logs in the operation and maintenance center's job details cannot be displayed properly
• Fix issues with CataLog NPE
• Fix the issue of Yarn's port being 0
• Fix front-end form status issues with data sources
• Fix the issue with Kubeconfig acquisition
• Fix the issue of pre job task status errors
• Fix syntax issues with add customjar
• Fix some web NPE exceptions
• Fix a bug in enabling SSL when the alarm instance is of email type
• Fix the issue of inability to monitor jar tasks

Optimization & Improve:

• Optimize the UDF download logic of K8S
• Optimize CDC3.0 related logic
• Optimize the synchronization of the entire database by sub database and sub table
• Optimize and integrate LDAP logic
• Optimize the logic of redirecting the data source list to the details page in the registry ->Data source list
• Optimization of homework configuration logic (homework configuration cannot be edited in the published status)
• Optimize the cluster instance rendering logic for job configuration in data development
• Optimize the startup script to enable configuration of environment variables for startup

Document：

• Optimize documents for database and table partitioning
• Optimize regular deployment documents
• Add relevant documents on alarm anti resend
• Optimize OpenAPI documentation
• Add HDFS HA configuration document

Contributors

@aiwenmo
@gaoyan1998
@izouxv
@JiaLiangC
@kylinmac
@leechor
@yangzehan
@yqwoe
@zackyoungh