Skip to content

1.1.0
Compare
Choose a tag to compare
@zqburde zqburde released this 01 Jul 14:11
· 15 commits to branch-1.1.0 since this release
1.1.0
55c0638
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

DataSphereStudio 1.1.0 is a milestone in the practice of data application development and management framework. It integrates all the open source ecological components of WeDataSphere, and brings a series of powerful new features, as well as a more streamlined and easy-to-connect data application development integration architecture design and implementation .

DSS-1.1.0 includes all of Project DSS-1.1.0.

The main features of DSS-1.1.0 are as follows:

  • All the open source ecological components of WeDataSphere have been integrated, including Apache Linkis 1.1.1, Exchangeis 1.0.0, Schedulis 0.7.0, Qualitis 0.9.2, Visualis 1.0.0, Streamis 0.2.0 and Prophecis 0.3.2.
  • Integrate Apache DolphinScheduler 1.3.X. It supports one-click publishing of DSS workflows as DolphinScheduler workflows, designs and develops a new scheduling center for workflow scheduling.
  • User experience optimization. Such as support for skinning, top navigation bar revision, DSS development center revision, etc.
  • Help manual and beginner's guide.
  • Installation and deployment optimization. It further simplifies the one-click installation and deployment process of DSS&Linkis family buckets, allowing the installation of DSS and Linkis to be completed within half an hour.
  • Support graceful upgrade. Provides a detailed upgrade process on how to upgrade from DSS-1.0.1 to DSS-1.1.0, and how to migrate from DSS-0.9 to DSS-1.1.0.
  • AppConn architecture optimization. The architecture is simpler and clearer, and the documentation is more comprehensive and detailed. It teaches you how to implement a new AppConn and add a new workflow node.

Abbreviations:

  • DSS: DataSphereStudio
  • DAS: DataApiService

New Feature

  • DSS-848 [DSS-AppConn] Integrate Apache DolphinScheduler1.3.X, design and develop a new scheduling center
  • DSS-849 [DSS-Commons] Adapt to Apache Linkis1.1.1
  • DSS-716 [DSS-AppConn] Integrate Exchangeis1.0.0
  • DSS-846 [DSS-AppConn] Integrate Schedulis0.7.0
  • DSS-847 [DSS-AppConn] Integrate Qualitis0.9.2
  • DSS-850 [DSS-AppConn] Integrate Visualis1.0.0
  • DSS-851 [DSS-AppConn] Integrate Streamis0.2.0
  • DSS-852 [DSS-AppConn] Integrate Prophecis0.3.2
  • DSS-853 [DSS-AppConn] AppConn Architecture Optimization
  • DSS-792 [DSS-Deployment] Support hot update AppConn plugin installation without restarting all services
  • DSS-862 [DSS-Deployment] Support graceful upgrade
  • DSS-863 [DSS-Workspace] Added help manual and beginner's guide
  • DSS-590 [DSS-UI] Optimize development center user experience, such as support changing the background and optimizing the display of the top navigation bar, etc.
  • DSS-864 [DSS-Workflow] Add the script file download function of the workflow version

Enhancement

  • DSS-865[DSS-Workspace] Streamline part of the interface of the workspace, while removing the useless part of the interface
  • DSS-866 [DSS-Workspace] Add a workspace type option when creating a new workspace; add a management console function on the right side of the workspace homepage; add a help button in the lower right corner
  • DSS-753 [DSS-Workspace] Remove the application store and change the component access entry to the upper left menu bar
  • DSS-728 [DSS-Workspace] Optimize the demo of the application development process at the bottom of the homepage, remove the button of the demo case and change it to stay tuned
  • DSS-590 [DSS-UI] Adjust the style of the explorer button, add the background switching function, change the UI of the project list and navigation bar, change the UI style of the application store
  • DSS-628 [DSS-DAS] The download function is limited to 5000, and every download operation will pop up an operation risk prompt to the user
  • DSS-780 [DSS-DAS] Optimiz result set visualization page display, optimize result set paging sorting, support result set and log part drop-down, support result set table width extension
  • DSS-864 [DSS-Workflow] Add workflow basic property display
  • DSS-724 [DSS-Workflow] Automatically check the workflow mode and workflow mode when creating a new workflow
  • DSS-725 [DSS-Workflow] Add the workflow importance level feature when creating a new workflow
  • DSS-161 [DSS-Workflow] Support the use of runtime variables in datachecker
  • DSS-868 [DSS-Scriptis] Support dragging the code tab to any position
  • DSS-869 [DSS-Scriptis] Support mutual modification of Sql and Hql file types
  • DSS-870 [DSS-Scriptis] Support copy and paste workspace code files
  • DSS-720 [DSS-Scriptis] Support only viewing tables created by yourself
  • DSS-871 [DSS-Commons] Help users clear cache after login
  • DSS-872 [DSS-AppConn] Supplement Update and Delete operations of Schedules AppConn, and add corresponding interfaces

Bugs Fix

  • DSS-650 [DSS-Workspace] Fixed an issue where all 3rd party system items could not be deleted synchronously when deleting an item
  • DSS-594 [DSS-Workspace] Fix the problem of 400 bad request reported in workspace management-user management, editing user interface
  • DSS-873 [DSS-Workspace] Fixed the problem that the user data displayed abnormally on the user management page
  • DSS-601 [DSS-Workspace] Fixed the issue that the drop-down boxes of publish permission, edit permission and view permission on the Create Project page could not obtain all users of the workspace
  • DSS-632 [DSS-Workspace] Fixed the problem that the file directory displayed in the front-end workspace was incorrect after switching the proxy user
  • DSS-874 [DSS-Workspace] Fixed the problem that the interface did not display the visual interface after clicking the visual button
  • DSS-621 [DSS-Workspace] Fix the problem that the script selects right-click to open to the side console and reports an error
  • DSS-875 [DSS-Workspace] Fix the problem of copying and pasting the script to the first opened folder and reporting an error
  • DSS-744 [DSS-Workspace] Fix the problem that other users have abnormal permissions after a user grants permissions to other users after creating a new project
  • DSS-704 [DSS-Workspace] Fix the problem that the project copy function button is not displayed
  • DSS-667 [DSS-Workspace] Fix the problem that the request to the third-party application to check whether the project name is duplicated fails when creating a project
  • DSS-652 [DSS-Workflow] Fix the problem that the eventsender and eventreceiver nodes fail to pass parameters
  • DSS-640 [DSS-Workflow] Fixed the issue that new built-in parameters such as run_year in datachecker did not take effect
  • DSS-759 [DSS-Workflow] Fix the problem that the exported data is disordered or lost when there is a subflow
  • DSS-695 [DSS-Workflow] Fix the issue that sendmail node fails to run
  • DSS-692 [DSS-Workflow] Fix the failure of workflow rollback in the development center
  • DSS-600 [DSS-Workflow] Fix the Failed to async get EngineNode AMErrorException when datachecker, eventsender, eventreceiver nodes are running
  • DSS-605 [DSS-Workflow] Fix the exception that the workflow pause execution interface displays 404
  • DSS-876 [DSS-Workflow] Fixed that when the workflow node right-clicks the key script, the directory cannot display the latest exception
  • DSS-780 [DSS-Workflow] Fix the problem that the result set of the management console is not displayed completely when running a node with a result set
  • DSS-247 [DSS-Workflow] Fix the problem that datachecker fails to run after eventreceiver
  • DSS-877 [DSS-Workflow] Fix the workflow stuck when some nodes have succeeded but the status has not been flipped when the workflow is executed in real time question
  • DSS-632 [DSS-Workflow] Fix the workflow execution failure after the proxy user is set to a non-system username in the real-time execution workflow The problem
  • DSS-607 [DSS-Scriptis] Fix the problem that the workspace fails to import files to HDFS
  • DSS-665 [DSS-Scriptis] Fix the problem of invalid reference to global variables in IDE
  • DSS-635 [DSS-DAS] Fix data service execution failure exception
  • DSS-636 [DSS-DAS] Fix result set download error exception
  • DSS-813 [DSS-DAS] Fixed the issue that when multiple result sets were selected, the page turning of the previous result set would be brought over
  • DSS-878 [DSS-DAS] Fix the problem that the result set in CSV format is displayed without permission
  • DSS-801 [DSS-DAS] Fix the problem that the content of the running log page is incomplete after exporting the result set
  • DSS-620 [DSS-DAS] Fix the exception of visual error when running scripts with result sets
  • DSS-157 [DSS-DAS] Fix result set sorting issue
  • DSS-879 [DSS-Commons] Fix the inconsistency between calling sqoop and script code in shell
  • DSS-880 [DSS-Commons] Fixed the issue that inputting the vi a.txt command on the shell node would cause the script to keep running and the engine is busy
  • DSS-630 [DSS-Commons] Fix interface /api/rest_j/v1/dss/datapipe/backgroundservice to set proxy user to empty The exception that caused the error
  • DSS-625 [DSS-Commons] Fixed hadoop user not giving A user any permissions when creating a project, but A user workspace still displayed Exception for this item
  • DSS-791 [DSS-AppConn] Fixed occasional zip failure when AppConn was started
  • DSS-548 [DSS-Engine] Fix the problem that the running node is displayed as Python 2 after the Python 3 engine is killed

Credits

The release of DSS 1.1.0 is inseparable from the contributors of the DSS community. Thanks to all the community contributors, Including but not limited to the following contributors: rootljw, teenwolf0910, njnu-seafish, luban08, HanTang1, det101, KidUncle, mingfengwang.

Compiled Version

Tencent Cloud:

DSS-1.1.0&Linkis-1.1.1 Compiled package (.tar.gz)

Assets 2