Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dev 1.0.2 #951

Merged
merged 18 commits into from
Aug 12, 2021
Merged

Dev 1.0.2 #951

merged 18 commits into from
Aug 12, 2021

Conversation

Fuu3214
Copy link
Contributor

@Fuu3214 Fuu3214 commented Aug 10, 2021 •
edited
Loading

What is the purpose of the change

Linkis-1.0.2 includes all of Project Linkis-1.0.1 and will be merged into our future releases.
Linkis-1.0.2 mainly introduces Flink-support into Linkis ecosystem.

The following feature(s) are added:

  • Flink-engingconn which offers solid support for Flink jobs. Executing, debugging and monitoring Flink SQL or applications are now available, together with SQL-enhancement ability powered by Linkis-Orchestrator.
  • LinkisManagerClient which enables direct access to Linkis-Manager. Submitting and managing once-jobs rely on this feature.

The following bug(s) are fixed:

  • A serial execution bug such that linkis concurrency engine actually performs sequential execution.
  • A redundant thread bug for Concurrent-Executor

Abbreviations:

CGS: Computation Governance Services

Brief change log

Enhancement

  • Linkis-935 [CGS-EnginePlugin-Flink] supports Flink Engine
  • Linkis-936 [CGS-LinkisOnceEngineconn] supports once engine executor
  • Linkis-937 [CGS-LinkisComputationClient] supports once engine executor client
  • Linkis-947 [CGS-EnginePlugin-Flink] supports executing Flink SQL and Flink application
  • Linkis-948 [CGS-EnginePlugin-Flink] multiple-datasource support for Flink Engineconn
  • Linkis-949 [CGS-EnginePlugin-Flink] monitoring Flink Metrics
  • Linkis-953 [CGS-LinkisManager] label supports '-' in hostname

Bug Fixes

  • Linkis-938 [CGS-LimkisMnagager] fixes a serial execution bug
  • Linkis-952 [CGS-linkisEngineconn] fixes a redundant thread bug

Verifying this change

(Please pick either of the following options)
This change is already covered by existing tests.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (no)
  • Anything that affects deployment: (no)
  • The MGS(Microservice Governance Services), i.e., Spring Cloud Gateway, OpenFeign, Eureka.: (no)

Documentation

  • Does this pull request introduce a new feature? (no)
  • If yes, how is the feature documented? (not applicable)

cooperyang and others added 15 commits August 4, 2021 10:23
yangzhiyue
yangzhiyue approved these changes Aug 11, 2021
View reviewed changes
Copy link
Contributor

@yangzhiyue yangzhiyue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thnks for this pr

Fuu3214 and others added 2 commits August 12, 2021 10:19
peacewong
peacewong approved these changes Aug 12, 2021
View reviewed changes
Copy link
Contributor

@peacewong peacewong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

...re/linkis/engineconnplugin/flink/client/deployment/YarnSessionClusterDescriptorAdapter.scala
@@ -0,0 +1,20 @@
package com.webank.wedatasphere.linkis.engineconnplugin.flink.client.deployment
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add license

@peacewong peacewong merged commit 1eacd7b into apache:dev-1.0.2 Aug 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@peacewong peacewong peacewong approved these changes

@yangzhiyue yangzhiyue yangzhiyue approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@Fuu3214 @peacewong @yangzhiyue