Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[release] Prepare for release Linkis-1.0.2 #983

Merged
merged 52 commits into from Sep 2, 2021
Merged

[release] Prepare for release Linkis-1.0.2 #983

merged 52 commits into from Sep 2, 2021

Conversation

wushengyeyouya
Copy link
Contributor

What is the purpose of the change

Linkis-1.0.2 includes all of Project Linkis-1.0.2.

This release mainly introduces Flink-support into Linkis ecosystem.

The following key features are added:

  • Flink-engingconn which offers solid support for Flink jobs. Executing, debugging and monitoring Flink SQL or applications are now available, together with SQL-enhancement ability powered by Linkis-Orchestrator.
  • LinkisManagerClient which enables direct access to Linkis-Manager. Submitting and managing once-jobs rely on this feature.

Abbreviations:

CGS: Computation Governance Services

PES: Public Enhancement Services

MGS: Microservice Governance Services

Brief change log

New Feature

EngineConn
  • Linkis-936 [CGS-LinkisOnceEngineconn] supports once engine executor
EnginePlugin
  • Linkis-935 [CGS-EnginePlugin-Flink] supports Flink Engine
  • Linkis-947 [CGS-EnginePlugin-Flink] supports executing Flink SQL and Flink application
  • Linkis-948 [CGS-EnginePlugin-Flink] multiple-datasource support for Flink Engineconn
  • Linkis-949 [CGS-EnginePlugin-Flink] monitoring Flink Metrics
ComputationClient
  • Linkis-937 [CGS-LinkisComputationClient] supports once engine executor client

Enhancement

  • Linkis-953 [CGS-LinkisManager] label supports '-' in hostname
  • Linkis-925 [MGS-LinkisServiceGateway] fix weak password in linkis gateway
  • Linkis-950 [CGS-LinkisEngineconnManager] support both ip address and hostname for service discovery
  • Linkis-967 [CGS-LinkisEntrance] remove instance-label client dependency, Solve the host name and ip judgment abnormality in the gateway router, exclude pentaho-aggdesigner-algorithm module
  • Linkis-963 [PES-LinkisBmlServer] default download user changed to jvm user, and supports configurable default download user

Bugs Fix

  • Linkis-938 [CGS-LimkisMnagager] fixes a serial execution bug
  • Linkis-952 [CGS-LinkisEngineconn] fixes a redundant thread bug
  • Linkis-943 [CGS-EnginePlugin-Hive] fixes a Hive3.0 compilation error
  • Linkis-961 [CGS-EnginePlugin-Flink] fixes a Flink-EnginePlugin compilation bug
  • Linkis-966 [CGS-EnginePlugin-Hive] [CGS-EnginePlugin-Spark] Solve Spark and hive compatibility issue

Verifying this change

(Please pick either of the following options)
This change is already covered by existing tests.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • Anything that affects deployment: no
  • The MGS(Microservice Governance Services), i.e., Spring Cloud Gateway, OpenFeign, Eureka.: no

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? docs

cooperyang and others added 30 commits August 4, 2021 10:23
first commit
b2b554b
添加once-computation-client的代码
6481e1d
修改flink的版本
d56411b
添加onceengine的相关代码
33c0c09
flink代码的相关修改
55ae0c0
添加flink引擎的相关的license
6cf4246
添加once引擎client的相关的license
50639ea
支持并发引擎
4435e90
优化flink引擎的相关内容
59a6e23
Merge branch 'master' of git.weoa.com:cooperyang/mylinkis
8ae1a88
HIVE3.0 编译报错，使用WritableComparable代替具体的实现类接受返回，编译通过
f86df56
@demonray
移除proxyuser
d0a28ed
@demonray
remove useless code
e5fef28
@peacewong
Merge pull request #945 from demonray/dev-1.0.2
c833d4d 
Dev 1.0.2
@lunescode
#946
7ea30a0
@lunescode
#946
36607e3
@Fuu3214
merged dev-1.0.2
9b3c2ad 
closes #935
closes #936
closes #937
closes #947
closes #948
closes #949
fixes #938
@Fuu3214
modified gitignore
1fde192
@Fuu3214
added English language comments
542dd22
@Fuu3214
added English language comments
e26a62f
@Fuu3214
fixed a bug that one thread per concurrent-task rather than per concu…
5816180 
…rrent-task-queue is actually generated for Concurrent Executor

fixes #952
@Fuu3214
1. fixed a small bug
45f961b 
2. support '-' in hostname

closes #953
@peacewong
Update AMConfiguration.scala
d1db126
@peacewong
Update YarnSessionClusterDescriptorAdapter.scala
b2578fe
@peacewong
Merge pull request #951 from Fuu3214/dev-1.0.2
1eacd7b 
Dev 1.0.2
@peacewong
Merge pull request #943 from zosimer/dev-1.0.2
907d971 
Hive3.0 compiles and reports an error. Instead of the specific implementation class, WritableComparable accepts the return, and the compilation passes
@FireFoxAhri
add configuration for admin password, use admin username as default
15e44f9
@peacewong
Merge pull request #925 from FireFoxAhri/dev-1.1.0-924
c8cec90 
fix weak password in linkis gateway
@wanghualei
in ecm plugin Decide eurekaPreferIp by judging a host is valid ip , n…
1f3f9a5 
…ow through read vavlue from Commvars to decide.
@wanghualei
in ecm plugin Decide eurekaPreferIp by judging a host is valid ip , n…
ab494e1 
…ow through read vavlue from Commvars to decide.
peacewong and others added 16 commits August 16, 2021 20:35
@peacewong
Solve compilation problems
fa45b8c
Merge pull request #961 from peacewong/dev-1.0.2
b3f0ef8 
Modify the scala compilation plugin to support JDK8
@peacewong
Optimize BML default download user default jvm user
f404402
@leeebai
Merge pull request #963 from peacewong/dev-1.0.2
0850689 
Optimize BML default download user default jvm user
@peacewong
Solve Spark version compatibility issues
917f743
@peacewong
Solve Hive version compatibility issues
ba6eb88
@Alexkun
Merge pull request #966 from peacewong/dev-1.0.2
d87a821 
Solve the problem of compatibility between Spark and hive versions
@peacewong
remove instance-label client dependency
ae51cd5
@peacewong
exclude pentaho-aggdesigner-algorithm module
99efa0a
@peacewong
Solve the host name and ip judgment abnormality in the gateway router
1525eb4
@Alexkun
Merge pull request #967 from peacewong/dev-1.0.2
93e6cb9 
Optimize gateway/hiveEngineConn/Entrance modules
@wushengyeyouya
Optimize computation client module, add some test classes for new cli…
5466d57 
…ent sdk.
@wushengyeyouya
Optimize computation client module, add some test classes for new cli…
fc0b272 
…ent sdk.
@peacewong
Merge pull request #974 from wushengyeyouya/dev-1.0.2
057f220 
Optimize computation client module, add some test classes for new client SDK.
Update FlinkOnceJobTest.java
02ee70f 
fixed a compilation error
@peacewong
Merge pull request #981 from WeBankFinTech/Fuu3214-dev-1.0.2
92a1608 
Update FlinkOnceJobTest.java
@wushengyeyouya wushengyeyouya added this to In Progress in Linkis1.0.2 Sep 1, 2021
@wushengyeyouya wushengyeyouya moved this from In Progress to Done in Linkis1.0.2 Sep 1, 2021
peacewong
peacewong approved these changes Sep 1, 2021
View reviewed changes
Copy link
Contributor

@peacewong peacewong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

leeebai
leeebai approved these changes Sep 1, 2021
View reviewed changes
Copy link
Member

@leeebai leeebai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Alexkun
Alexkun approved these changes Sep 1, 2021
View reviewed changes
Copy link
Contributor

@Alexkun Alexkun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Adamyuanyuan
Adamyuanyuan approved these changes Sep 1, 2021
View reviewed changes
Copy link

@Adamyuanyuan Adamyuanyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks

Fuu3214
Fuu3214 approved these changes Sep 1, 2021
View reviewed changes
Copy link
Contributor

@Fuu3214 Fuu3214 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

wForget
wForget approved these changes Sep 1, 2021
View reviewed changes
Copy link
Member

@wForget wForget left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@sargentti
Copy link
Contributor

LGTM

@wushengyeyouya wushengyeyouya merged commit f96b41e into master Sep 2, 2021
@peacewong peacewong deleted the dev-1.0.2 branch November 12, 2021 06:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Adamyuanyuan Adamyuanyuan Adamyuanyuan approved these changes

@Alexkun Alexkun Alexkun approved these changes

@sargentti sargentti sargentti approved these changes

@peacewong peacewong peacewong approved these changes

@Fuu3214 Fuu3214 Fuu3214 approved these changes

@wForget wForget wForget approved these changes

@leeebai leeebai leeebai approved these changes

Assignees
No one assigned
Labels
release
Projects
No open projects
Linkis1.0.2
  
Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet