Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a new module EngineConnPlugin for the Linkis1.0 architecture to simplify the user's implementation of a new Linkis underlying computation storage engine. #576

Closed
wushengyeyouya opened this issue Mar 9, 2021 · 0 comments · Fixed by #595
Closed

Add a new module EngineConnPlugin for the Linkis1.0 architecture to simplify the user's implementation of a new Linkis underlying computation storage engine. #576

wushengyeyouya opened this issue Mar 9, 2021 · 0 comments · Fixed by #595
Labels
component=EngineConnPlugin/Framework type=NewFeature New Feature

Comments

@wushengyeyouya
Copy link
Contributor

Add a new module EngineConnPlugin for the Linkis1.0 architecture. This module is defined to simplify the user's implementation of a new Linkis underlying computation storage engine. It provides the following capabilities:

  1. A separate service that provides interfaces for LinkisManager to obtain the resources when creating an EngineConn.

  2. Provides interfaces for EngineConnManager to prepare the start-up argument information of EngineConn after ECM receives the EngineConnBuilder's requests from LinkisManager.

  3. Be able to load the dependency jars required by the computation storage engine in real time, so those engines, which have been integreted to Linkis don't need to be pre-installed in EngineConnManager machines.

  4. Be able to load the corresponding EngineConnPlugin on demand.
wushengyeyouya added a commit to wushengyeyouya/Linkis that referenced this issue Mar 10, 2021
@wushengyeyouya
### What is the purpose of the change
f534d69 
Related issues: apache#576
Add a new module EngineConnPlugin for the Linkis1.0 architecture. This module is defined to simplify the user's implementation of a new Linkis underlying computation storage engine.

### Brief change log

1. A separate service that provides interfaces for LinkisManager to  obtain the resources when creating an EngineConn.

2. Provides interfaces for EngineConnManager to prepare the start-up argument information of EngineConn after ECM receives the EngineConnBuilder's requests from LinkisManager.

3. Be able to load the dependency jars required by the computation storage engine in real time, so those engines, which have been integreted to Linkis don't need to be pre-installed in EngineConnManager machines.

4. Be able to load the corresponding EngineConnPlugin on demand.
@wushengyeyouya wushengyeyouya mentioned this issue Mar 10, 2021
Merged
@wushengyeyouya wushengyeyouya linked a pull request Mar 11, 2021 that will close this issue
Add a new module EngineConnPlugin for the Linkis1.0 architecture to simplify the user's implementation of a new Linkis underlying computation storage engine. #595
Merged
mayinrain pushed a commit to mayinrain/incubator-linkis that referenced this issue Aug 29, 2024
@v-kkhuang
【1.7.0】fix jobhistory query with code (apache#576)
ffdc21d 
* Resource reset code optimization

* Resource reset code optimization

* Resource johhistory code optimization

* Resource johhistory code optimization

* revent jobhistory: get data

* update isreused

* fix executionCode  error

* Code optimization

* Code optimization

* Code optimization

* Code optimization

* Code optimization

* code review fix

* code review fix

* Fix Security Work Order: Upgrade Spring Version:5.3.27  -> 5.3.34

* Optimize script log address

* SDK interface adds new parameters

* Rollback modification to ensure normal cross cluster functionality

* fix jobhistory query with code

* fix jobhistory query with code

---------

Co-authored-by: “v_kkhuang” <“420895376@qq.com”>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component=EngineConnPlugin/Framework type=NewFeature New Feature
Projects
None yet
Milestone
No milestone
2 participants
@peacewong @wushengyeyouya