Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature-2585][server] Support ssh command #3283

Closed
wants to merge 29 commits into from
Closed

Conversation

peilongwu
Copy link

@peilongwu peilongwu commented Jul 23, 2020

What is the purpose of the pull request

Support execute command on remote server. Only support linux.

Brief change log

  1. Add remote server datasource support.
  2. Update shell task to support execute command on remote datasource

@yangyichao-mango
Copy link
Contributor

Hi,

Please modify the pr title and add the pr content according the specifications[1]. Thx a lot for your good job~
[1] https://dolphinscheduler.apache.org/zh-cn/docs/development/pull-request.html

@peilongwu
Copy link
Author

peilongwu commented Jul 23, 2020 via email

@peilongwu peilongwu changed the title Merge support ssh command [Feature-2585][server] Support ssh command Jul 23, 2020
@peilongwu
Copy link
Author

peilongwu commented Jul 23, 2020 via email


@RunWith(SpringRunner.class)
@SpringBootTest(classes = ApiApplicationServer.class)
public class DataSourceService2Test {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi,
Please add this test to root pom if you introduce this test case.

@yangyichao-mango
Copy link
Contributor

Hi,
I switch to your branch and check the feature.

  1. Remote machine resources may not be suitable for being put with dataSources. And we can talk about the remote machine resource manage place. [1]

If you have any question or suggestion, welcome to put forward.

image

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@yangyichao-mango
Copy link
Contributor

yangyichao-mango commented Jul 24, 2020 via email

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@peilongwu
Copy link
Author

peilongwu commented Jul 24, 2020 via email

@yangyichao-mango
Copy link
Contributor

It has a lot of cases to use many remote serves to execute some shell commands. So I think that we must to design a good method to support this feature. I want to add a new table to manage the remote servers, but many committers feel that this change is too big. They think we can manage remote servers like data sources. So I develop this feature like this.

------------------ 原始邮件 ------------------ 发件人: "apache/incubator-dolphinscheduler" <notifications@github.com>; 发送时间: 2020年7月23日(星期四) 晚上11:09 收件人: "apache/incubator-dolphinscheduler"<incubator-dolphinscheduler@noreply.github.com>; 抄送: "裴龙武"<peilongwu@qq.com>;"Author"<author@noreply.github.com>; 主题: Re: [apache/incubator-dolphinscheduler] [Feature-2585][server] Support ssh command (#3283) Hi, I switch to your branch and check the feature. Remote machine resources may not be suitable for being put with dataSources. And we can talk about the remote machine resource manage place. [1] If you have any question or suggestion, welcome to put forward. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.

I got it.

@yangyichao-mango
Copy link
Contributor

yangyichao-mango commented Jul 24, 2020

Hi,
When I set the password free login, and I do not set the password in the remote server settings, the following error will appear. Do we have to set the password when we want to login in the remote server? In a lot of scene, we already set the password free login. Can you add the password free login to the sshtask?

image
image
image

@davidzollo
Copy link
Contributor

@peilongwu , supporting ssh task will be an important feature, and could you add password free to ssh task? by the way, please solve the conflicting files, thx

Hi,
When I set the password free login, and I do not set the password in the remote server settings, the following error will appear. Do we have to set the password when we want to login in the remote server? In a lot of scene, we already set the password free login. Can you add the password free login to the sshtask?

image
image
image

@davidzollo davidzollo linked an issue Aug 2, 2020 that may be closed by this pull request
@peilongwu
Copy link
Author

@peilongwu , supporting ssh task will be an important feature, and could you add password free to ssh task? by the way, please solve the conflicting files, thx

Hi,
When I set the password free login, and I do not set the password in the remote server settings, the following error will appear. Do we have to set the password when we want to login in the remote server? In a lot of scene, we already set the password free login. Can you add the password free login to the sshtask?
image
image
image

OK, I will perfect this feature in the next time. I was changing job recently. Now I work in a new company and I have times to finish this feature.

@davidzollo
Copy link
Contributor

image

there are some conflict files need to be sovled, please solve it locally, then I will merge into dev, thx

@davidzollo davidzollo added the Waiting for user feedback Waiting for feedback from issue/PR author label Oct 18, 2020
@CalvinKirs
Copy link
Member

no update.

@CalvinKirs CalvinKirs closed this Jul 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
first time contributor First-time contributor Waiting for user feedback Waiting for feedback from issue/PR author
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature]exec shell for remote
4 participants