Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support yarn-client and yarn-cluster for YarnApplicationOperation #4786

Closed
wants to merge 1 commit into from

Conversation

turboFei
Copy link
Member

@turboFei turboFei commented May 5, 2023

Why are the changes needed?

The spark master might be yarn-client and yarn-cluster

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

@turboFei
Copy link
Member Author

turboFei commented May 5, 2023

yarn-client and yarn-cluster are removed since apache/spark#25684.

But for kyuubi batch, we still support spark-2.3, so I think that this pr is still needed. cc @pan3793

@turboFei turboFei self-assigned this May 5, 2023
@codecov-commenter
Copy link

Codecov Report

Merging #4786 (accab6b) into master (dcb444e) will decrease coverage by 0.03%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master    #4786      +/-   ##
============================================
- Coverage     57.96%   57.93%   -0.03%     
  Complexity       13       13              
============================================
  Files           581      581              
  Lines         32459    32458       -1     
  Branches       4313     4312       -1     
============================================
- Hits          18816    18806      -10     
- Misses        11835    11840       +5     
- Partials       1808     1812       +4     
Impacted Files Coverage Δ
...kyuubi/engine/KubernetesApplicationOperation.scala 17.85% <0.00%> (+0.15%) ⬆️
...pache/kyuubi/engine/YarnApplicationOperation.scala 57.33% <0.00%> (ø)

... and 7 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@turboFei turboFei added this to the v1.8.0 milestone May 5, 2023
@turboFei turboFei closed this in 07e26a8 May 5, 2023
turboFei added a commit that referenced this pull request May 5, 2023
…onOperation

### _Why are the changes needed?_

The spark master might be yarn-client and yarn-cluster
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #4786 from turboFei/yarn_client_cluster.

Closes #4786

accab6b [fwang12] Support yarn-client and yarn-cluster

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
(cherry picked from commit 07e26a8)
Signed-off-by: fwang12 <fwang12@ebay.com>
@turboFei turboFei modified the milestones: v1.8.0, v1.7.1 May 5, 2023
@turboFei
Copy link
Member Author

turboFei commented May 5, 2023

thanks, merged to master and branch-1.7

@turboFei turboFei deleted the yarn_client_cluster branch May 5, 2023 02:08
@turboFei turboFei modified the milestones: v1.7.1, v1.7.2 May 5, 2023
pan3793 pushed a commit to pan3793/kyuubi that referenced this pull request May 12, 2023
…licationOperation

### _Why are the changes needed?_

The spark master might be yarn-client and yarn-cluster
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [x] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request

Closes apache#4786 from turboFei/yarn_client_cluster.

Closes apache#4786

accab6b [fwang12] Support yarn-client and yarn-cluster

Authored-by: fwang12 <fwang12@ebay.com>
Signed-off-by: fwang12 <fwang12@ebay.com>
(cherry picked from commit 07e26a8)
Signed-off-by: fwang12 <fwang12@ebay.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants