Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: taskmanager kubernetes watch job status and support hadoop #3157

Conversation

tobegit3hub
Copy link
Collaborator

@tobegit3hub tobegit3hub commented Mar 22, 2023

  • Watch k8s job status and update internal table, support blocking mode
  • Support hadoop config in kubernetes mode

Usage:

Create k8s hadoop configmap.

kubectl create configmap hadoop-config --from-file=/Users/tobe/software/2023_hadoop/hadoop-3.3.4/etc/hadoop_simple/

You can update the configmap by add config in taskmanager.properties.

k8s.hadoop.configmap=hadoop-config

@tobegit3hub tobegit3hub self-assigned this Mar 22, 2023
@github-actions github-actions bot added the task-manager openmldb taskmanager label Mar 22, 2023
@codecov
Copy link

codecov bot commented Mar 22, 2023

Codecov Report

Patch coverage has no change and project coverage change: -0.04 ⚠️

Comparison is base (363096d) 75.69% compared to head (81574ba) 75.65%.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #3157      +/-   ##
============================================
- Coverage     75.69%   75.65%   -0.04%     
  Complexity      393      393              
============================================
  Files           675      677       +2     
  Lines        125023   125329     +306     
  Branches       1139     1177      +38     
============================================
+ Hits          94631    94819     +188     
- Misses        30156    30274     +118     
  Partials        236      236              
Impacted Files Coverage Δ
...openmldb/taskmanager/config/TaskManagerConfig.java 0.00% <0.00%> (ø)
...nmldb/taskmanager/server/impl/TaskManagerImpl.java 0.00% <0.00%> (ø)
...adigm/openmldb/taskmanager/k8s/K8sJobManager.scala 0.00% <0.00%> (ø)

... and 33 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@dl239
Copy link
Collaborator

dl239 commented Mar 31, 2023

please add relevant docs

@tobegit3hub tobegit3hub merged commit 4f1294c into 4paradigm:main Apr 3, 2023
@lqy222 lqy222 mentioned this pull request May 8, 2023
@lumianph lumianph added the alpha this feature is not fully tested or functional label May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
alpha this feature is not fully tested or functional task-manager openmldb taskmanager
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants