Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

get task runtime configs tracked in Helix #9540

Merged
merged 2 commits into from Oct 6, 2022

Conversation

klsince
Copy link
Contributor

@klsince klsince commented Oct 5, 2022

Added a restful API to get task runtime configs like concurrencyPerWorker and taskTimeout. Note that those are not inside the subtasks' configs. Also refine some logs found useful when debugging minion related APIs.

Release Note

/tasks/task/{taskName}/runtime/config: a new restful API added on controller to get task runtime configs like subtask concurrency per worker and task timeout

@codecov-commenter
Copy link

Codecov Report

Merging #9540 (7fbcf64) into master (c145ac8) will decrease coverage by 6.16%.
The diff coverage is 8.69%.

@@             Coverage Diff              @@
##             master    #9540      +/-   ##
============================================
- Coverage     69.86%   63.69%   -6.17%     
- Complexity     4795     4848      +53     
============================================
  Files          1927     1874      -53     
  Lines        102697   100401    -2296     
  Branches      15586    15317     -269     
============================================
- Hits          71747    63951    -7796     
- Misses        25878    31741    +5863     
+ Partials       5072     4709     -363     
Flag Coverage Δ
integration1 ?
integration2 ?
unittests1 67.26% <ø> (+0.04%) ⬆️
unittests2 15.59% <8.69%> (+0.04%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...roller/api/resources/PinotTaskRestletResource.java 0.00% <0.00%> (-2.99%) ⬇️
...troller/helix/core/minion/ClusterInfoAccessor.java 37.93% <0.00%> (-41.38%) ⬇️
...lix/core/minion/PinotHelixTaskResourceManager.java 14.03% <0.00%> (-28.05%) ⬇️
...pache/pinot/minion/event/MinionEventObservers.java 87.09% <40.00%> (-2.56%) ⬇️
...va/org/apache/pinot/core/routing/RoutingTable.java 0.00% <0.00%> (-100.00%) ⬇️
...va/org/apache/pinot/common/config/NettyConfig.java 0.00% <0.00%> (-100.00%) ⬇️
...a/org/apache/pinot/common/metrics/MinionMeter.java 0.00% <0.00%> (-100.00%) ⬇️
...g/apache/pinot/common/metrics/ControllerMeter.java 0.00% <0.00%> (-100.00%) ⬇️
.../apache/pinot/common/metrics/BrokerQueryPhase.java 0.00% <0.00%> (-100.00%) ⬇️
.../apache/pinot/common/metrics/MinionQueryPhase.java 0.00% <0.00%> (-100.00%) ⬇️
... and 433 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor comments

@Jackie-Jiang Jackie-Jiang merged commit 1c202c7 into apache:master Oct 6, 2022
@Jackie-Jiang Jackie-Jiang added the release-notes Referenced by PRs that need attention when compiling the next release notes label Oct 6, 2022
@klsince klsince deleted the api_for_task_runtime_config branch October 6, 2022 21:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-notes Referenced by PRs that need attention when compiling the next release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants