-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Serve] [Dashboard] Add serve controller metrics to serve system dashboard page #43797
[Serve] [Dashboard] Add serve controller metrics to serve system dashboard page #43797
Conversation
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Awesome, thanks for getting this out so quickly! The dashboard page looks good. It's a little odd that ray_serve_controller_num_starts, ray_serve_num_scheduling_tasks, and ray_serve_num_scheduling_tasks_in_backoff aren't showing up. ray_serve_controller_num_starts should show up soon after the controller initializes for the first time. ray_serve_num_scheduling_tasks and ray_serve_num_scheduling_tasks_in_backoff should show up after a few requests on a hello world app. Is there any chance that the query is filtering for an incorrect/unexpected tag? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think ray_serve_num_scheduling_tasks, and ray_serve_num_scheduling_tasks_in_backoff are both gauge just happened to set to 0. There actually data in your screenshot :)
ray_serve_controller_num_starts is indeed the odd one that doesn't come with data. Would need to dig into how come it didn't log a metrics on start. Could be a bug in the code somewhere 😕
Thanks for the reviews, I'll update the PR soon. @edoakes any thoughts on other metrics that should be included here? |
Oh nice, this is looking good! Could we please also add |
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Will remove |
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
NP. This is somewhat redundant with the control loop counter anyways |
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
…board page (ray-project#43797) Adds the following Serve controller metrics to the Serve details page on the dashboard: ray_serve_num_ongoing_http_requests ray_serve_num_ongoing_grpc_requests ray_serve_controller_num_starts ray_serve_num_scheduling_tasks ray_serve_num_scheduling_tasks_in_backoff ray_serve_controller_num_control_loops --------- Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
…board page (ray-project#43797) Adds the following Serve controller metrics to the Serve details page on the dashboard: ray_serve_num_ongoing_http_requests ray_serve_num_ongoing_grpc_requests ray_serve_controller_num_starts ray_serve_num_scheduling_tasks ray_serve_num_scheduling_tasks_in_backoff ray_serve_controller_num_control_loops --------- Signed-off-by: Archit Kulkarni <architkulkarni@users.noreply.github.com>
Why are these changes needed?
Adds the following Serve controller metrics to the Serve details page on the dashboard:
#43797 (comment) contains a screenshot.
Related issue number
Closes #35667
Checks
git commit -s
) in this PR.scripts/format.sh
to lint the changes in this PR.method in Tune, I've added it in
doc/source/tune/api/
under thecorresponding
.rst
file.