Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cluster and bucket replication metrics in metrics-v3 #19546

Merged
merged 15 commits into from
May 23, 2024

Conversation

anjalshireesh
Copy link
Contributor

@anjalshireesh anjalshireesh commented Apr 18, 2024

Community Contribution License

All community contributions in this pull request are licensed to the project maintainers
under the terms of the Apache 2 license.
By creating this pull request I represent that I have the right to license the
contributions to the project maintainers under the Apache 2 license.

Description

endpoint: /minio/metrics/v3/replication
metrics:

  • average_active_workers
  • average_queued_bytes
  • average_queued_count
  • average_data_transfer_rate
  • current_active_workers
  • current_data_transfer_rate
  • last_minute_queued_bytes
  • last_minute_queued_count
  • max_active_workers
  • max_queued_bytes
  • max_queued_count
  • max_data_transfer_rate

endpoint: /minio/metrics/v3/bucket/replication metrics:

  • last_hour_failed_bytes
  • last_hour_failed_count
  • last_minute_failed_bytes
  • last_minute_failed_count
  • latency_ms
  • proxied_delete_tagging_requests_total
  • proxied_get_requests_failures
  • proxied_get_requests_total
  • proxied_get_tagging_requests_failures
  • proxied_get_tagging_requests_total
  • proxied_head_requests_failures
  • proxied_head_requests_total
  • proxied_put_tagging_requests_failures
  • proxied_put_tagging_requests_total
  • sent_bytes
  • sent_count
  • total_failed_bytes
  • total_failed_count
  • proxied_delete_tagging_requests_failures

Motivation and Context

https://github.com/miniohq/engineering/issues/1510

How to test this PR?

curl "http(s)://<host:port>/minio/metrics/v3/bucket/replication/<bucket>"
curl "http(s)://<host:port>/minio/metrics/v3/replication"

Should return the new replication related metrics

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Optimization (provides speedup with no functional changes)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • Fixes a regression (If yes, please add commit-id or PR # here)
  • Unit tests added/updated
  • Internal documentation updated
  • Create a documentation update request here

@anjalshireesh anjalshireesh force-pushed the metrics-v3-replication branch 3 times, most recently from 51ebac7 to 5e2021d Compare April 18, 2024 16:49
@anjalshireesh anjalshireesh marked this pull request as ready for review April 18, 2024 17:00
@anjalshireesh anjalshireesh force-pushed the metrics-v3-replication branch 3 times, most recently from 9025e25 to 17bd3b8 Compare April 29, 2024 13:18
@donatello donatello requested a review from poornas May 1, 2024 21:45
@anjalshireesh anjalshireesh force-pushed the metrics-v3-replication branch 3 times, most recently from 954544a to 84ba7ed Compare May 3, 2024 09:34
@shtripat
Copy link
Contributor

shtripat commented May 6, 2024

Are we still using query string based endpoints? description of PR may need changes.

@anjalshireesh
Copy link
Contributor Author

Are we still using query string based endpoints? description of PR may need changes.

@shtripat updated the description with bucket-as-path-component based endpoint. PTAL.

Copy link
Contributor

@shtripat shtripat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

endpoint: /minio/metrics/v3/cluster/replication
metrics:
- average_active_workers
- average_queued_bytes
- average_queued_count
- average_transfer_rate
- current_active_workers
- current_transfer_rate
- last_minute_queued_bytes
- last_minute_queued_count
- max_active_workers
- max_queued_bytes
- max_queued_count
- max_transfer_rate
- recent_backlog_count

endpoint: /minio/metrics/v3/api/bucket/replication
metrics:
- last_hour_failed_bytes
- last_hour_failed_count
- last_minute_failed_bytes
- last_minute_failed_count
- latency_ms
- proxied_delete_tagging_requests_total
- proxied_get_requests_failures
- proxied_get_requests_total
- proxied_get_tagging_requests_failures
- proxied_get_tagging_requests_total
- proxied_head_requests_failures
- proxied_head_requests_total
- proxied_put_tagging_requests_failures
- proxied_put_tagging_requests_total
- sent_bytes
- sent_count
- total_failed_bytes
- total_failed_count
- proxied_delete_tagging_requests_failures
@harshavardhana harshavardhana merged commit 7981509 into minio:master May 23, 2024
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants