Skip to content

scan server metrics from #4458 based on #4459#4461

Merged
EdColeman merged 7 commits intoapache:2.1from
EdColeman:kt_scan_server_metrics
May 3, 2024
Merged

scan server metrics from #4458 based on #4459#4461
EdColeman merged 7 commits intoapache:2.1from
EdColeman:kt_scan_server_metrics

Conversation

@EdColeman
Copy link
Contributor

This PR is based on the changes proposed by @keith-turner in #4458, using the changes in #4459 as the base.

  • includes updated documentation in MetricsProducer
  • includes cache metrics for table metadata cache in sserver (resolves todo)

These changes have not be test yet.

These changes should not be merged until #4459 is complete.

@EdColeman EdColeman requested a review from keith-turner April 15, 2024 12:29
@keith-turner
Copy link
Contributor

@EdColeman I added commit d8b4c66 to #4458 that could be merged into this

@EdColeman EdColeman force-pushed the kt_scan_server_metrics branch from ac6ec88 to ad34474 Compare April 24, 2024 16:58
@EdColeman EdColeman marked this pull request as ready for review April 24, 2024 21:47
@EdColeman
Copy link
Contributor Author

@keith-turner I believe this is up to date with your additions, if not we can add them before merge, This was rebased with the other metric changes so the change-set is more reasonable to review.

Comment on lines +54 to +56
// TODO this counter is a duplicate, already a metrics for this below the scan server... use
// that instead, but look into renaming existing one to indicate scan server
busyCounter = Counter.builder(MetricsProducer.METRICS_SSERVER_BUSY_COUNTER)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The process name in the common tags should differentiate between tserver and sserver.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed in 5dd3c2d

@EdColeman
Copy link
Contributor Author

Changes in 5dd3c2d

  • Renames String METRICS_SCAN_PREFIX from accumulo.tserver.scans. to accumulo.scan. Service type (tserver, sserver) is available in the tags
  • Renames registration to reservation to reflect usage.

@keith-turner
Copy link
Contributor

@EdColeman I was experimenting with these changes and I was not seeing the stats I expected from the cache. Finally figured out that stats have to be enabled when building the cache, so pushed a change to do that in 3660ecd.

I was using MetricsIT to experiment with these changes when trying to figure this out, can see those changes here b3fdae9 if interested.

@EdColeman EdColeman merged commit c488f78 into apache:2.1 May 3, 2024
@EdColeman EdColeman deleted the kt_scan_server_metrics branch May 3, 2024 01:52
@ctubbsii ctubbsii modified the milestones: 3.1.0, 2.1.3 Jul 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants