Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KAFKA-15293 Add documentation for tiered storage metrics #14331

Merged
merged 5 commits into from Sep 5, 2023
Merged

KAFKA-15293 Add documentation for tiered storage metrics #14331

Changes from 2 commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
85a39c1
Add documentation for tiered storage metrics
abhijeetk88 Sep 4, 2023
bc22036
Review comments
abhijeetk88 Sep 4, 2023
9e30536
Review comments
abhijeetk88 Sep 5, 2023
48577a2
Fix names
abhijeetk88 Sep 5, 2023
724c55f
More fixes
abhijeetk88 Sep 5, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
45 changes: 45 additions & 0 deletions docs/ops.html
View file
Open in desktop
Expand Up @@ -1545,6 +1545,51 @@ <h4 class="anchor-heading"><a id="remote_jmx" class="anchor-link"></a><a href="#
<td>kafka.server:type=BrokerTopicMetrics,name=BytesRejectedPerSec,topic=([-.\w]+)</td>
<td>Rejected byte rate per topic, due to the record batch size being greater than max.message.bytes configuration. Omitting 'topic=(...)' will yield the all-topic rate.</td>
</tr>
<tr>
satishd marked this conversation as resolved.
Show resolved Hide resolved
<td>The number of bytes read from remote storage per second</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteFetchBytesPerSec,topic=([-.\w]+)</td>
<td>Rate of bytes read from remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>The number of remote storage read requests per second.</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteFetchRequestsPerSec,topic=([-.\w]+)</td>
<td>Rate of read requests from remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>The number of remote storage read errors per second.</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteFetchErrorsPerSec,topic=([-.\w]+)</td>
<td>Rate of read errors from remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>The number of bytes copied to remote storage per second.</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteCopyBytesPerSec,topic=([-.\w]+)</td>
<td>Rate of bytes copied to remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>The number of remote storage write requests per second</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteCopyRequestsPerSec,topic=([-.\w]+)</td>
<td>Rate of write requests to remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>The number of remote storage write errors per second.</td>
<td>kafka.server:type=BrokerTopicMetrics,name=RemoteCopyErrorsPerSec,topic=([-.\w]+)</td>
<td>Rate of write errors from remote storage per topic. Omitting 'topic=(...)' will yield the all-topic rate</td>
</tr>
<tr>
<td>Number of remote storage read tasks pending for execution</td>
<td>kafka.log.remote:type=RemoteLogManager,name=RemoteLogReaderTaskQueueSize</td>
divijvaidya marked this conversation as resolved.
Show resolved Hide resolved
<td>Size of the queue holding remote storage read tasks</td>
</tr>
<tr>
<td>Average idle percent of the remote storage reader thread pool</td>
<td>org.apache.kafka.storage.internals.log:type=RemoteStorageThreadPool,name=RemoteLogReaderAvgIdlePercent</td>
<td>Average idle percent of thread pool for processing remote storage read tasks</td>
</tr>
<tr>
<td>Average idle percent of RemoteLogManager thread pool</td>
<td>org.apache.kafka.storage.internals.log:type=RemoteStorageThreadPool,name=RemoteLogManagerTasksAvgIdlePercent</td>
divijvaidya marked this conversation as resolved.
Show resolved Hide resolved
<td>Average idle percent of thread pool for copying data to remote storage</td>
</tr>
<tr>
<td>Message validation failure rate due to no key specified for compacted topic</td>
<td>kafka.server:type=BrokerTopicMetrics,name=NoKeyCompactedTopicRecordsPerSec</td>
Expand Down