Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-8324] [kafka] Expose another offsets metrics by using new metric API to specify user defined variables #5214

Closed
wants to merge 2 commits into from

Conversation

tony810430
Copy link
Contributor

What is the purpose of the change

Add two metrics for current offsets and committed offsets by using new metric API, which can define user scope variables.

Brief change log

  • add two metrics for current offsets and committed offsets

Verifying this change

This change is a trivial rework / code cleanup without any test coverage.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not documented

@tzulitai
Copy link
Contributor

tzulitai commented Jan 10, 2018

Good idea. I think we should also update the metrics doc to educate this addition.
https://ci.apache.org/projects/flink/flink-docs-release-1.4/monitoring/metrics.html#connectors

@tony810430
Copy link
Contributor Author

@tzulitai Have updated the metrics doc.

@tzulitai
Copy link
Contributor

Thanks for the PR @tony810430. The changes LGTM, will merge this a bit later.

tzulitai added a commit to tzulitai/flink that referenced this pull request Jan 12, 2018
… should not be touched

This commit consolidates all metrics related constant string names in a
KafkaConsumerMetricConstants class, to give a better overview code-wise
which metrics are exported.

That makes it more clear in the code which metrics are kept for
compatibility reasons. It also additionally states that metric names
should not be changed, otherwise metrics compatibility will be broken.

This closes apache#5214.
@asfgit asfgit closed this in 82a9ae5 Jan 12, 2018
@tony810430 tony810430 deleted the FLINK-8324 branch January 12, 2018 20:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants