Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-13152][CORE] Fix task metrics deprecation warning #11056

Conversation

holdenk
Copy link
Contributor

@holdenk holdenk commented Feb 3, 2016

Make an internal non-deprecated version of incBytesRead and incRecordsRead so we don't have unecessary deprecation warnings in our build.

Right now incBytesRead and incRecordsRead are marked as deprecated and for internal use only. We should make private[spark] versions which are not deprecated and switch to those internally so as to not clutter up the warning messages when building.

cc @andrewor14 who did the initial deprecation

…sRead so we don't have unecessary deprecation warnings in our build.
@holdenk holdenk changed the title [SPARK-13152] Fix task metrics deprecation warning [SPARK-13152][CORE] Fix task metrics deprecation warning Feb 3, 2016
@holdenk
Copy link
Contributor Author

holdenk commented Feb 3, 2016

also cc @srowen who was interested

@@ -81,10 +81,14 @@ class InputMetrics private (
*/
def readMethod: DataReadMethod.Value = DataReadMethod.withName(_readMethod.localValue)

// Once incBytesRead & intRecordsRead is ready to be removed from the public API
// we can remove the internal versions and make the previous public API private.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add that this is to suppress warnings?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done :)

@andrewor14
Copy link
Contributor

LGTM

@SparkQA
Copy link

SparkQA commented Feb 3, 2016

Test build #50677 has finished for PR 11056 at commit e2d518b.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14
Copy link
Contributor

retest this please

@SparkQA
Copy link

SparkQA commented Feb 3, 2016

Test build #50683 has finished for PR 11056 at commit 1076946.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Feb 4, 2016

Test build #50692 has finished for PR 11056 at commit 1076946.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@andrewor14
Copy link
Contributor

Merged into master

@asfgit asfgit closed this in a8e2ba7 Feb 4, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants