Skip to content

Conversation

NicoK
Copy link
Contributor

@NicoK NicoK commented Jul 18, 2017

This should guard us from uploading (and deleting) the same file more than once and also from hash collisions.

This PR is based upon #4358 in a series to implement FLINK-6916.

  • General

    • The pull request references the related JIRA issue ("[FLINK-XXX] Jira title text")
    • The pull request addresses only one issue
    • Each commit in the PR has a meaningful commit message (including the JIRA id)
  • Documentation

    • Documentation has been added for new functionality
    • Old documentation affected by the pull request has been updated
    • JavaDoc for public methods has been added
  • Tests & Build

    • Functionality added by the pull request is covered by tests
    • mvn clean verify has been executed successfully locally or a Travis build has passed

protected final long lowerPart;

/** The memoized value returned by toString() */
/** The memorized value returned by toString() */
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, hey, that was me. I was just thinking about this the other day and how the JobManager used to bottleneck for large jobs when logging and converting these AbstractID to string. Anyway, this original should be the correct spelling: https://en.wikipedia.org/wiki/Memoization

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you're right...learned something today :)

@NicoK NicoK force-pushed the flink-6916-7140 branch 5 times, most recently from fbbdea8 to 0a28e51 Compare July 21, 2017 13:25
@NicoK NicoK force-pushed the flink-6916-7140 branch from 0a28e51 to 77717b6 Compare July 27, 2017 07:58
@NicoK NicoK force-pushed the flink-6916-7140 branch 7 times, most recently from 6c70f46 to 114ce68 Compare August 21, 2017 11:50
@NicoK
Copy link
Contributor Author

NicoK commented Oct 5, 2017

rebased onto the latest #4358

This should guard us from uploading (and deleting) the same file more than
once and also from hash collisions.
Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes look good to me. Thanks for your contribution @NicoK. Will rebase it and once Travis passes, I'll merge it.

tillrohrmann pushed a commit to tillrohrmann/flink that referenced this pull request Oct 13, 2017
This should guard us from uploading (and deleting) the same file more than
once and also from hash collisions.

This closes apache#4359.
@asfgit asfgit closed this in f853f33 Oct 16, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants