Skip to content

Draft 001: A zero rename committer

Pre-release
Pre-release
Compare
Choose a tag to compare
@steveloughran steveloughran released this 04 Jan 22:18
· 14 commits to master since this release
tag_draft_001
2cc7629
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

First public draft.

a_zero_rename_committer.pdf

Too verbose, under proof-checked, algorithms rendering but not reviewed, proofs badly argued and doesn't include any benchmarks.

One thing I'd like early comments on is actually my descriptions/illustrations of both the Hadoop and Spark commit protocols. I've stepped through a lot of the Hadoop one (it's how you understand the FileOutputCommitter algorithms after all, but the Spark one more from IDE archaeology. Jackson versions are stopping me bringing up the new committers in the IDE there, at least for now.

Assets 2
Loading