steveloughran
Follow
Create your own GitHub profile
Sign up for your own profile on GitHub, the best place to host code, manage projects, and build software alongside 50 million developers.
Sign up
Pinned
377 contributions in the last year
Activity overview
Contribution activity
October 2020
Created a pull request in apache/spark that received 11 comments
[SPARK-33230][SQL] Hadoop committers to get unique job ID in "spark.sql.sources.writeJobUUID"
What changes were proposed in this pull request?
This reinstates the old option spark.sql.sources.write.jobUUID to set a unique jobId in the jobcon…
+5
−1
•
11
comments
- HADOOP-17201. eliminate double retry around delete/finishedWrite
- HADOOP-17318. Support concurrent S3A commit jobs slightly better.
- HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients.
- HADOOP-17258. Magic S3Guard Committer to overwrite existing pendingSet file on task commit
- HADOOP-17293. Aways probe S3 when opening/getFileStatus on non-auth paths
- HADOOP-17308. WASB : PageBlobOutputStream succeeding flush even when …
- HADOOP-17191. ABFS: Run the integration tests with various combinations of configurations and publish a consolidated results
- HADOOP-17272. ABFS Streams to support IOStatistics API
- HADOOP-16878. FileUtil.copy() to throw IOException if the source and destination are the same
- HADOOP-17292. Using lz4-java in Lz4Codec
- HADOOP-17258. Magic S3Guard Committer to overwrite existing pendingSet file on task commit
- HDFS-15620. RBF: Fix test failures after HADOOP-17281
- HADOOP-17301. ABFS: Fix bug introduced in HADOOP-16852 which reports read-ahead error back
- HADOOP-17295 Move dedicated pre-logging statements into existing logg…
- HADOOP-17281 Implement FileSystem.listStatusIterator() in S3AFileSystem
- HADOOP-17125. Using snappy-java in SnappyCodec
- HADOOP-17021. Add concat fs command
2
contributions
in private repositories
Oct 8 – Oct 13