Skip to content

Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)

License

Notifications You must be signed in to change notification settings

spark-all/winutils

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

winutils

Windows binaries for Hadoop versions

These are built directly from the same git commit used to create the official ASF releases; they are checked out and built on a windows VM which is dedicated purely to testing Hadoop/YARN apps on Windows. It is not a day-to-day used system so is isolated from driveby/email security attacks.

Note that I am a Hadoop committer: I have nothing to gain by creating malicious versions of these binaries. If I wanted to run anything on your systems, I'd be able to add the code into Hadoop itself, or its build process.

I'm moving to gpg -armor signing of binaries; the GPG key used is on the MIT key server

release process

in hadoop-trunk

Check out the git commit ID voted on as the final release of the ASF artifacts.

mvn clean
mvn package -Pdist -Dmaven.javadoc.skip=true -DskipTests

This creates a distribution, with the native binaries under hadoop-dist\target

  1. create dir winutils/$VERSION
  2. copy bin* to winutils/$VERSION
  3. rm stuff you don't want
  4. add the rest
  5. GPG sign, add .ASC files.
  6. commit
  7. push

About

Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 51.9%
  • Batchfile 47.2%
  • PowerShell 0.9%