move to upstream code colinmarc/hdfs

[harshavardhana]

Description

move to upstream code colinmarc/hdfs

Motivation and Context

• supports SASL based authentication now
• upgrades to new changes in gokrb library
• implement force delete feature

Fixes #8206

How to test this PR?

Needs CDH6 environment to validate with kerberos

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• Fixes a regression (If yes, please add commit-id or PR # here)
• Documentation needed
• Unit tests needed
• Functional tests needed (If yes, add mint PR # here: )

[minio-trusted]

Mint Automation

Test	Result
mint-xl.sh	✔️
mint-large-bucket.sh	✔️
mint-fs.sh	✔️
mint-dist-xl.sh	✔️
mint-gateway-s3.sh	✔️
mint-gateway-nas.sh	✔️
mint-gateway-azure.sh	❌ more...

9738-77833cd/mint-gateway-azure.sh.log:

Running with
SERVER_ENDPOINT:      minio-dev7.minio.io:30260
ACCESS_KEY:           minioazure
SECRET_KEY:           ***REDACTED***
ENABLE_HTTPS:         0
SERVER_REGION:        us-east-1
MINT_DATA_DIR:        /mint/data
MINT_MODE:            full
ENABLE_VIRTUAL_STYLE: 0

To get logs, run 'docker cp 2643af51f38b:/mint/log /tmp/mint-logs'

(1/15) Running aws-sdk-go tests ... done in 7 seconds
(2/15) Running aws-sdk-java tests ... done in 2 seconds
(3/15) Running aws-sdk-php tests ... done in 29 seconds
(4/15) Running aws-sdk-ruby tests ... done in 15 seconds
(5/15) Running awscli tests ... done in 2 minutes and 10 seconds
(6/15) Running healthcheck tests ... done in 0 seconds
(7/15) Running mc tests ... done in 3 minutes and 15 seconds
(8/15) Running minio-dotnet tests ... done in 1 minutes and 23 seconds
(9/15) Running minio-go tests ... done in 3 minutes and 54 seconds
(10/15) Running minio-java tests ... FAILED in 25 minutes and 39 seconds
error occurred
ErrorResponse(code = BucketNotEmpty, message = The bucket you tried to delete is not empty, bucketName = minio-java-test-32ulofh, objectName = null, resource = /minio-java-test-32ulofh, requestId = 1613A86FE8509ACE, hostId = c7ad2687-7098-4497-aca1-fd21f65feebc)
request={method=DELETE, url=http://minio-dev7.minio.io:30260/minio-java-test-32ulofh, headers=Host: minio-dev7.minio.io:30260
Accept-Encoding: identity
User-Agent: MinIO (amd64; amd64) minio-java/dev
Content-MD5: 1B2M2Y8AsgTpgAmY7PhCfg==
x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
x-amz-date: 20200530T005811Z
Authorization: AWS4-HMAC-SHA256 Credential=*REDACTED*/20200530/us-east-1/s3/aws4_request, SignedHeaders=accept-encoding;content-md5;host;x-amz-content-sha256;x-amz-date, Signature=*REDACTED*
}
response={code=409, headers=Accept-Ranges: bytes
Content-Length: 328
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Server: MinIO/DEVELOPMENT.GOGET
Vary: Origin
X-Amz-Request-Id: 1613A86FE8509ACE
X-Xss-Protection: 1; mode=block
Date: Sat, 30 May 2020 00:58:12 GMT
}

	at io.minio.MinioClient.execute(MinioClient.java:1211)
	at io.minio.MinioClient.execute(MinioClient.java:1236)
	at io.minio.MinioClient.executeDelete(MinioClient.java:1366)
	at io.minio.MinioClient.removeBucket(MinioClient.java:3686)
	at FunctionalTest.teardown(FunctionalTest.java:414)
	at FunctionalTest.runTests(FunctionalTest.java:4122)
	at FunctionalTest.main(FunctionalTest.java:4192)
(10/15) Running minio-js tests ... FAILED in 1 minutes and 51 seconds
{
  "name": "minio-js",
  "function": "fPutObject(bucketName, objectName, filePath, metaData)",
  "args": "bucketName:minio-js-test-66037ad3-8bb6-4bf4-8087-83adcce3e941, objectName:datafile-65-MB, filePath:/tmp/datafile-65-MB",
  "duration": 986,
  "status": "FAIL",
  "error": "Error: read ECONNRESET at TCP.onStreamRead (internal/stream_base_commons.js:205:27)"
}
(10/15) Running minio-py tests ... done in 9 minutes and 42 seconds
(11/15) Running s3cmd tests ... done in 1 minutes and 32 seconds
(12/15) Running s3select tests ... done in 1 minutes and 3 seconds
(13/15) Running security tests ... done in 0 seconds

Executed 13 out of 15 tests successfully.

Deleting image on docker hub
Deleting image locally

[kannappanr]

LGTM