[services] update azure-storage-blob 12.22.0 to mitigate "Stream is already closed"

[danking]

Fixes #12976

I do not fully understand the Azure git tagging scheme, but this commit appears to have made close idempotent. It was merged in June of 2022. That commit resolved an issue reporting an error very similar to our own.

All the azure version changes update the Azure packages to their latest versions as of 2023-05-09 1713 ET.

Unfortunately, newer Azure versions and Spark 3.3.0 have inconsistent io.netty requirements. Spark is stuck back in February 2022. Spark 3.4.0 does support a compatible version of io.netty, but we're months from seeing that in Dataproc.

This change packages up Azure and all its dependencies into one JAR of relocated classes. We must refer to those classes by their relocated names.

[danking]

https://batch.azure.hail.is/batches/3834432/jobs/1

I feel close but its still not working. Now I'm getting some signature mismatch from the server.

[danking]

I have no idea what this means

Caused by: is.hail.shadedazure.com.azure.storage.blob.models.BlobStorageException: If you are using a StorageSharedKeyCredential, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate method call.
If you are using a SAS token, and the server returned an error message that says 'Signature did not match', you can compare the string to sign with the one generated by the SDK. To log the string to sign, pass in the context key value pair 'Azure-Storage-Log-String-To-Sign': true to the appropriate generateSas method call.
Please remember to disable 'Azure-Storage-Log-String-To-Sign' before going to production as this string can potentially contain PII.
Status code 403, (empty body)

[danking]

The suppressed message is:

	Suppressed: java.lang.Exception: #block terminated with an error
		at is.hail.shadedazure.reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99)
		at is.hail.shadedazure.reactor.core.publisher.Mono.block(Mono.java:1742)
		at is.hail.shadedazure.com.azure.storage.common.implementation.StorageImplUtils.blockWithOptionalTimeout(StorageImplUtils.java:133)
		at is.hail.shadedazure.com.azure.storage.blob.specialized.BlobClientBase.getPropertiesWithResponse(BlobClientBase.java:1379)
		at is.hail.shadedazure.com.azure.storage.blob.specialized.BlobClientBase.getProperties(BlobClientBase.java:1348)
		at is.hail.io.fs.AzureStorageFS.$anonfun$openNoCompression$1(AzureStorageFS.scala:223)
		at is.hail.io.fs.AzureStorageFS.$anonfun$handlePublicAccessError$1(AzureStorageFS.scala:175)
		at is.hail.services.package$.retryTransientErrors(package.scala:124)
		at is.hail.io.fs.AzureStorageFS.handlePublicAccessError(AzureStorageFS.scala:174)
		at is.hail.io.fs.AzureStorageFS.openNoCompression(AzureStorageFS.scala:220)
		at is.hail.io.fs.RouterFS.openNoCompression(RouterFS.scala:20)
		at is.hail.io.fs.FS.openNoCompression(FS.scala:322)
		at is.hail.io.fs.FS.openNoCompression$(FS.scala:322)
		at is.hail.io.fs.RouterFS.openNoCompression(RouterFS.scala:3)
		at is.hail.backend.service.ServiceBackendSocketAPI2$.$anonfun$main$3(ServiceBackend.scala:459)
		at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
		at is.hail.services.package$.retryTransientErrors(package.scala:124)
		at is.hail.backend.service.ServiceBackendSocketAPI2$.main(ServiceBackend.scala:459)
		at is.hail.backend.service.Main$.main(Main.scala:15)
		at is.hail.backend.service.Main.main(Main.scala)
		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.lang.reflect.Method.invoke(Method.java:498)
		at is.hail.JVMEntryway$1.run(JVMEntryway.java:119)
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
		... 1 more

[danking]

Oh shit this just means my service account can't write to this bucket.

[danking]

🤦

C