Cannot proceed with delivery: an existing transporter instance is currently uploading this package

[mbarbero]

Sometimes, the services keep alive a CDS instance which prevents any further notarization attempt of the same bundle. The response from the service is

RESPONSE='{"uuid":"18f6c9d3-d697-42af-a7fa-44c0b66b0ff7", 
"notarizationStatus":{"status":"ERROR","message":"Issue happened while uploading file to Apple 
notarization service","moreInfo":"Failed to notarize the requested file. Reason: Cannot proceed 
with delivery: an existing transporter instance is currently uploading this package"}}'

on the notarization machine, here is the stucked process:

/Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/bin/java 
-Djava.ext.dirs=/Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/lib/ext 
-XX:NewSize=2m -Xms32m -XX:NewSize=2m -DWORootDirectory= -DWOLocalRootDirectory= 
-DWOUserDirectory=/usr/local/webservice/eclipse.org/notarization -DWOEnvClassPath= 
-DWOApplicationClass= -DWOPlatform=MacOS -Dcom.webobjects.pid=88372 -Xmx2048m -Xms1024m 
-Djava.awt.headless=true -Dsun.net.http.retryPost=false -Dhttps.protocols=TLSv1.1,TLSv1.2 -Dtransporter.client=altool 
-Dtransporter.client.version=4.00 (1181) -jar ./lib/itmstransporter-launcher.jar -m upload -u <redacted>@eclipse.org 
-vp json -TxHeaders <redacted> -sessionid @env:<redacted> -sharedsecret @env:<redacted> 
-f /tmp/macos-notarization-service/pending-files/eclipse-rcp-2021-06-R-macosx-cocoa-x86_64-6018569964121664258-xcrun-notarize-app-2192338967387698589/D86F7639-49A8-4B14-B1E8-75A087D7F058/eclipse-rcp-2021-06-R.itmsp 
-indicator true -v eXtreme -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181)

[mbarbero]

Once again, I see some zombies CDS

svcuser           16574   0.0  2.2  7925836 182072   ??  S     1:43PM   0:27.25 /Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/bin/java -Djava.ext.dirs=/Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/lib/ext -XX:NewSize=2m -Xms32m -XX:NewSize=2m -DWORootDirectory= -DWOLocalRootDirectory= -DWOUserDirectory=/usr/local/webservice/eclipse.org/notarization -DWOEnvClassPath= -DWOApplicationClass= -DWOPlatform=MacOS -Dcom.webobjects.pid=16574 -Xmx2048m -Xms1024m -Djava.awt.headless=true -Dsun.net.http.retryPost=false -Dhttps.protocols=TLSv1.1,TLSv1.2 -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181) -jar ./lib/itmstransporter-launcher.jar -m upload -u mac.developer@eclipse.org -vp json -TxHeaders eyJqZW5nYSI6dHJ1ZX0= -sessionid @env:CE91DE20-A63D-4DA6-89B8-CD91C752C20A -sharedsecret @env:DBDD1A0D-3416-4D0A-8FA8-33441DD715AA -f /tmp/macos-notarization-service/pending-files/eclipse-rcp-2021-09-M3-macosx-cocoa-x86_64-8690948417419159031-xcrun-notarize-app-5386341375380398552/E5EF7943-6C32-4B52-932C-9B061D937417/eclipse-rcp-2021-09-M3.itmsp -indicator true -v eXtreme -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181)
svcuser           16368   0.0  1.3  7926968 110424   ??  S     1:42PM   0:28.31 /Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/bin/java -Djava.ext.dirs=/Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/lib/ext -XX:NewSize=2m -Xms32m -XX:NewSize=2m -DWORootDirectory= -DWOLocalRootDirectory= -DWOUserDirectory=/usr/local/webservice/eclipse.org/notarization -DWOEnvClassPath= -DWOApplicationClass= -DWOPlatform=MacOS -Dcom.webobjects.pid=16368 -Xmx2048m -Xms1024m -Djava.awt.headless=true -Dsun.net.http.retryPost=false -Dhttps.protocols=TLSv1.1,TLSv1.2 -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181) -jar ./lib/itmstransporter-launcher.jar -m upload -u mac.developer@eclipse.org -vp json -TxHeaders eyJqZW5nYSI6dHJ1ZX0= -sessionid @env:29319CC9-8464-4F06-AE00-B985AB858C4A -sharedsecret @env:FD6A4639-B5BC-4A7A-A78D-0DE7254AF5FE -f /tmp/macos-notarization-service/pending-files/eclipse-jee-2021-09-M3-macosx-cocoa-x86_64-1463153427852419381-xcrun-notarize-app-3452589060038267252/12B06DB5-78F0-4A8C-8431-23CD344B4AA6/eclipse-jee-2021-09-M3.itmsp -indicator true -v eXtreme -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181)
svcuser           14853   0.0  2.4  7934304 198944   ??  S     1:30PM   0:37.07 /Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/bin/java -Djava.ext.dirs=/Applications/Xcode.app/Contents/SharedFrameworks/ContentDeliveryServices.framework/Versions/A/itms/java/lib/ext -XX:NewSize=2m -Xms32m -XX:NewSize=2m -DWORootDirectory= -DWOLocalRootDirectory= -DWOUserDirectory=/usr/local/webservice/eclipse.org/notarization -DWOEnvClassPath= -DWOApplicationClass= -DWOPlatform=MacOS -Dcom.webobjects.pid=14853 -Xmx2048m -Xms1024m -Djava.awt.headless=true -Dsun.net.http.retryPost=false -Dhttps.protocols=TLSv1.1,TLSv1.2 -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181) -jar ./lib/itmstransporter-launcher.jar -m upload -u mac.developer@eclipse.org -vp json -TxHeaders eyJqZW5nYSI6dHJ1ZX0= -sessionid @env:A51AA2C5-B0F3-47A7-AB3E-279A8F1209D4 -sharedsecret @env:5FFD60AB-BCAD-4F03-9E16-C39B0E69EBE6 -f /tmp/macos-notarization-service/pending-files/eclipse-php-2021-09-M3-macosx-cocoa-x86_64-4001517220800271495-xcrun-notarize-app-2985122397963811787/FEA8749D-C7B3-4869-AA20-3CDD33B138DE/eclipse-php-2021-09-M3.itmsp -indicator true -v eXtreme -Dtransporter.client=altool -Dtransporter.client.version=4.00 (1181)

Those java processes are started by xcrun that we spawn from the webservice. xcrun processes are properly terminated, but it seems that xcrun does not terminate its children properly.

We should investigate ProcessHandle API and more specifically ProcessHandle#descendants and kill all children, recursively.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[jonahgraham]

@mbarbero its been a while since this last happened, but I am getting this error again today. Can you give it the appropriate kick when you get a chance. https://ci.eclipse.org/packaging/job/notarize-downloads/128/console

15:09:15 Notarization failed: {"uuid":"09c87cde-2bdd-418b-b559-58996f1d3501","notarizationStatus":{"status":"ERROR","message":"Issue happened while uploading file to Apple notarization service","moreInfo":"Failed to notarize the requested file. Reason: Cannot proceed with delivery: an existing transporter instance is currently uploading this package"}}

[mbarbero]

I don't see the usual suspects alive on the machines. Would you mind trying again?

[jonahgraham]

It worked this time. I think this is Bug 571669 then. I'll add a comment there.

[jonahgraham]

It worked this time. I think this is Bug 571669 then. I'll add a comment there.

Done Bug 571669 Comment 51

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.