GAE buildpack is not able to determine zip file without .zip extension

[xSAVIKx]

While deploying GAE standard service with a ZIP archive stored in the GCS I found that it's not capable of determining the archive type properly and just fails after trying to unpack .tar instead of .zip 3 times.

At the same time, GCF buildpack is able to work with the same ZIP archive without any glitches.

I assume the reason behind such behavior is the usage of different buildpacks for GAE and GCF environments. And I assume that GAE uses google.python.webserver to unpack the archive while GCF uses google.utils.archive-source to do the same job.

Can anyone please help me out understanding if that's the case and maybe give a direction on how this can be fixed?

[squee1945]

Can you mention how you're deploying to GAE?

[xSAVIKx]

I'm using Pulumi to deploy the app, but I believe that even with the gcloud cli and a zip archive as a source we'll see the same results.

Pulumi like Terraform uses AppEngine Admin SDK under the hood.

[matthewrobertson]

@xSAVIKx is right, we do fetch the code differently on GAE and GCF. On GAE we use a custom build step that runs the gcs-fetcher. I guess we would need to fix the bug in that image.

[xSAVIKx]

@matthewrobertson, can you please pinpoint where and how we're starting the gcs-fetcher? I'd be glad to jump in and see if I can fix the fetcher, but I have trouble understanding this whole buildpacks/bazel setup and dependencies.

[xSAVIKx]

Just tried again. Here are the logs from Cloud Build build of the App Engine app (it hasn't even started the first pre-buildpacks step):

starting build "241b0b97-e90d-425c-bfe2-f8b8171d2ff6"

FETCHSOURCE
Fetching storage object: gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243
Copying gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243...
/ [0 files][    0.0 B/185.0 KiB]                                                
/ [1 files][185.0 KiB/185.0 KiB]                                                
Operation completed over 1 objects/185.0 KiB.                                    
tar: This does not look like a tar archive
tar: Skipping to next header
gzip: stdin has more than one entry--rest ignored
tar: Child returned status 2
tar: Error is not recoverable: exiting now
Fetching storage object: gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243
Copying gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243...
/ [0 files][    0.0 B/185.0 KiB]                                                
/ [1 files][185.0 KiB/185.0 KiB]                                                
Operation completed over 1 objects/185.0 KiB.                                    
gzip: stdin has more than one entry--rest ignored
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Child returned status 2
tar: Error is not recoverable: exiting now
Fetching storage object: gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243
Copying gs://<PROJECT_ID>/<PROJECT_NAME>-sources-6236cb3#1677879307405243...
/ [0 files][    0.0 B/185.0 KiB]                                                
/ [1 files][185.0 KiB/185.0 KiB]                                                
Operation completed over 1 objects/185.0 KiB.                                    
gzip: stdin has more than one entry--rest ignored
tar: This does not look like a tar archive
tar: Skipping to next header
tar: Child returned status 2
tar: Error is not recoverable: exiting now
ERROR
ERROR: error fetching storage source: generic::unknown: retry budget exhausted (3 attempts): fetching gcs source: unpacking source from gcs: source fetch container exited with non-zero status: 2