Skip to content

๐ŸŽ A microservice that extracts a .zip file and uploads individual entries

Notifications You must be signed in to change notification settings

itchio/zipserver

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

test

zipserver

Zip server is an HTTP service that takes a key to a zip file on Google Cloud storage, extracts it, then reuploads the individual files to a specified prefix. It can restrict extraction of the zip file based on individual file size, total file size, or number of files.

Usage

Install

go install github.com/itchio/zipserver@latest

zipserver -help

Create a config file:

zipserver.json:

{
	"PrivateKeyPath": "path/to/service/key.pem",
	"ClientEmail": "111111111111@developer.gserviceaccount.com"
}

More config settings can be found in config.go

Run:

$GOPATH/bin/zipserver

Extract a zip file:

curl http://localhost:8090/extract?key=zips/my_file.zip&prefix=extracted

Slurping

You can tell the zip server to download a file from a URL. This can be used to load a zip file you want to extract later.

curl http://localhost:8090/slurp?key=myfile.zip&url=http://leafo.net/file.zip

GCS authentication and permissions

The key file in your config should be the PEM-encoded private key for a service account which has permissions to view and create objects on your chosen GCS bucket.

The bucket needs correct access settings:

  • Public access must be enabled, not prevented.
  • Access control should be set to fine-grained ("legacy ACL"), not uniform.

About

๐ŸŽ A microservice that extracts a .zip file and uploads individual entries

Resources

Stars

Watchers

Forks

Packages

No packages published