-
Notifications
You must be signed in to change notification settings - Fork 1
Home
AWSBootStrapper is a set of python scripts for automating EC2 and S3 tasks. This script is based on (and requires) the boto3 package.
When running this script locally it derives AWS permissions from your AWS access key
In windows setting the environment variables “AWS_ACCESS_KEY_ID” and “AWS_SECRET_ACCESS_KEY” with the values for your AWS access key will allow boto3 to interact with AWS using your credentials.
uploader.py --manifest ./manifest.json --localWorkingDir ./temp
The documents for upload referenced in the manifest, and the manifest itself, are uploaded to AWS S3. The specified localWorkingDir is used to create temp files for compressing documents.
launcher.py --manifest ./manifest.json --instanceConfigPath ./instanceConfig.json --localWorkingDir ./temp
All instances enumerated in the manifest are created and started. All instances are configured using values in instanceConfig.json, and instance specific commands, such as documents to download, and jobs to run are specified in manifest.json
downloader.py --manifest ./manifest.json --instanceConfigPath ./instanceConfig.json --localWorkingDir ./temp
The documents for download referenced in the manifest, are downloaded from AWS S3 to the local paths specified for each document. The specified localWorkingDir is used to unpack compressed files before copying to the final path.
The manifest file describes the instance commands to run and S3 documents. The path to this file is one of 2 arguments to the scripts in awsbootstrapper. documentation
The instance config file contains boto3 configuration for launching instances via the boto3 create_instances command