It appears the AWS Access Key / Secret fields do not save properly. No matter what I put in the field, they always come back empty. This is true on both the global as well as job-specific settings.
Not sure if related or a different problem, but when trying to use alternative method of injecting environment variables for AWS_ACCESS_KEY and AWS_SECRET_KEY, the plugin does not seem to recognize and use them either.