New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(custom-file-in-bucket): Custom file names are also support for S3 output. #1129
Merged
jfagoagas
merged 2 commits into
master
from
PRWLR-456-allow-prowler-to-use-f-custom-file-name-extension-and-d-custom-bucket
May 11, 2022
Merged
fix(custom-file-in-bucket): Custom file names are also support for S3 output. #1129
jfagoagas
merged 2 commits into
master
from
PRWLR-456-allow-prowler-to-use-f-custom-file-name-extension-and-d-custom-bucket
May 11, 2022
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jfagoagas
requested changes
May 9, 2022
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Check comments and inspect the following:
copyToS3() {
# Prowler will copy each format to its own folder in S3, that is for better handling
# and processing by Quicksight or others.
# Also, check if -F was introduced
if [ -n "${OUTPUT_FILE_NAME+x}" ]; then
OUTPUT_PATH="${OUTPUT_FILE_NAME}"
else
OUTPUT_PATH="$OUTPUT_DIR/prowler-output-${ACCOUNT_NUM}-${OUTPUT_DATE}"
fi
for output_format in "${MODES[@]}";
do
case ${output_format} in
csv)
s3cp "${OUTPUT_PATH}" "${EXTENSION_CSV}"
;;
html)
s3cp "${OUTPUT_PATH}" "${EXTENSION_HTML}"
;;
json)
s3cp "${OUTPUT_PATH}" "${EXTENSION_JSON}"
;;
json-asff)
s3cp "${OUTPUT_PATH}" "${EXTENSION_ASFF}"
;;
*)
echo "$OPTRED ERROR!$OPTNORMAL - Invalid output format copying to S3. Use -h for help."
exit 1
;;
esac
done
}
s3cp(){
OUTPUT_PATH="${1}"
EXTENSION="${2}"
"${AWSCLI}" ${PROFILE_OPT} s3 cp "${OUTPUT_PATH}.${EXTENSION}" s3://"${OUTPUT_BUCKET}"/${EXTENSION}/ --acl bucket-owner-full-control
}
I love it! Thank you @jfagoagas |
jfagoagas
requested changes
May 11, 2022
jfagoagas
approved these changes
May 11, 2022
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Awesome!!!
A really good fix here.
jfagoagas
deleted the
PRWLR-456-allow-prowler-to-use-f-custom-file-name-extension-and-d-custom-bucket
branch
May 11, 2022 08:16
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Context
Custom file names were not applied to S3 bucket uploads. (flag -F was not applicable to -D/B)
Description
Include custom file names as well when exporting prowler reports to S3.
License
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.