Skip to content
This repository has been archived by the owner on Jun 3, 2024. It is now read-only.

CKAN + S3 + Openssl + NOT(FIPS) = Happy Family #225

Merged
merged 11 commits into from
Oct 10, 2022
Merged

CKAN + S3 + Openssl + NOT(FIPS) = Happy Family #225

merged 11 commits into from
Oct 10, 2022

Conversation

nickumia-reisys
Copy link
Contributor

@nickumia-reisys nickumia-reisys commented Oct 7, 2022

Related to

Setup

Grab the S3 Bucket from catalog (development):

cf t -s development
cf service-key catalog-s3 key

Edit the S3 Values in .env:

CKANEXT__S3SITEMAP__AWS_ACCESS_KEY_ID
CKANEXT__S3SITEMAP__AWS_BUCKET_NAME
CKANEXT__S3SITEMAP__AWS_SECRET_ACCESS_KEY
CKANEXT__S3SITEMAP__REGION_NAME
CKANEXT__S3SITEMAP__ENDPOINT_URL

Only enable the s3test plugin, Do make up and run the command docker-compose exec app ckan datagovs3 s3-test

The file at https://s3-us-gov-west-1.amazonaws.com/cg-4392b3a2-9692-45be-8e19-b1608b93778b/test.txt should have the timestamp of when you ran the program.

References/Notes:

THE GOLDEN ANSWER

@nickumia-reisys nickumia-reisys changed the title new: test s3 command CKAN + S3 + Openssl + FIPS = Happy Family Oct 7, 2022
@nickumia-reisys nickumia-reisys marked this pull request as ready for review October 7, 2022 05:23
@nickumia-reisys nickumia-reisys changed the title CKAN + S3 + Openssl + FIPS = Happy Family CKAN + S3 + Openssl + NOT(FIPS) = Happy Family Oct 7, 2022
@nickumia-reisys nickumia-reisys requested a review from a team October 7, 2022 05:27
- Isolate everything
- No other requirement installs
- No other plugins enabled in ckan
- No other extends from the plugin class
- Just a simple s3 upload function
- Also, I believe that the only change that mattered was the custom hash function
- Will update in future commits
- HOWEVER, this was the first working case
S3 Test command still works! It's a miracle.  There's no other conflicts with everything else just added in :)
- To write the local test, the endpoint_url was needed (as @robert-bryson has mentioned in the past)
- Good news! It still works on cloud.gov with endpoint_url
- Add local test validating that the file is uploaded and has the right data.
- Obviously, we can't write the local test for a cloud.gov s3 service, but I tested it manually and the PR has instructions on how to test it IF YOU DON'T BELIEVE ME haha..
Hopefully, 'make up' will fix the problem.  It seems like the localstack-container just isn't up for the test to talk to, hopefully that's all.  It works locally, I'm not lying!
Yes, you heard me right Github Actions >:(
@nickumia-reisys
Copy link
Contributor Author

Rebased onto main

@nickumia-reisys nickumia-reisys changed the base branch from fix/index-creation to main October 8, 2022 18:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants