Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR4 - Add CI and AWS terraform #15

Merged
merged 4 commits into from
Oct 16, 2023
Merged

PR4 - Add CI and AWS terraform #15

merged 4 commits into from
Oct 16, 2023

Conversation

ghukill
Copy link
Collaborator

@ghukill ghukill commented Oct 13, 2023

What does this PR do?

This final PR adds Github CI actions and terraform code to project. This was formerly in place, but removed during the full PR review process.

Helpful background context?

After this PR is approved and merged, the retroactive code review process will be complete. The next step will be to force update the main branch with the code-review-main branch that's been used. This may or may not be a PR, as it might be ultimately easier to perform directly this via a git CLI command.

UPDATE: Working to force update main, and will update the target of this PR to go into main. This shouldn't affect the code review, just some git gymnastics after failing to reset the git history of the template when originally cloned.

UPDATE: main has been force reset to match pr3-parser, and this PR has been updated to merge into main. The code-review-main branch is no longer needed.

How can a reviewer manually see the effects of these changes?

With this CI and AWS scaffolding added, it's possible to run a test harvest in the Dev1 environment.

If required / desired, you can publish a new image (though the creation of this PR has accomplished this):

make publish-dev

The following Makefile command will kick off an ECS task to run a harvest in Dev1:

make test-harvest-ecs-dev1

If you have the AWS CLI installed, you can monitor the logs of the harvest:

aws logs tail timdex-browsertrixharvester-dev --follow

The final output should be two new files in the TIMDEX S3 bucket. Using the TimdexManager role, you can navigate to bucket + folder: s3://timdex-extract-dev-222053980223/librarywebsite/ and look for files with pattern:

  • WACZ: test-harvest-ecs-2023-10-13.wacz
  • Metadata records XML: test-harvest-ecs-2023-10-13.xml

Includes new or updated dependencies?

NO

What are the relevant tickets?

https://mitlibraries.atlassian.net/browse/TIMX-247

Developer

  • All new ENV is documented in README (or there is none)
  • Stakeholder approval has been confirmed (or is not needed)

Code Reviewer

  • The commit message is clear and follows our guidelines
    (not just this pull request message)
  • There are appropriate tests covering any new functionality
  • The documentation has been updated or is unnecessary
  • The changes have been verified
  • New dependencies are appropriate or there were no changes

Why these changes are being introduced:

This final PR adds Github CI actions and terraform code to project.  This was formerly in place, but removed
during the full PR review process.

How this addresses that need:

  * adds .github folder
  * adds terraform generated AWS CLI commands to Makefile
  * adds convenience Makefile command to run a test harvest in Dev1

Side effects of this change:

  * Github actions now fire

Relevant ticket(s):

https://mitlibraries.atlassian.net/browse/TIMX-247
@ghukill ghukill changed the base branch from code-review-main to main October 13, 2023 14:16
Copy link

@ehanson8 ehanson8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 suggested changes

.github/dependabot.yml Show resolved Hide resolved
Makefile Outdated Show resolved Hide resolved
@ghukill ghukill requested a review from ehanson8 October 13, 2023 18:27
Copy link

@ehanson8 ehanson8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@ghukill ghukill merged commit 7e4a5e1 into main Oct 16, 2023
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants