Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[10k]: Database (DB) replica #54

Closed
13 tasks done
widal001 opened this issue Jun 28, 2023 · 0 comments
Closed
13 tasks done

[10k]: Database (DB) replica #54

widal001 opened this issue Jun 28, 2023 · 0 comments
Labels
deliverable: 10k ft Product deliverables described at 10k feet project: grants.gov Grants.gov Modernization tickets topic: backend Backend development tickets topic: data Measurement and evaluation tickets

Comments

@widal001
Copy link
Collaborator

widal001 commented Jun 28, 2023

Description

Create a replica of AWS PROD database for legacy grants.gov in a beta.grants.gov environment. Replica should (1) journal all changes from legacy DB to new system DB and (2) support uptime even while legacy DB is undergoing planned or unplanned downtime, maintenance, and upgrades.

The creation of this replica should be scripted using infrastructure as code.

Outcome

  • Successful creation of a replica of AWS PROD database for legacy grants.gov in a beta.grants.gov environment to understand how the DB works.
  • Ability to perform experiments with the data without impacting production DB
  • Understand how future adaptations for our evolving data migration needs

Considerations and Assumptions

  • New DB needs to stay in-sync with the legacy DB
  • Reliance on expensive Oracle DB
  • Changes to the data model require speccing features using the database and we need more info on the issues with the current DB
  • Assumptions: When we later want to make changes to the DB, how will that impact Terraform? The service does support changes and we would capture in Terraform.

Dependencies

Out of Scope

  • We will not make changes to the data model in this work

Sub-Tasks

Sub-tasks can be found in this milestone

  • [ADR]: Replication tool #322
  • AWS dev account to put infrastructure
  • Provision infrastructure via Terraform
  • Access to MH AWS dev account
  • Permissions resolved and access to data

Definition of Done

  • Replication of the AWS prod with no changes to the data model
  • Replica will support uptime even while legacy DB is undergoing downtime, maintenance, and upgrades
  • Changes made to data in the existing production database are available in the new data model in less than 1 hour
  • The API endpoints have been tested and verified to return the expected data
@widal001 widal001 added topic: backend Backend development tickets topic: data Measurement and evaluation tickets and removed topic: backend Backend development tickets labels Jun 28, 2023
@widal001 widal001 modified the milestones: DB Replica, Database (DB) Replica, GET Opportunities Jun 29, 2023
@widal001 widal001 added project: grants.gov Grants.gov Modernization tickets deliverable: 10k ft Product deliverables described at 10k feet labels Jul 14, 2023
@widal001 widal001 changed the title Milestone: Database (DB) replica [Epic]: Database (DB) replica Aug 28, 2023
@widal001 widal001 removed this from the FY24 Q1: GET Opportunities milestone Sep 18, 2023
@widal001 widal001 changed the title [Epic]: Database (DB) replica [10k]: Database (DB) replica Oct 12, 2023
@acouch acouch mentioned this issue Dec 13, 2023
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
deliverable: 10k ft Product deliverables described at 10k feet project: grants.gov Grants.gov Modernization tickets topic: backend Backend development tickets topic: data Measurement and evaluation tickets
Projects
Development

No branches or pull requests

2 participants