Sedna

Story of Sedna here

Pre-requisites:

• Set up necessary IAM via one of:
  • Environment variables
  • Shared credential file (~/.aws/credentials)
  • AWS config file (~/.aws/config)
• RDS access to the SAU PostgreSQL database
• Ability to create additional IAM roles for Sedna usage

Configuration:

• Copy .env_template to .env and fill in appropriate values
• Create an .export_version file with a short alphanumeric content (this will version your run of Sedna)
• Run in order check, perm, export, setup, and finally allocate per the Usage section below
• Running the import step generates allocation_import.sql which can be used to import allocation results and associated supporting tables from Athena/S3 to RDS

Usage:

$ python main.py

Sedna allocation tool for Sea Around Us

Usage:
    python main.py <command>

    Available commands:
    check    - Ensure configuration and proper access
    perm     - Automatically create the proper IAM permissions in AWS
    export   - Export necessary data (views and snapshot) from RDS to S3
    setup    - Set up necessary Athena tables based off S3 data
    allocate - Run the allocation process
    import   - Generate allocation result import SQL

Check is optional, all other steps must be followed in sequence. Steps are idempotent so running them more than once is not harmful (and may be required). Some steps are long-running but nothing should take more than 30 minutes.