Skip to content

Data Submission

Chelsea edited this page Nov 25, 2023 · 5 revisions

Home > Features > Data Submission


Data Sources

This application receives data from two groups:

  • Ministry-Client

    • ie: Service BC
    • Sends json files with transaction records
  • Bank and Cash Management

    • Sends TDI flat files with deposit records

How the Data is Received

  • Files are pushed to our SFTP server

  • AWS Tranfer Family automatically moves these files from the SFTP server into an S3 bucket

  • The Parser Lambda is triggered as soon as a file is dropped into the S3 bucket

  • After parsing, the data is stored in a postgres RDS instance on AWS

    • Transaction data files from the Ministry-Client are reformatted and then stored in the transaction/payment tables

    • Deposit data files from Bank and Cash Management are converted from the flatfile format and then stored in the pos_deposit table and cash_deposit table (dependent upon the file type)

Clone this wiki locally