Skip to content

Azure Function to transfer Azure Blob Storage files to AWS S3

License

Notifications You must be signed in to change notification settings

nhwkuhns/azstorage-to-s3

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Azure Storage to AWS S3

Deploy To Azure

This is a solution based on Azure Functions to transfer Azure Blob Storage files to AWS S3.

The architecture of the solution is as depicted on the following diagram:

Artitectural Diagram

The role of each component

  • Azure Function -responsible to manage the file tranfer with two approaches:
    • BlobTrigger: whenever a file is added on the referenced container (named 'live' by default), it causes the execution of the function to tranfer it to an AWS S3 bucket
    • TimeTrigger: runs in predefined time intervals tranfers all files from Azure Storage container (named 'scheduled' by default) towards AWS S3 bucket, which are then moved to an archive container (named 'archive'😊)
  • Azure Key Vault responsible to securely store the secrets/credentials for AWS S3 and Az Data Storage Account
  • Application Insights to provide monitoring and visibility for the health and performance of the application
  • Data Storage Account the Storage Account that will contain the application data / blob files

Note: The external services / application (greyed out on the diagram using Data Factory as an example) generating the data in the Storage Account are not included.

As an example, below are the resources created when running the deployment with project: 'blobtos3' and environment: 'dev'

Artitectural Diagram

About

Azure Function to transfer Azure Blob Storage files to AWS S3

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Bicep 53.5%
  • C# 46.5%