Todos

[maxwelllevin]

Putting this in an issue so we can remove the TODO.notes file.

• Need a script to create a dataset in MHKDR and then set up a DataSync resource to keep the tsdat output bucket in sync with the MHKDR dataset bucket. DataSync can be created via CDK or boto3 (TBD).
• See if we can change the type of code build object that is created in the stack (e.g., use code build only instead of code pipeline) so that we can set webhook filters to trigger the build on tagged release instead of push to branch.
• Let users override storage.yaml file: Users need to specify the storage yaml path in aws template and the corresponding storage file in the pipelines repo. Then if specified build will replace the pipelines storage with the aws storage.
• Add cloudwatch alarms for the lambda functions if there are errors in the log
• Make sure that input_bucket_path can take wildcard patterns