DI-446 Dependabot experiment to be recursive #313
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
JackPlowman
changed the title
JackPlowman
changed the title
|
Kudos, SonarCloud Quality Gate passed!
|
mabe13
approved these changes
May 27, 2022
mabe13
pushed a commit
that referenced
this pull request
Jun 23, 2022
Corbisc
pushed a commit
that referenced
this pull request
Jun 27, 2022
JackPlowman
added a commit
that referenced
this pull request
Jul 20, 2022
* Add orgtype info to event replay logs (#269) * DI-410 Generify given for properties (#281) * DI-406 Edge cases for dentist ods (#264) * Added some new functionality to verify no logs * Streamlined the tests slightly * Removed the kit flags that were unnecessary * Added scenario outlines for two features * Removed reference to splunk from feature * Added new generic given step * Removed unnecessary test steps * Added some more improvements to tests * Further updates to test steps * Further removal of steps * Removed more steps to be generified * Further updates to test suites * Resolving rebasing issues with steps * Fixed a couple more issues * Added the pharmacy to F004S009 * Removed kit flag that was left present * DI-237 Update the ADR and associated diagrams (#293) * Update all the diagrams * Update the adr * Update the adr * Refine the diagrams and ADR * More funky changes * More changes yah * More changes yah * Add Event Replay feature in * Add splunk dashboards to solution architecture * Add a security view * Fix a few typos * DI-434 Change perf to use mock api (#298) * Change perf to use mock api * Change perf to use mock api * DI-430 Automate odscode selection with contact (#292) * Sql querry added to db checker handler * Update db checker handler query * Update db checker handler query * Update db checker handler queries * Update db checker handler query syntax * Modify dos data for test with a given step * Update code layout * Add unique corr id for data lignment run * Update unit test * Update to single service odscodes (#299) * DI-407 Gitflow release pipelines (#263) * Add Release Pipelines * Refactored F002 and F004 features and steps * Test cases are now all functioning Start Release Pipeline Single deploy codebuild Update codepipeline to build release pipelines Start release pipeline Start check if environment is deployed Add wait for log groups to create Start terraform to delete release environments and pipelines Delete based on branch name Add terraform debugging Move Performance Pipeline to mgmt account Continue moving performance pipelines to mgmt Move to codebuild for performance tests Upgrade Release pipeline for new S3 module Fix demo deployment codebuild stage Use development pipeline outputs Update to deploy pipeline before running pipeline Remove github auth in delete release environment Don't change release pipeline if not required Fix build branch Refactor Terraform Update buildspec to clean terraform modules Upgrade provider version * Remove unexpected changes * Add missing environment variable * Re add master to Github Workflow * Fix deployment bug (#301) * Fix incorrect variable in codepipeline (#302) * Renaming and redeploy performance-pipelines to perf-test-tools (#305) * DI-434 Pipeline to deploy Perf env with DoS API Mock (#303) * Swap perf and p2 environments * Add perf to delete api mock * Use correct database credentials * DI-443 Fix Delete Task Environments (#306) * Add github workflow diagram (#307) * DI-435 Performance Environment setup and change make targets (#304) * Swap perf and p2 environments * Add switch between perf and p2 profiles * Update Readme documentation * Fix rebase issue * DI-216 Batch Dentist Reporting (#297) * Initial commit * Fixed import error * removed testing print * Fixed open times reports * stuff * makefile addition * Commit * Added to gitignore * Fixed column heading mistake * Edited makefile paramters * Edited makefile paramters * Edited makefile paramters * Update p2 profile to perf-to-dos (#309) * DI-428 Add logging for change requests created (#310) * Add Dependabot config script (#312) * DI-446 Dependabot experiment to be recursive (#313) * DI-446 Add all Dependabot folder paths (#315) * DI-466 Add Dependabot branch naming pattern (#317) * DI-446 Remove AWS Public ECR from Dependabot (#318) * Bump actions/checkout from 2 to 3 (#314) Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](actions/checkout@v2...v3) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-451 Update Sonarcloud to include Serverless Framework and Terraform (#319) Attempt to update Sonarcloud to include SF and TF * DI-451 Fix coverage in Sonarcloud (#320) Fix coverage in sonarcloud * Fix coverage for Sonarcloud (#322) * Fix coverage for sonarcloud * Revert sonarcloud options change * Fix Unit Tests codebuild stage (#323) Update unit tests to work * DI-374 Triggering a Jenkins deploy from AWS Codebuild (#311) * Add a make target to trigger a Jenkins Job Add new codebuild stage security group Add codebuild stage for setting up integration test Use variable for mgmt vpc Add debug settings for make target Remove debug message and update version * Update release pipeline * Remove s3 module version * DI-445 Autodetect active organisation type flag (#308) * Update db checker sql query for single service pha * Update unit test * Build make target to autodetect active flag * Update terraform for pipeline modification * Add query for services count * Update relaease pipeline * Update unit test make target on pipeline buildspec * Update db checker handler unit test * Reformat unformatted python files (#321) Reduce duplications and code smells Experiment with test folder in sonarcloud Fix broken patch Fix coverage reports * DI-452 Add tfsec to security workflow (#324) * Add tfsec to security workflow * Add tfsec make target * Start TFSec security recommendations * More TFSec configuration * Set versions for terraform modules and more TFSec recommendations * Upgrade Terraform version to 1.2 * Revert Detect Changes change * Fix missing Dependabot dependency * DI-421 Updated readme and devops diagram (#295) * Updated readme * Add files via upload * Added instructions for DI-219 * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * WIP updating Readme & diagrams with pipeline and automations changes * Updating Diagrams with pipeline and automations changes * After review devops diagrams and readme changes * Change Artefact to UK English spelling Co-authored-by: Matthew Begley <matthewbegley@nhs.net> * DI-447 Security Scanning of Dockerfiles, Serverless Framework and Github Actions (#325) * Add default dependency review workflow * Add Checkov for Serverless, Docker and Terraform * Add make targets for checkov * Set Docker checks to not run/suppress checks * Suppress Github Actions warning * Start Terraform best practices * Remove Terraform checks * DI-447 Security Scanning of Terraform with Checkov (#326) * Add ignore for terraform checks with checkov * Enable checkov in Github Actions * DI-454 Upgrade tester image python version (#330) Upgrade test to python version 3.10.4 * DI-453 Refactor of change event generation (#327) Added new file to handle change events from dos * Bump django in /build/automation/lib/docker/image/python-app/example (#332) Bumps [django](https://github.com/django/django) from 3.2.7 to 3.2.13. - [Release notes](https://github.com/django/django/releases) - [Commits](django/django@3.2.7...3.2.13) --- updated-dependencies: - dependency-name: django dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-455 Implement case statements in test suite (#333) Replaced elifs with case statements * Update Serverless deployment to use direct deployment (#329) * DI-456 Resolved circular dependencies in change event (#334) * Resolved circular dependencies in change event * Further amendments to resolve dependency issues * Applying changes from commit checks * DI-448 Set up dead code scanning (#331) * Add Vulture code * Exclude files that use by other lambdas * Improve TODO message * Exclude files that use by other lambdas * Add an unit test for reporter.py * Update Make Devops Library (#328) Update make devops library * Switch base branch name to main (#353) Set everything to use main branch name * Upgrade Terraform versions (#360) * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-random@v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-random@v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Reduce Terraform upgrades to monthly (#354) * DI-449 Update and add Github Pull Request Checklists (#358) * Add basic template to be used when action runs * Update task and test PR templates * Simplify Workflow to use single file * Experiment with environment variables * Add test branches to regex * Reword template files Co-authored-by: Jack Plowman <jack.plowman1@nhs.net> * Bump python from 3.10.4 to 3.10.5 in /build/docker/tester (#370) * DI-465 Rename master to main in confluence (#372) Rename master to main in diagram and confluence Co-authored-by: Rohit <rohit.kondapalli1@nhs.net> * Remove Automatic Pull Request Bot (#369) * Change template folder name * Add new workflow * Update Github Actions * Fix incorrect directory * Refactor Github Actions and Workflows (#359) * Separate Secret Scanning and Security vulnerability scanning * Add update description workflow * Get branch name * Update description regex * Add multiple jobs to GH workflow * Separate checklist checker again * Add warning to PR template * DI-458 Add demo deployment to development pipeline (#373) Update pipeline to deploy to demo * DI-457 Refactor application code to remove dead code (#371) * Refactor unused variables * Fix comparison reporter * Fix unit tests * Reduce duplication in docker build steps (#377) * Simplify docker build steps * Save specific CMD to docker image * Remove unused code * Add demo deployment fixes * Remove debug command * Update Terraform AWS Provider (#388) * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.16.0...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix development pipelines and Remove duplicated make targets (#390) * Remove duplicated make targets and fix development pipeline * Remove extra line * Fix entrypoint to docker images * Fix Dos API Gateway Mock (#392) * Fix dos api gateway mock * Revert health check checker * Increase unit test coverage * Revert event sender * Fix not running unit tests * DI-466 Remove redundant utils function (#396) * DI-463 Refactored several steps for dos ce (#368) * Refactored several steps for dos ce * Removed commented out stuff * Event type added to fix in parent steps * Changed event type to org type * Resolved issues with tests * Removed change made to utils for troubleshooting * Updated some intermittently failing cases * Resolved the code quality error * Added issue occurring with split opening times * Update dentist demographics data and fix ods bug * Update failing scenario step * Removed get payload function as not in develop Co-authored-by: mik3ola <michael.olaw1@nhs.net> * DI-467 Check ECR scanning reports for vulnerabilities (#374) * Add scanning results make targets * Improve ECR image scanning make target * Put Image scanning on the correct buildspec * Fix Github Workflows and Improve Unit Test Coverage (#395) Improve Unit Testing Bump chuhlomin/render-template from 1.4 to 1.5 Bumps [chuhlomin/render-template](https://github.com/chuhlomin/render-template) from 1.4 to 1.5. - [Release notes](https://github.com/chuhlomin/render-template/releases) - [Commits](chuhlomin/render-template@v1.4...v1.5) --- updated-dependencies: - dependency-name: chuhlomin/render-template dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Add mutation tests Slim down repetitive make targets Update Github Actions add improve unit Add temporary full mutation test run Fix mutation test results and Github Action names Reduce scope of mutations Start process to only run against folder that have changed Simplify filters for mutation testing Silence output from make target Add rest of lambda folders Update Github Workflow to use matrix Use correct matrix name Improve unit tests Continue to improve unit tests Increase unit test coverage Update pip as part of docker build Exclude logger and tracer lines Improve test coverage * Bump actions/dependency-review-action from 1 to 2 (#397) Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 1 to 2. - [Release notes](https://github.com/actions/dependency-review-action/releases) - [Commits](actions/dependency-review-action@v1...v2) --- updated-dependencies: - dependency-name: actions/dependency-review-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix Performance Test Runner (#398) Fix performance tests using incorrect environment * DI-469 Fix Opening times scenario failure bug (#399) Correct change event schema data * Refactor Integration Test Suite (#401) Refactor Test Suite Remove change_request function and file Remove useless variable initialisation Fix PR description updater Type hint and introduce variables Use constant aliases for service type matching * Fix Performance Test Tools Slack Notification (#400) * Use slack webhook rather than sns topic * Remove unused data source * Remove unused variables * Fix workflow using branch name rather than designator * Update Cloudwatch dashboard and queries (#403) * Update Cloudwatch dashboard and queries Fix github action * Update incorrect echo in github action * DI-476 Hotfix - Remove publicname change ability (#406) * Remove publicname change ability and update unit tests * Python code formatting * Add public name int test scenario * Update env variable for special xter test * Fix test step and feature change when rebasing to develop Co-authored-by: Matthew Begley <matthewbegley@nhs.net> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Refactor Integration Test to build Change Events using Class (#402) * Create ChangeEventBuilder and ChangeEvent * Move away from dataclass for ChangeEvent class * Migrate build same as DoS function into ChangeEventBuilder class * Fix phone bug * Migrate ChangeEventBuilder into separate file * Remove debug line * Refactor Opening Times check * DI-489 Hotfix bug fixes release 1-0-4 (#414) * DI-481 Changed overlap definition and added unit tests (#409) * Changed overlap definition and added unit tests * DI-490 Integration tests for same closing and opening time (#411) * Branch change for hotfix * Removed dentist test as not supported * Removed the kit tag Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> * DI-480 Website Validation Hotfix (#410) * Add website validation * Handle if http/https is not in URL * Fix unit tests and update changes to exclude empty string * Add additional unit tests and fixes * Remove debugging print statement * Test scenarios for url variations Co-authored-by: mik3ola <michael.olaw1@nhs.net> Co-authored-by: Sam Clayton <SLClayton@users.noreply.github.com> Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Fix integration tests from hotfix (#415) Fix integration tests * DI-482 Dynamodb Cloner Kms Key Access (#413) * Add developer access to KMS key so that dbcloner can use key * Fix broken role permission * DI-470 Refactor Steps File and Context Variable (#404) * Refactor Test Suite Rename steps file and rebuild context dictionary into class Move away from dataclass for ChangeEvent class Migrate build same as DoS function into ChangeEventBuilder class Fix phone bug Migrate ChangeEventBuilder into separate file Remove debug line Refactor Opening Times check Remove positive check function to allow negative checks Fix missing fixture in integration tests Change line to create change request Use context class instead of dictionary Python formatting fixes Follow python standards Remove duplicated functionality Remove run id Use change event class until sent to API instead of dictionary Add a test step summary Handle when there is no context fixture Fix broken test when change_event moved from dictionary to class Fix more test failures More test failure fixes More test failure fixes Remove extra log line Improve run id Fix missing variable changes Fix test failures Add line to trigger CR Generate unique key Add temporary flakey test solution Use pytest fixture instead of building it in step Reduce duplicated functionality Change sequence test to make sense Add unique key Use unique correlation id for each run Remove odscode from list of usable odscode Increase get service id timeout Increase reliability of website and phone numbers Reduce duplication in feature files Reformat feature files Change back to use reruns Add feature to auto fail if status code is wrong Fix missing case statement Increase timeout for retries Fix odscode error and incorrect sequence number error Exclude specific sequence numbers from failing tests Trial using default CE Add address change check Use valid postcode in default event * Start to fix after rebase * Increase timeouts to make some tests more reliable * Merge website steps * Add additional retry to improve reliability * Reduce duplications of dynamodb checking * Increase delay between retries * Upgrade Terraform versions (#430) * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](terraform-aws-modules/terraform-aws-s3-bucket@v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws in /infrastructure/modules/s3 Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](terraform-aws-modules/terraform-aws-s3-bucket@v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-random@v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-random@v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.17.1...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](hashicorp/terraform-provider-aws@v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](terraform-aws-modules/terraform-aws-s3-bucket@v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Upgrade after lambda deployment terraform stack Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Add Python Script for downloading a Dynamodb Table to CSV (#433) * DI-442 Adjusting lambda performance (#431) * Initial commit * Added a bunch of debug logs * Added new get locations method method * Fixed untit tests * Added for redeploy * fixed vars bug * Removed most of timing loggings * Checking for errors * Changed lambda size for event processor * Testing changes * Testing changes * test bug fix * Changing for new commit comment * DI-472 Add change to remove specified dates in the past (#434) * Add change to remove specified dates in the past * Refinements and test improvements * Improve unit tests * Refactoring of update_changes_with_opening_times function * Refinements after review * DI-477 Integration tests for past opening times (#437) Updated test to be valid for functionality * DI-493 Create generic error report (#435) * Added to generic log output extras * Edited log error info message * Updated again to include more of last * Fix Invalid Website Integration Test (#438) Fix Error handling test * DI-485 Reduce change event size for logging (#436) * Reduce change event size for logging * Update one more test senario Co-authored-by: Rohit kondapalli <rohit.kondapalli1@nhs.net> Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> Co-authored-by: Ed Sparkes <1023491+ed-sparkes@users.noreply.github.com> Co-authored-by: Michael Olaw <67810234+mik3ola@users.noreply.github.com> Co-authored-by: Matthew Begley <60427904+mabe13@users.noreply.github.com> Co-authored-by: Sam Clayton <SLClayton@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matthew Begley <matthewbegley@nhs.net> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mik3ola <michael.olaw1@nhs.net>
JackPlowman
added a commit
that referenced
this pull request
Oct 17, 2022
* Add orgtype info to event replay logs (#269) * DI-410 Generify given for properties (#281) * DI-406 Edge cases for dentist ods (#264) * Added some new functionality to verify no logs * Streamlined the tests slightly * Removed the kit flags that were unnecessary * Added scenario outlines for two features * Removed reference to splunk from feature * Added new generic given step * Removed unnecessary test steps * Added some more improvements to tests * Further updates to test steps * Further removal of steps * Removed more steps to be generified * Further updates to test suites * Resolving rebasing issues with steps * Fixed a couple more issues * Added the pharmacy to F004S009 * Removed kit flag that was left present * DI-237 Update the ADR and associated diagrams (#293) * Update all the diagrams * Update the adr * Update the adr * Refine the diagrams and ADR * More funky changes * More changes yah * More changes yah * Add Event Replay feature in * Add splunk dashboards to solution architecture * Add a security view * Fix a few typos * DI-434 Change perf to use mock api (#298) * Change perf to use mock api * Change perf to use mock api * DI-430 Automate odscode selection with contact (#292) * Sql querry added to db checker handler * Update db checker handler query * Update db checker handler query * Update db checker handler queries * Update db checker handler query syntax * Modify dos data for test with a given step * Update code layout * Add unique corr id for data lignment run * Update unit test * Update to single service odscodes (#299) * DI-407 Gitflow release pipelines (#263) * Add Release Pipelines * Refactored F002 and F004 features and steps * Test cases are now all functioning Start Release Pipeline Single deploy codebuild Update codepipeline to build release pipelines Start release pipeline Start check if environment is deployed Add wait for log groups to create Start terraform to delete release environments and pipelines Delete based on branch name Add terraform debugging Move Performance Pipeline to mgmt account Continue moving performance pipelines to mgmt Move to codebuild for performance tests Upgrade Release pipeline for new S3 module Fix demo deployment codebuild stage Use development pipeline outputs Update to deploy pipeline before running pipeline Remove github auth in delete release environment Don't change release pipeline if not required Fix build branch Refactor Terraform Update buildspec to clean terraform modules Upgrade provider version * Remove unexpected changes * Add missing environment variable * Re add master to Github Workflow * Fix deployment bug (#301) * Fix incorrect variable in codepipeline (#302) * Renaming and redeploy performance-pipelines to perf-test-tools (#305) * DI-434 Pipeline to deploy Perf env with DoS API Mock (#303) * Swap perf and p2 environments * Add perf to delete api mock * Use correct database credentials * DI-443 Fix Delete Task Environments (#306) * Add github workflow diagram (#307) * DI-435 Performance Environment setup and change make targets (#304) * Swap perf and p2 environments * Add switch between perf and p2 profiles * Update Readme documentation * Fix rebase issue * DI-216 Batch Dentist Reporting (#297) * Initial commit * Fixed import error * removed testing print * Fixed open times reports * stuff * makefile addition * Commit * Added to gitignore * Fixed column heading mistake * Edited makefile paramters * Edited makefile paramters * Edited makefile paramters * Update p2 profile to perf-to-dos (#309) * DI-428 Add logging for change requests created (#310) * Add Dependabot config script (#312) * DI-446 Dependabot experiment to be recursive (#313) * DI-446 Add all Dependabot folder paths (#315) * DI-466 Add Dependabot branch naming pattern (#317) * DI-446 Remove AWS Public ECR from Dependabot (#318) * Bump actions/checkout from 2 to 3 (#314) Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](https://github.com/actions/checkout/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-451 Update Sonarcloud to include Serverless Framework and Terraform (#319) Attempt to update Sonarcloud to include SF and TF * DI-451 Fix coverage in Sonarcloud (#320) Fix coverage in sonarcloud * Fix coverage for Sonarcloud (#322) * Fix coverage for sonarcloud * Revert sonarcloud options change * Fix Unit Tests codebuild stage (#323) Update unit tests to work * DI-374 Triggering a Jenkins deploy from AWS Codebuild (#311) * Add a make target to trigger a Jenkins Job Add new codebuild stage security group Add codebuild stage for setting up integration test Use variable for mgmt vpc Add debug settings for make target Remove debug message and update version * Update release pipeline * Remove s3 module version * DI-445 Autodetect active organisation type flag (#308) * Update db checker sql query for single service pha * Update unit test * Build make target to autodetect active flag * Update terraform for pipeline modification * Add query for services count * Update relaease pipeline * Update unit test make target on pipeline buildspec * Update db checker handler unit test * Reformat unformatted python files (#321) Reduce duplications and code smells Experiment with test folder in sonarcloud Fix broken patch Fix coverage reports * DI-452 Add tfsec to security workflow (#324) * Add tfsec to security workflow * Add tfsec make target * Start TFSec security recommendations * More TFSec configuration * Set versions for terraform modules and more TFSec recommendations * Upgrade Terraform version to 1.2 * Revert Detect Changes change * Fix missing Dependabot dependency * DI-421 Updated readme and devops diagram (#295) * Updated readme * Add files via upload * Added instructions for DI-219 * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * WIP updating Readme & diagrams with pipeline and automations changes * Updating Diagrams with pipeline and automations changes * After review devops diagrams and readme changes * Change Artefact to UK English spelling Co-authored-by: Matthew Begley <matthewbegley@nhs.net> * DI-447 Security Scanning of Dockerfiles, Serverless Framework and Github Actions (#325) * Add default dependency review workflow * Add Checkov for Serverless, Docker and Terraform * Add make targets for checkov * Set Docker checks to not run/suppress checks * Suppress Github Actions warning * Start Terraform best practices * Remove Terraform checks * DI-447 Security Scanning of Terraform with Checkov (#326) * Add ignore for terraform checks with checkov * Enable checkov in Github Actions * DI-454 Upgrade tester image python version (#330) Upgrade test to python version 3.10.4 * DI-453 Refactor of change event generation (#327) Added new file to handle change events from dos * Bump django in /build/automation/lib/docker/image/python-app/example (#332) Bumps [django](https://github.com/django/django) from 3.2.7 to 3.2.13. - [Release notes](https://github.com/django/django/releases) - [Commits](https://github.com/django/django/compare/3.2.7...3.2.13) --- updated-dependencies: - dependency-name: django dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-455 Implement case statements in test suite (#333) Replaced elifs with case statements * Update Serverless deployment to use direct deployment (#329) * DI-456 Resolved circular dependencies in change event (#334) * Resolved circular dependencies in change event * Further amendments to resolve dependency issues * Applying changes from commit checks * DI-448 Set up dead code scanning (#331) * Add Vulture code * Exclude files that use by other lambdas * Improve TODO message * Exclude files that use by other lambdas * Add an unit test for reporter.py * Update Make Devops Library (#328) Update make devops library * Switch base branch name to main (#353) Set everything to use main branch name * Upgrade Terraform versions (#360) * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Reduce Terraform upgrades to monthly (#354) * DI-449 Update and add Github Pull Request Checklists (#358) * Add basic template to be used when action runs * Update task and test PR templates * Simplify Workflow to use single file * Experiment with environment variables * Add test branches to regex * Reword template files Co-authored-by: Jack Plowman <jack.plowman1@nhs.net> * Bump python from 3.10.4 to 3.10.5 in /build/docker/tester (#370) * DI-465 Rename master to main in confluence (#372) Rename master to main in diagram and confluence Co-authored-by: Rohit <rohit.kondapalli1@nhs.net> * Remove Automatic Pull Request Bot (#369) * Change template folder name * Add new workflow * Update Github Actions * Fix incorrect directory * Refactor Github Actions and Workflows (#359) * Separate Secret Scanning and Security vulnerability scanning * Add update description workflow * Get branch name * Update description regex * Add multiple jobs to GH workflow * Separate checklist checker again * Add warning to PR template * DI-458 Add demo deployment to development pipeline (#373) Update pipeline to deploy to demo * DI-457 Refactor application code to remove dead code (#371) * Refactor unused variables * Fix comparison reporter * Fix unit tests * Reduce duplication in docker build steps (#377) * Simplify docker build steps * Save specific CMD to docker image * Remove unused code * Add demo deployment fixes * Remove debug command * Update Terraform AWS Provider (#388) * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix development pipelines and Remove duplicated make targets (#390) * Remove duplicated make targets and fix development pipeline * Remove extra line * Fix entrypoint to docker images * Fix Dos API Gateway Mock (#392) * Fix dos api gateway mock * Revert health check checker * Increase unit test coverage * Revert event sender * Fix not running unit tests * DI-466 Remove redundant utils function (#396) * DI-463 Refactored several steps for dos ce (#368) * Refactored several steps for dos ce * Removed commented out stuff * Event type added to fix in parent steps * Changed event type to org type * Resolved issues with tests * Removed change made to utils for troubleshooting * Updated some intermittently failing cases * Resolved the code quality error * Added issue occurring with split opening times * Update dentist demographics data and fix ods bug * Update failing scenario step * Removed get payload function as not in develop Co-authored-by: mik3ola <michael.olaw1@nhs.net> * DI-467 Check ECR scanning reports for vulnerabilities (#374) * Add scanning results make targets * Improve ECR image scanning make target * Put Image scanning on the correct buildspec * Fix Github Workflows and Improve Unit Test Coverage (#395) Improve Unit Testing Bump chuhlomin/render-template from 1.4 to 1.5 Bumps [chuhlomin/render-template](https://github.com/chuhlomin/render-template) from 1.4 to 1.5. - [Release notes](https://github.com/chuhlomin/render-template/releases) - [Commits](https://github.com/chuhlomin/render-template/compare/v1.4...v1.5) --- updated-dependencies: - dependency-name: chuhlomin/render-template dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Add mutation tests Slim down repetitive make targets Update Github Actions add improve unit Add temporary full mutation test run Fix mutation test results and Github Action names Reduce scope of mutations Start process to only run against folder that have changed Simplify filters for mutation testing Silence output from make target Add rest of lambda folders Update Github Workflow to use matrix Use correct matrix name Improve unit tests Continue to improve unit tests Increase unit test coverage Update pip as part of docker build Exclude logger and tracer lines Improve test coverage * Bump actions/dependency-review-action from 1 to 2 (#397) Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 1 to 2. - [Release notes](https://github.com/actions/dependency-review-action/releases) - [Commits](https://github.com/actions/dependency-review-action/compare/v1...v2) --- updated-dependencies: - dependency-name: actions/dependency-review-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix Performance Test Runner (#398) Fix performance tests using incorrect environment * DI-469 Fix Opening times scenario failure bug (#399) Correct change event schema data * Refactor Integration Test Suite (#401) Refactor Test Suite Remove change_request function and file Remove useless variable initialisation Fix PR description updater Type hint and introduce variables Use constant aliases for service type matching * Fix Performance Test Tools Slack Notification (#400) * Use slack webhook rather than sns topic * Remove unused data source * Remove unused variables * Fix workflow using branch name rather than designator * Update Cloudwatch dashboard and queries (#403) * Update Cloudwatch dashboard and queries Fix github action * Update incorrect echo in github action * DI-476 Hotfix - Remove publicname change ability (#406) * Remove publicname change ability and update unit tests * Python code formatting * Add public name int test scenario * Update env variable for special xter test * Fix test step and feature change when rebasing to develop Co-authored-by: Matthew Begley <matthewbegley@nhs.net> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Refactor Integration Test to build Change Events using Class (#402) * Create ChangeEventBuilder and ChangeEvent * Move away from dataclass for ChangeEvent class * Migrate build same as DoS function into ChangeEventBuilder class * Fix phone bug * Migrate ChangeEventBuilder into separate file * Remove debug line * Refactor Opening Times check * DI-489 Hotfix bug fixes release 1-0-4 (#414) * DI-481 Changed overlap definition and added unit tests (#409) * Changed overlap definition and added unit tests * DI-490 Integration tests for same closing and opening time (#411) * Branch change for hotfix * Removed dentist test as not supported * Removed the kit tag Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> * DI-480 Website Validation Hotfix (#410) * Add website validation * Handle if http/https is not in URL * Fix unit tests and update changes to exclude empty string * Add additional unit tests and fixes * Remove debugging print statement * Test scenarios for url variations Co-authored-by: mik3ola <michael.olaw1@nhs.net> Co-authored-by: Sam Clayton <SLClayton@users.noreply.github.com> Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Fix integration tests from hotfix (#415) Fix integration tests * DI-482 Dynamodb Cloner Kms Key Access (#413) * Add developer access to KMS key so that dbcloner can use key * Fix broken role permission * DI-470 Refactor Steps File and Context Variable (#404) * Refactor Test Suite Rename steps file and rebuild context dictionary into class Move away from dataclass for ChangeEvent class Migrate build same as DoS function into ChangeEventBuilder class Fix phone bug Migrate ChangeEventBuilder into separate file Remove debug line Refactor Opening Times check Remove positive check function to allow negative checks Fix missing fixture in integration tests Change line to create change request Use context class instead of dictionary Python formatting fixes Follow python standards Remove duplicated functionality Remove run id Use change event class until sent to API instead of dictionary Add a test step summary Handle when there is no context fixture Fix broken test when change_event moved from dictionary to class Fix more test failures More test failure fixes More test failure fixes Remove extra log line Improve run id Fix missing variable changes Fix test failures Add line to trigger CR Generate unique key Add temporary flakey test solution Use pytest fixture instead of building it in step Reduce duplicated functionality Change sequence test to make sense Add unique key Use unique correlation id for each run Remove odscode from list of usable odscode Increase get service id timeout Increase reliability of website and phone numbers Reduce duplication in feature files Reformat feature files Change back to use reruns Add feature to auto fail if status code is wrong Fix missing case statement Increase timeout for retries Fix odscode error and incorrect sequence number error Exclude specific sequence numbers from failing tests Trial using default CE Add address change check Use valid postcode in default event * Start to fix after rebase * Increase timeouts to make some tests more reliable * Merge website steps * Add additional retry to improve reliability * Reduce duplications of dynamodb checking * Increase delay between retries * Upgrade Terraform versions (#430) * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws in /infrastructure/modules/s3 Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Upgrade after lambda deployment terraform stack Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Add Python Script for downloading a Dynamodb Table to CSV (#433) * DI-442 Adjusting lambda performance (#431) * Initial commit * Added a bunch of debug logs * Added new get locations method method * Fixed untit tests * Added for redeploy * fixed vars bug * Removed most of timing loggings * Checking for errors * Changed lambda size for event processor * Testing changes * Testing changes * test bug fix * Changing for new commit comment * DI-472 Add change to remove specified dates in the past (#434) * Add change to remove specified dates in the past * Refinements and test improvements * Improve unit tests * Refactoring of update_changes_with_opening_times function * Refinements after review * DI-477 Integration tests for past opening times (#437) Updated test to be valid for functionality * DI-493 Create generic error report (#435) * Added to generic log output extras * Edited log error info message * Updated again to include more of last * Fix Invalid Website Integration Test (#438) Fix Error handling test * DI-485 Reduce change event size for logging (#436) * Reduce change event size for logging * Update one more test senario * Fix Release Branch Pipeline (#441) Fix release codepipeline * Add mock lambdas back into release pipeline (#442) * Performance Tests Improvements (#443) * Fix performance tests to update all fields * Modify Address to always be unique * DI-478 Update Address received from NHS.UK to title case (#416) * Start title casing address * Start fixing unit tests * Fix last unit test * Add new apostrophe and ampersand rules * Fix bug with apostrophes not being replaced * Update Documentation for release 1.0.4 (#444) * Clean up diagrams * Set background to white * Rename drawio files * DI-498 Tests for title case address (#439) Start title casing address Start fixing unit tests Fix last unit test Add new apostrophe and ampersand rules Fix bug with apostrophes not being replaced Address line title case tests Update duplicate step function name Update address variation tests Update address variation test scenario * DI-475 Update cloudwatch alarms for slack (#432) * Fix alerts and add alert for 400 Error * Use correct alert selector * Make change_event_endpoint_4xx_errors_alert actually error * DI-488 Sqs and slack alert test cases (#450) * Removed imported library that wasn't used * Slack tests as a wip * Sqs queue injection update * Test cases now running but requiring token * Updated delay so the test doesnt timeout * Updated the makefile to run properly * Updated tags on test cases * Tag images when the release branch is deleted (#447) * Re tag images when the release branch is deleted * Fix invalid sed statement * Add retag images to documentation * Add Error Rate to Cloudwatch Dashboard (#445) * Remove unused serverless variable * Update cloudwatch dashboard * Rename file to reflect infrastructure included in file * DI-537 Slack timing update for cloudwatch changes (#458) Updated timings on Slack tests * DI-518 Direct DoS DB Connection (#457) * Connect Directly to DoS DB Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug * Fixed hash function for OpenPeriod and added unit tests * Attempt to fix specified opening times * Attempt to fix another specified opening times/service histories bug * Set none in services table to empty string * Fix generic bank holiday error Co-authored-by: SLClayton <SLClayton@users.noreply.github.com> * DI-519 Tests for DI-518 (#473) * Trying to figure out errors with loading opening times * Begin changing tests to work with DI-518 * Get F001S001 to work * Fix integration test F001S003 & F001S005 * Fix most of F001 tests * Added functions to generate new ods * Fix more integration tests * Test and Fix all tests except F006 * Fix all opening times tests * Add back in test retries * Improve unit test coverage Co-authored-by: Kit <christopher.corbishley1@nhs.net> * DI-517 Add documentation for new DI Architecture (#456) * Add ADR for decision * New architecture diagrams * Add a security group diagram * Update DB connections diagram * Update Diagrams with latest information * Add dos_db_handler warning message * DI-518 Fix deleting security group (#485) Attempt to fix security group being deleted * DI-533 Update Cloudwatch Dashboard and Add New Cloudwatch Alarms (#469) * Add new alarms Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Trying to figure out errors with loading opening times Begin changing tests to work with DI-518 Get F001S001 to work Fix integration test F001S003 & F001S005 Fix most of F001 tests Added functions to generate new ods Fix more integration tests Test and Fix all tests except F006 Fix all opening times tests Add back in test retries Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric * Fix rebase issue * DI-553 Update sqs test failures (#476) * Connect Directly to DoS DB Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Trying to figure out errors with loading opening times Begin changing tests to work with DI-518 Get F001S001 to work Fix integration test F001S003 & F001S005 Fix most of F001 tests Added functions to generate new ods Fix more integration tests Test and Fix all tests except F006 Fix all opening times tests Add back in test retries * Updated sqs test cases and reworded features Ran the python import sort Removed some unnecessary comments * Updated change to project file Co-authored-by: Jack Plowman <jack.plowman1@nhs.net> * DI-546 Python Security Scanning (#470) * Python security scanning Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric Add python code security check Improve test performance on reruns * Add is closed unit test * Fix rebase issue * Fix delete current value * Fix specified opening times bug * DI-534 Handle DoS DB Failures (#474) * Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric * Add python code security check * Create health check path in service sync Update cloudwatch dashboard Improve metrics names and behaviour Add new unit tests and log messages * Add health check for replica db as well * Update healthcheck exception unit test * Add cloudwatch alarm * Bump python from 3.10.5 to 3.10.6 in /build/docker/tester (#471) Bumps python from 3.10.5 to 3.10.6. --- updated-dependencies: - dependency-name: python dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-560 Service history checks for integration (#486) * Added new steps for negative service history * Updated logic to check for recent events * Updated for errors when running * Updated features to use new steps * Removed kit tag from feature * Added brackets to a function * Updated to return data rather than array * Fixed a couple of edge cases causing failures * Updated logic for change add switches * Improve unit test coverage (#488) * Improve opening times unit test coverage * Start covering changes to dos branches * Fix import error * Continue covering changes to dos branches * DI-558 Service history specified dates tests (#487) * New step to enable checking specified opening times * Updated to support closed and be more resilient * Removed the kit tags * Updated some utils and added removed comments * Updated format of comments * Updated comment format again * Renamed check service history specified function * Changed comments from hash to speech marks * DI-524 Log Service Update to DoS (#477) * Work in progress python logging Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric Add python code security check Create health check path in service sync Update cloudwatch dashboard Improve metrics names and behaviour Add new unit tests and log messages Work in progress python logging Fix unit tests Log demographics update to DoS Change splunk filter * Add opening times update message * Improve unit test coverage * Turn off sending logs in demo environment * Change filter and add more unit tests * Change log format * Fix bug when value is null * Fix duplicate previous opening times bug * Fix UnboundLocalError issue * Change readme documentation * DI-559 Standard Opening Times Service History Checks (#490) * New step to enable checking specified opening times * Updated to support closed and be more resilient * Removed the kit tags * Added new steps and utils for standard opening times * Assertions now functioning with open dates * Updated to support closed standard day checks * Updated with some comment feedback * Updated logic for add and remove * Updated return type and var names * Updated format of assertions and added support for modify * Added new tests to force status in sh * Running but with inconsistencies * Updated for stability and consistency changes * Ran the python sort imports * Fix application bugs (#504) Fix rebase issues * DI-538 Send Email Documentation (#491) Add Send Email documentation Update testing documentation for s3 trigger Change Architecture Diagram Add delete email lambda Add ADR for sending emails Update who decided email sending architecture * Revert IAM Changes & Refactor Image Roles (#492) * Attempt to fix lambda roles deletion * Add back in old lambda names * Ignore security warning on wildcards * Remove role for sending emails * DI-539 Handle DoS Location Data (#489) * Move dos location tests to new file and pick up postaltown from table * Update the service table with updated location data * Refactor logging to guarantee service updates have been saved to db * Fix existing unit tests * Refactor to separate comparison wrapper functions * Improve unit test coverage * Add debug log * Update db in a way apostrophes are escaped * Fix python imports formatting * Add PR review changes * Increase Integration Test Reliability (#508) Increase test time to increase reliability * DI-578 Change the change action from remove to delete (#509) * Change the change action from remove to delete * Fix integration tests * Increase delay to improve test reliability * DI-541 Add additional metrics for splunk dashboards (#511) Add additional metrics for splunk dashboards * Update automation scripts (#512) * Remove duplicated files (#515) * DI-579 Service History Location Update Integration Tests (#514) * Initial push with changes to dos handler * Added new query to dos handler * Updated formatting to be nicer * Updated to use existing steps * Updated column name for table * More efficient way to verify location data * Added new generic test function * Added service history check for locations data * Sorted out tags and makefile issue * Updated function name to make more sense * Improve DoS Integration Documentation (#516) * Start reworking README documentation * Update more documentation * Update more documentation * DI-556 Service Update Report (#519) Add service update log for ServiceUpdateReport * DI-514 Assuring existing DoS invalid openings don't break (#518) * Added test for invalid existing dos times * import format changes * Committing again so I can have a new message. * Trying commit comment again * DI-532 Reject DoS Pending Changes and Initiate Email (#507) * Add email architecture Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Fix rebase issues * Add dummy values and inner join on query * Fix unit tests * Fix development pipeline (#522) * DI-570 Add NHS Mail SMTP Configuration (#517) * Send emails for rejected pending change Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Fix rebase issues Send emails for rejected pending change Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Set up common variables in terraform Add basic email configuration Get emails working Add some unit tests Refactor variables to reduce duplication Fix unit tests Modify implementation to use SMTP email Add more unit tests and delete dead code Modify email to send HTML Remove ses config Remove user data from logs * Fix unit tests * Refactor to hide event and remove unreachable code * DI-562 Blank Opening Times Reporting (#521) * Added new report logging * Changed some formatting * Added more test stuff * DI-583 Email Monitoring Alarm (#523) * Add metrics for when emails fail * Fix undeploy make target * Fix unit tests and add new test * DI-523 Use correct DoS Nonprod Database Role (#528) * Use specific database role * Improve test reliability and remove debug log * Fix performance variables * DI-592 Fix a couple of bugs (#524) Fix a couple of bugs * DI-600 Increase DoS Version in Regressiondi Environment (#529) Increase DoS Version * DI-523 Update Production profiles for release 3.0 (#530) Add Production profiles for release 3.0 * DI-606 Fix production deployments (#532) Remove role condition as lambda doesn't have condition * DI-585 Create Integration Tests for Emails (#533) * Added new features and utils to run s3 file checks for email * Updated insert to not expect result * Updated json insert to try and make it parse * Updated formatting of the json string * Further changes to the formatting * Converted json to string * Added strings in triple quotes * Added returning to the dos db handler * Updated the spacing for commit checks * Added some escape characters * Used the existing method in handler * Updated to use new query structure * Updated to use json * Removed using json library * Added extra speech marks * Removed the extra speech marks * Sams solution being tested * Added raw string format * Updated function to use entirely args * Updated to use new connection settings * Neatened up the insert code for query * Updated commit to add new formatting * Updated services in dos handler * Removed pathwaysdos from services path * Updated the formatting of the query * Trying to get around auto formatting * Reverted to less readable format * Updated logic to use uid instead of id * Removed unnecessary f string * Removed makefile changes and unused tags * Added new entry in dos db handler * Added new test case to check rejection * Repushing to make new env * Updated method of committing to db * Updated to use default user * DI-523 Add second sg inbound rule for replicas in specific environments (#534) Add second inbound rule for replicas in specific environments * DI-523 Fix incorrect Terraform condition (#536) Add second inbound rule for replicas in specific environments * DI-591 Disable address formatting (#535) * Disable address formatting * Fix more integration Tests * DI-571 Delete Old Emails From S3 Bucket (#537) Use S3 lifecycle rule to delete old emails * DI-595 Fix exception being logged with PID (#527) * Fix exception being logged with PID * Hide error message and add checkpoints * Improve logging and alphabetically order classes * Fix JSON decode error * Fix python imports * DI-596 Censor pid in sql logs (#531) * Added option in query func to censor * Formatting changes to code * DI-526 Performance Testing and Test Upgrades (#526) * Bump up rate limit * Remove unused data collection from repo * General refactoring of performance tests * Refactor performance test * Reduce number of variables set * Fix unit tests * Make generic performance test function Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Rohit kondapalli <rohit.kondapalli1@nhs.net> Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> Co-authored-by: Ed Sparkes <1023491+ed-sparkes@users.noreply.github.com> Co-authored-by: Michael Olaw <67810234+mik3ola@users.noreply.github.com> Co-authored-by: Matthew Begley <60427904+mabe13@users.noreply.github.com> Co-authored-by: Sam Clayton <SLClayton@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Matthew Begley <matthewbegley@nhs.net> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mik3ola <michael.olaw1@nhs.net> Co-authored-by: Kit <christopher.corbishley1@nhs.net>
mabe13
added a commit
that referenced
this pull request
Nov 3, 2022
* Add orgtype info to event replay logs (#269) * DI-410 Generify given for properties (#281) * DI-406 Edge cases for dentist ods (#264) * Added some new functionality to verify no logs * Streamlined the tests slightly * Removed the kit flags that were unnecessary * Added scenario outlines for two features * Removed reference to splunk from feature * Added new generic given step * Removed unnecessary test steps * Added some more improvements to tests * Further updates to test steps * Further removal of steps * Removed more steps to be generified * Further updates to test suites * Resolving rebasing issues with steps * Fixed a couple more issues * Added the pharmacy to F004S009 * Removed kit flag that was left present * DI-237 Update the ADR and associated diagrams (#293) * Update all the diagrams * Update the adr * Update the adr * Refine the diagrams and ADR * More funky changes * More changes yah * More changes yah * Add Event Replay feature in * Add splunk dashboards to solution architecture * Add a security view * Fix a few typos * DI-434 Change perf to use mock api (#298) * Change perf to use mock api * Change perf to use mock api * DI-430 Automate odscode selection with contact (#292) * Sql querry added to db checker handler * Update db checker handler query * Update db checker handler query * Update db checker handler queries * Update db checker handler query syntax * Modify dos data for test with a given step * Update code layout * Add unique corr id for data lignment run * Update unit test * Update to single service odscodes (#299) * DI-407 Gitflow release pipelines (#263) * Add Release Pipelines * Refactored F002 and F004 features and steps * Test cases are now all functioning Start Release Pipeline Single deploy codebuild Update codepipeline to build release pipelines Start release pipeline Start check if environment is deployed Add wait for log groups to create Start terraform to delete release environments and pipelines Delete based on branch name Add terraform debugging Move Performance Pipeline to mgmt account Continue moving performance pipelines to mgmt Move to codebuild for performance tests Upgrade Release pipeline for new S3 module Fix demo deployment codebuild stage Use development pipeline outputs Update to deploy pipeline before running pipeline Remove github auth in delete release environment Don't change release pipeline if not required Fix build branch Refactor Terraform Update buildspec to clean terraform modules Upgrade provider version * Remove unexpected changes * Add missing environment variable * Re add master to Github Workflow * Fix deployment bug (#301) * Fix incorrect variable in codepipeline (#302) * Renaming and redeploy performance-pipelines to perf-test-tools (#305) * DI-434 Pipeline to deploy Perf env with DoS API Mock (#303) * Swap perf and p2 environments * Add perf to delete api mock * Use correct database credentials * DI-443 Fix Delete Task Environments (#306) * Add github workflow diagram (#307) * DI-435 Performance Environment setup and change make targets (#304) * Swap perf and p2 environments * Add switch between perf and p2 profiles * Update Readme documentation * Fix rebase issue * DI-216 Batch Dentist Reporting (#297) * Initial commit * Fixed import error * removed testing print * Fixed open times reports * stuff * makefile addition * Commit * Added to gitignore * Fixed column heading mistake * Edited makefile paramters * Edited makefile paramters * Edited makefile paramters * Update p2 profile to perf-to-dos (#309) * DI-428 Add logging for change requests created (#310) * Add Dependabot config script (#312) * DI-446 Dependabot experiment to be recursive (#313) * DI-446 Add all Dependabot folder paths (#315) * DI-466 Add Dependabot branch naming pattern (#317) * DI-446 Remove AWS Public ECR from Dependabot (#318) * Bump actions/checkout from 2 to 3 (#314) Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3. - [Release notes](https://github.com/actions/checkout/releases) - [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md) - [Commits](https://github.com/actions/checkout/compare/v2...v3) --- updated-dependencies: - dependency-name: actions/checkout dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-451 Update Sonarcloud to include Serverless Framework and Terraform (#319) Attempt to update Sonarcloud to include SF and TF * DI-451 Fix coverage in Sonarcloud (#320) Fix coverage in sonarcloud * Fix coverage for Sonarcloud (#322) * Fix coverage for sonarcloud * Revert sonarcloud options change * Fix Unit Tests codebuild stage (#323) Update unit tests to work * DI-374 Triggering a Jenkins deploy from AWS Codebuild (#311) * Add a make target to trigger a Jenkins Job Add new codebuild stage security group Add codebuild stage for setting up integration test Use variable for mgmt vpc Add debug settings for make target Remove debug message and update version * Update release pipeline * Remove s3 module version * DI-445 Autodetect active organisation type flag (#308) * Update db checker sql query for single service pha * Update unit test * Build make target to autodetect active flag * Update terraform for pipeline modification * Add query for services count * Update relaease pipeline * Update unit test make target on pipeline buildspec * Update db checker handler unit test * Reformat unformatted python files (#321) Reduce duplications and code smells Experiment with test folder in sonarcloud Fix broken patch Fix coverage reports * DI-452 Add tfsec to security workflow (#324) * Add tfsec to security workflow * Add tfsec make target * Start TFSec security recommendations * More TFSec configuration * Set versions for terraform modules and more TFSec recommendations * Upgrade Terraform version to 1.2 * Revert Detect Changes change * Fix missing Dependabot dependency * DI-421 Updated readme and devops diagram (#295) * Updated readme * Add files via upload * Added instructions for DI-219 * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * WIP updating Readme & diagrams with pipeline and automations changes * Updating Diagrams with pipeline and automations changes * After review devops diagrams and readme changes * Change Artefact to UK English spelling Co-authored-by: Matthew Begley <matthewbegley@nhs.net> * DI-447 Security Scanning of Dockerfiles, Serverless Framework and Github Actions (#325) * Add default dependency review workflow * Add Checkov for Serverless, Docker and Terraform * Add make targets for checkov * Set Docker checks to not run/suppress checks * Suppress Github Actions warning * Start Terraform best practices * Remove Terraform checks * DI-447 Security Scanning of Terraform with Checkov (#326) * Add ignore for terraform checks with checkov * Enable checkov in Github Actions * DI-454 Upgrade tester image python version (#330) Upgrade test to python version 3.10.4 * DI-453 Refactor of change event generation (#327) Added new file to handle change events from dos * Bump django in /build/automation/lib/docker/image/python-app/example (#332) Bumps [django](https://github.com/django/django) from 3.2.7 to 3.2.13. - [Release notes](https://github.com/django/django/releases) - [Commits](https://github.com/django/django/compare/3.2.7...3.2.13) --- updated-dependencies: - dependency-name: django dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-455 Implement case statements in test suite (#333) Replaced elifs with case statements * Update Serverless deployment to use direct deployment (#329) * DI-456 Resolved circular dependencies in change event (#334) * Resolved circular dependencies in change event * Further amendments to resolve dependency issues * Applying changes from commit checks * DI-448 Set up dead code scanning (#331) * Add Vulture code * Exclude files that use by other lambdas * Improve TODO message * Exclude files that use by other lambdas * Add an unit test for reporter.py * Update Make Devops Library (#328) Update make devops library * Switch base branch name to main (#353) Set everything to use main branch name * Upgrade Terraform versions (#360) * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.2.0 to 3.3.0. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.2.0...v3.3.0) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.17.1. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.17.1) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Reduce Terraform upgrades to monthly (#354) * DI-449 Update and add Github Pull Request Checklists (#358) * Add basic template to be used when action runs * Update task and test PR templates * Simplify Workflow to use single file * Experiment with environment variables * Add test branches to regex * Reword template files Co-authored-by: Jack Plowman <jack.plowman1@nhs.net> * Bump python from 3.10.4 to 3.10.5 in /build/docker/tester (#370) * DI-465 Rename master to main in confluence (#372) Rename master to main in diagram and confluence Co-authored-by: Rohit <rohit.kondapalli1@nhs.net> * Remove Automatic Pull Request Bot (#369) * Change template folder name * Add new workflow * Update Github Actions * Fix incorrect directory * Refactor Github Actions and Workflows (#359) * Separate Secret Scanning and Security vulnerability scanning * Add update description workflow * Get branch name * Update description regex * Add multiple jobs to GH workflow * Separate checklist checker again * Add warning to PR template * DI-458 Add demo deployment to development pipeline (#373) Update pipeline to deploy to demo * DI-457 Refactor application code to remove dead code (#371) * Refactor unused variables * Fix comparison reporter * Fix unit tests * Reduce duplication in docker build steps (#377) * Simplify docker build steps * Save specific CMD to docker image * Remove unused code * Add demo deployment fixes * Remove debug command * Update Terraform AWS Provider (#388) * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.16.0 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.16.0...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.18.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.18.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix development pipelines and Remove duplicated make targets (#390) * Remove duplicated make targets and fix development pipeline * Remove extra line * Fix entrypoint to docker images * Fix Dos API Gateway Mock (#392) * Fix dos api gateway mock * Revert health check checker * Increase unit test coverage * Revert event sender * Fix not running unit tests * DI-466 Remove redundant utils function (#396) * DI-463 Refactored several steps for dos ce (#368) * Refactored several steps for dos ce * Removed commented out stuff * Event type added to fix in parent steps * Changed event type to org type * Resolved issues with tests * Removed change made to utils for troubleshooting * Updated some intermittently failing cases * Resolved the code quality error * Added issue occurring with split opening times * Update dentist demographics data and fix ods bug * Update failing scenario step * Removed get payload function as not in develop Co-authored-by: mik3ola <michael.olaw1@nhs.net> * DI-467 Check ECR scanning reports for vulnerabilities (#374) * Add scanning results make targets * Improve ECR image scanning make target * Put Image scanning on the correct buildspec * Fix Github Workflows and Improve Unit Test Coverage (#395) Improve Unit Testing Bump chuhlomin/render-template from 1.4 to 1.5 Bumps [chuhlomin/render-template](https://github.com/chuhlomin/render-template) from 1.4 to 1.5. - [Release notes](https://github.com/chuhlomin/render-template/releases) - [Commits](https://github.com/chuhlomin/render-template/compare/v1.4...v1.5) --- updated-dependencies: - dependency-name: chuhlomin/render-template dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Add mutation tests Slim down repetitive make targets Update Github Actions add improve unit Add temporary full mutation test run Fix mutation test results and Github Action names Reduce scope of mutations Start process to only run against folder that have changed Simplify filters for mutation testing Silence output from make target Add rest of lambda folders Update Github Workflow to use matrix Use correct matrix name Improve unit tests Continue to improve unit tests Increase unit test coverage Update pip as part of docker build Exclude logger and tracer lines Improve test coverage * Bump actions/dependency-review-action from 1 to 2 (#397) Bumps [actions/dependency-review-action](https://github.com/actions/dependency-review-action) from 1 to 2. - [Release notes](https://github.com/actions/dependency-review-action/releases) - [Commits](https://github.com/actions/dependency-review-action/compare/v1...v2) --- updated-dependencies: - dependency-name: actions/dependency-review-action dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix Performance Test Runner (#398) Fix performance tests using incorrect environment * DI-469 Fix Opening times scenario failure bug (#399) Correct change event schema data * Refactor Integration Test Suite (#401) Refactor Test Suite Remove change_request function and file Remove useless variable initialisation Fix PR description updater Type hint and introduce variables Use constant aliases for service type matching * Fix Performance Test Tools Slack Notification (#400) * Use slack webhook rather than sns topic * Remove unused data source * Remove unused variables * Fix workflow using branch name rather than designator * Update Cloudwatch dashboard and queries (#403) * Update Cloudwatch dashboard and queries Fix github action * Update incorrect echo in github action * DI-476 Hotfix - Remove publicname change ability (#406) * Remove publicname change ability and update unit tests * Python code formatting * Add public name int test scenario * Update env variable for special xter test * Fix test step and feature change when rebasing to develop Co-authored-by: Matthew Begley <matthewbegley@nhs.net> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Refactor Integration Test to build Change Events using Class (#402) * Create ChangeEventBuilder and ChangeEvent * Move away from dataclass for ChangeEvent class * Migrate build same as DoS function into ChangeEventBuilder class * Fix phone bug * Migrate ChangeEventBuilder into separate file * Remove debug line * Refactor Opening Times check * DI-489 Hotfix bug fixes release 1-0-4 (#414) * DI-481 Changed overlap definition and added unit tests (#409) * Changed overlap definition and added unit tests * DI-490 Integration tests for same closing and opening time (#411) * Branch change for hotfix * Removed dentist test as not supported * Removed the kit tag Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> * DI-480 Website Validation Hotfix (#410) * Add website validation * Handle if http/https is not in URL * Fix unit tests and update changes to exclude empty string * Add additional unit tests and fixes * Remove debugging print statement * Test scenarios for url variations Co-authored-by: mik3ola <michael.olaw1@nhs.net> Co-authored-by: Sam Clayton <SLClayton@users.noreply.github.com> Co-authored-by: Corbisc <95412908+Corbisc@users.noreply.github.com> Co-authored-by: mik3ola <michael.olaw1@nhs.net> * Fix integration tests from hotfix (#415) Fix integration tests * DI-482 Dynamodb Cloner Kms Key Access (#413) * Add developer access to KMS key so that dbcloner can use key * Fix broken role permission * DI-470 Refactor Steps File and Context Variable (#404) * Refactor Test Suite Rename steps file and rebuild context dictionary into class Move away from dataclass for ChangeEvent class Migrate build same as DoS function into ChangeEventBuilder class Fix phone bug Migrate ChangeEventBuilder into separate file Remove debug line Refactor Opening Times check Remove positive check function to allow negative checks Fix missing fixture in integration tests Change line to create change request Use context class instead of dictionary Python formatting fixes Follow python standards Remove duplicated functionality Remove run id Use change event class until sent to API instead of dictionary Add a test step summary Handle when there is no context fixture Fix broken test when change_event moved from dictionary to class Fix more test failures More test failure fixes More test failure fixes Remove extra log line Improve run id Fix missing variable changes Fix test failures Add line to trigger CR Generate unique key Add temporary flakey test solution Use pytest fixture instead of building it in step Reduce duplicated functionality Change sequence test to make sense Add unique key Use unique correlation id for each run Remove odscode from list of usable odscode Increase get service id timeout Increase reliability of website and phone numbers Reduce duplication in feature files Reformat feature files Change back to use reruns Add feature to auto fail if status code is wrong Fix missing case statement Increase timeout for retries Fix odscode error and incorrect sequence number error Exclude specific sequence numbers from failing tests Trial using default CE Add address change check Use valid postcode in default event * Start to fix after rebase * Increase timeouts to make some tests more reliable * Merge website steps * Add additional retry to improve reliability * Reduce duplications of dynamodb checking * Increase delay between retries * Upgrade Terraform versions (#430) * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws in /infrastructure/modules/s3 Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/random in /infrastructure/stacks/api-key Bumps [hashicorp/random](https://github.com/hashicorp/terraform-provider-random) from 3.3.0 to 3.3.2. - [Release notes](https://github.com/hashicorp/terraform-provider-random/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-random/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-random/compare/v3.3.0...v3.3.2) --- updated-dependencies: - dependency-name: hashicorp/random dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/appconfig Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/perf-test-tools Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/before-lambda-deployment Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/api-key Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/dos-api-gateway-mock Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/release-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.17.1 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.17.1...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump hashicorp/aws in /infrastructure/stacks/development-pipeline Bumps [hashicorp/aws](https://github.com/hashicorp/terraform-provider-aws) from 4.18.0 to 4.21.0. - [Release notes](https://github.com/hashicorp/terraform-provider-aws/releases) - [Changelog](https://github.com/hashicorp/terraform-provider-aws/blob/main/CHANGELOG.md) - [Commits](https://github.com/hashicorp/terraform-provider-aws/compare/v4.18.0...v4.21.0) --- updated-dependencies: - dependency-name: hashicorp/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Bump terraform-aws-modules/s3-bucket/aws Bumps [terraform-aws-modules/s3-bucket/aws](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket) from 3.2.3 to 3.3.0. - [Release notes](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/releases) - [Changelog](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/blob/master/CHANGELOG.md) - [Commits](https://github.com/terraform-aws-modules/terraform-aws-s3-bucket/compare/v3.2.3...v3.3.0) --- updated-dependencies: - dependency-name: terraform-aws-modules/s3-bucket/aws dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Upgrade after lambda deployment terraform stack Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Add Python Script for downloading a Dynamodb Table to CSV (#433) * DI-442 Adjusting lambda performance (#431) * Initial commit * Added a bunch of debug logs * Added new get locations method method * Fixed untit tests * Added for redeploy * fixed vars bug * Removed most of timing loggings * Checking for errors * Changed lambda size for event processor * Testing changes * Testing changes * test bug fix * Changing for new commit comment * DI-472 Add change to remove specified dates in the past (#434) * Add change to remove specified dates in the past * Refinements and test improvements * Improve unit tests * Refactoring of update_changes_with_opening_times function * Refinements after review * DI-477 Integration tests for past opening times (#437) Updated test to be valid for functionality * DI-493 Create generic error report (#435) * Added to generic log output extras * Edited log error info message * Updated again to include more of last * Fix Invalid Website Integration Test (#438) Fix Error handling test * DI-485 Reduce change event size for logging (#436) * Reduce change event size for logging * Update one more test senario * Fix Release Branch Pipeline (#441) Fix release codepipeline * Add mock lambdas back into release pipeline (#442) * Performance Tests Improvements (#443) * Fix performance tests to update all fields * Modify Address to always be unique * DI-478 Update Address received from NHS.UK to title case (#416) * Start title casing address * Start fixing unit tests * Fix last unit test * Add new apostrophe and ampersand rules * Fix bug with apostrophes not being replaced * Update Documentation for release 1.0.4 (#444) * Clean up diagrams * Set background to white * Rename drawio files * DI-498 Tests for title case address (#439) Start title casing address Start fixing unit tests Fix last unit test Add new apostrophe and ampersand rules Fix bug with apostrophes not being replaced Address line title case tests Update duplicate step function name Update address variation tests Update address variation test scenario * DI-475 Update cloudwatch alarms for slack (#432) * Fix alerts and add alert for 400 Error * Use correct alert selector * Make change_event_endpoint_4xx_errors_alert actually error * DI-488 Sqs and slack alert test cases (#450) * Removed imported library that wasn't used * Slack tests as a wip * Sqs queue injection update * Test cases now running but requiring token * Updated delay so the test doesnt timeout * Updated the makefile to run properly * Updated tags on test cases * Tag images when the release branch is deleted (#447) * Re tag images when the release branch is deleted * Fix invalid sed statement * Add retag images to documentation * Add Error Rate to Cloudwatch Dashboard (#445) * Remove unused serverless variable * Update cloudwatch dashboard * Rename file to reflect infrastructure included in file * DI-537 Slack timing update for cloudwatch changes (#458) Updated timings on Slack tests * DI-518 Direct DoS DB Connection (#457) * Connect Directly to DoS DB Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug * Fixed hash function for OpenPeriod and added unit tests * Attempt to fix specified opening times * Attempt to fix another specified opening times/service histories bug * Set none in services table to empty string * Fix generic bank holiday error Co-authored-by: SLClayton <SLClayton@users.noreply.github.com> * DI-519 Tests for DI-518 (#473) * Trying to figure out errors with loading opening times * Begin changing tests to work with DI-518 * Get F001S001 to work * Fix integration test F001S003 & F001S005 * Fix most of F001 tests * Added functions to generate new ods * Fix more integration tests * Test and Fix all tests except F006 * Fix all opening times tests * Add back in test retries * Improve unit test coverage Co-authored-by: Kit <christopher.corbishley1@nhs.net> * DI-517 Add documentation for new DI Architecture (#456) * Add ADR for decision * New architecture diagrams * Add a security group diagram * Update DB connections diagram * Update Diagrams with latest information * Add dos_db_handler warning message * DI-518 Fix deleting security group (#485) Attempt to fix security group being deleted * DI-533 Update Cloudwatch Dashboard and Add New Cloudwatch Alarms (#469) * Add new alarms Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Trying to figure out errors with loading opening times Begin changing tests to work with DI-518 Get F001S001 to work Fix integration test F001S003 & F001S005 Fix most of F001 tests Added functions to generate new ods Fix more integration tests Test and Fix all tests except F006 Fix all opening times tests Add back in test retries Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric * Fix rebase issue * DI-553 Update sqs test failures (#476) * Connect Directly to DoS DB Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Trying to figure out errors with loading opening times Begin changing tests to work with DI-518 Get F001S001 to work Fix integration test F001S003 & F001S005 Fix most of F001 tests Added functions to generate new ods Fix more integration tests Test and Fix all tests except F006 Fix all opening times tests Add back in test retries * Updated sqs test cases and reworded features Ran the python import sort Removed some unnecessary comments * Updated change to project file Co-authored-by: Jack Plowman <jack.plowman1@nhs.net> * DI-546 Python Security Scanning (#470) * Python security scanning Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric Add python code security check Improve test performance on reruns * Add is closed unit test * Fix rebase issue * Fix delete current value * Fix specified opening times bug * DI-534 Handle DoS DB Failures (#474) * Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric * Add python code security check * Create health check path in service sync Update cloudwatch dashboard Improve metrics names and behaviour Add new unit tests and log messages * Add health check for replica db as well * Update healthcheck exception unit test * Add cloudwatch alarm * Bump python from 3.10.5 to 3.10.6 in /build/docker/tester (#471) Bumps python from 3.10.5 to 3.10.6. --- updated-dependencies: - dependency-name: python dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * DI-560 Service history checks for integration (#486) * Added new steps for negative service history * Updated logic to check for recent events * Updated for errors when running * Updated features to use new steps * Removed kit tag from feature * Added brackets to a function * Updated to return data rather than array * Fixed a couple of edge cases causing failures * Updated logic for change add switches * Improve unit test coverage (#488) * Improve opening times unit test coverage * Start covering changes to dos branches * Fix import error * Continue covering changes to dos branches * DI-558 Service history specified dates tests (#487) * New step to enable checking specified opening times * Updated to support closed and be more resilient * Removed the kit tags * Updated some utils and added removed comments * Updated format of comments * Updated comment format again * Renamed check service history specified function * Changed comments from hash to speech marks * DI-524 Log Service Update to DoS (#477) * Work in progress python logging Refactoring application folder Remove DoS API Gateway references from project files Start connecting to replica for service matcher lambda Set up connection between Service Matcher and Service Sync Start save to db process Begin expanding to public phone Save update into database Save service history and delete sqs message Add address and postcode comparison back in Fix address and postcode changes, remove unused function Get service history working when no service history exists Continue working on standard opening times comparison Add specified opening times to service history Move to new lambda and queue names Fix unit tests Revert security group changes and fix iam roles Set service history to use correct timezone Fix unit tests Revert python checks and fix formatting Add standard opening times and specified opening times Refactor and reduce dead code Remove trace id from application name Check python import format Format Python imports Add docstrings and unit tests Fix python formatting Improve unit tests, type hinting and docstrings Fix isort not checking Sort out perf environment Remove unnecessary demo folder Optimise and fix specified opening times Move day id to opening_times.py Increase unit test coverage Continue to improve unit tests Continue to improve unit tests Continue to improve unit tests Fix service histories bug Fixed hash function for OpenPeriod and added unit tests Attempt to fix specified opening times Attempt to fix another specified opening times/service histories bug Set none in services table to empty string Fix generic bank holiday error Update cloudwatch alarms and dashboards Add Cloudwatch Alarms Add more alarms Add change event received metric Add python code security check Create health check path in service sync Update cloudwatch dashboard Improve metrics names and behaviour Add new unit tests and log messages Work in progress python logging Fix unit tests Log demographics update to DoS Change splunk filter * Add opening times update message * Improve unit test coverage * Turn off sending logs in demo environment * Change filter and add more unit tests * Change log format * Fix bug when value is null * Fix duplicate previous opening times bug * Fix UnboundLocalError issue * Change readme documentation * DI-559 Standard Opening Times Service History Checks (#490) * New step to enable checking specified opening times * Updated to support closed and be more resilient * Removed the kit tags * Added new steps and utils for standard opening times * Assertions now functioning with open dates * Updated to support closed standard day checks * Updated with some comment feedback * Updated logic for add and remove * Updated return type and var names * Updated format of assertions and added support for modify * Added new tests to force status in sh * Running but with inconsistencies * Updated for stability and consistency changes * Ran the python sort imports * Fix application bugs (#504) Fix rebase issues * DI-538 Send Email Documentation (#491) Add Send Email documentation Update testing documentation for s3 trigger Change Architecture Diagram Add delete email lambda Add ADR for sending emails Update who decided email sending architecture * Revert IAM Changes & Refactor Image Roles (#492) * Attempt to fix lambda roles deletion * Add back in old lambda names * Ignore security warning on wildcards * Remove role for sending emails * DI-539 Handle DoS Location Data (#489) * Move dos location tests to new file and pick up postaltown from table * Update the service table with updated location data * Refactor logging to guarantee service updates have been saved to db * Fix existing unit tests * Refactor to separate comparison wrapper functions * Improve unit test coverage * Add debug log * Update db in a way apostrophes are escaped * Fix python imports formatting * Add PR review changes * Increase Integration Test Reliability (#508) Increase test time to increase reliability * DI-578 Change the change action from remove to delete (#509) * Change the change action from remove to delete * Fix integration tests * Increase delay to improve test reliability * DI-541 Add additional metrics for splunk dashboards (#511) Add additional metrics for splunk dashboards * Update automation scripts (#512) * Remove duplicated files (#515) * DI-579 Service History Location Update Integration Tests (#514) * Initial push with changes to dos handler * Added new query to dos handler * Updated formatting to be nicer * Updated to use existing steps * Updated column name for table * More efficient way to verify location data * Added new generic test function * Added service history check for locations data * Sorted out tags and makefile issue * Updated function name to make more sense * Improve DoS Integration Documentation (#516) * Start reworking README documentation * Update more documentation * Update more documentation * DI-556 Service Update Report (#519) Add service update log for ServiceUpdateReport * DI-514 Assuring existing DoS invalid openings don't break (#518) * Added test for invalid existing dos times * import format changes * Committing again so I can have a new message. * Trying commit comment again * DI-532 Reject DoS Pending Changes and Initiate Email (#507) * Add email architecture Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Fix rebase issues * Add dummy values and inner join on query * Fix unit tests * Fix development pipeline (#522) * DI-570 Add NHS Mail SMTP Configuration (#517) * Send emails for rejected pending change Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Fix rebase issues Send emails for rejected pending change Add S3 notification for send email Add SQL to reject changes Add change rejection logs and start on email template Add functionality to put email into s3 bucket Start to add unit tests Add more unit test coverage Fix dead code Format change rejection email Fix send email lambda Fix python import formatting Remove temporary file after it has been saved to s3 Remove python security warning Improve email so that it can be linked back to correlation id Fix couple of minor bugs Revert security changes Set up common variables in terraform Add basic email configuration Get emails working Add some unit tests Refactor variables to reduce duplication Fix unit tests Modify implementation to use SMTP email Add more unit tests and delete dead code Modify email to send HTML Remove ses config Remove user data from logs * Fix unit tests * Refactor to hide event and remove unreachable code * DI-562 Blank Opening Times Reporting (#521) * Added new report logging * Changed some formatting * Added more test stuff * DI-583 Email Monitoring Alarm (#523) * Add metrics for when emails fail * Fix undeploy make target * Fix unit tests and add new test * DI-523 Use correct DoS Nonprod Database Role (#528) * Use specific database role * Improve test reliability and remove debug log * Fix performance variables * DI-592 Fix a couple of bugs (#524) Fix a couple of bugs * DI-600 Increase DoS Version in Regressiondi Environment (#529) Increase DoS Version * DI-523 Update Production profiles for release 3.0 (#530) Add Production profiles for release 3.0 * DI-606 Fix production deployments (#532) Remove role condition as lambda doesn't have condition * DI-585 Create Integration Tests for Emails (#533) * Added new features and utils to run s3 file checks for email * Updated insert to not expect result * Updated json insert to try and make it parse * Updated formatting of the json string * Further changes to the formatting * Converted json to string * Added strings in triple quotes * Added returning to the dos db handler * Updated the spacing for commit checks * Added some escape characters * Used the existing method in handler * Updated to use new query structure * Updated to use json * Removed using json library * Added extra speech marks * Removed the extra speech marks * Sams solution being tested * Added raw string format * Updated function to use entirely args * Updated to use new connection settings * Neatened up the insert code for query * Updated commit to add new formatting * Updated services in dos handler * Removed pathwaysdos from services path * Updated the formatting of the query * Trying to get around auto formatting * Reverted to less readable format * Updated logic to use uid instead of id * Removed unnecessary f string * Removed makefile changes and unused tags * Added new entry in dos db handler * Added new test case to check rejection * Repushing to make new env * Updated method of committing to db * Updated to use default user * DI-523 Add second sg inbound rule for replicas in specific environments (#534) Add second inbound rule for replicas in specific environments * DI-523 Fix incorrect Terraform condition (#536) Add second inbound rule for replicas in specific environments * DI-591 Disable address formatting (#535) * Disable address formatting * Fix more integration Tests * DI-571 Delete Old Emails From S3 Bucket (#537) Use S3 lifecycle rule to delete old emails * DI-595 Fix exception being logged with PID (#527) * Fix exception being logged with PID * Hide error message and add checkpoints * Improve logging and alphabetically order classes * Fix JSON decode error * Fix python imports * DI-596 Censor pid in sql logs (#531) * Added option in query func to censor * Formatting changes to code * DI-526 Performance Testing and Test Upgrades (#526) * Bump up rate limit * Remove unused data collection from repo * General refactoring of performance tests * Refactor performance test * Reduce number of variables set * Fix unit tests * Make generic performance test function * DI-550 Add more tags to Terraform and Serverless Framework (#540) * Add more tags to Terraform and Serverless Framework * Removed unused cloudformation condition * Confirm same tags are used in Terraform and Serverless Framework * Remove unused variables * DI-557 Script to compare specified opening times (#525) * WIP script to compare specified opening times * Improve formatting of python script * Update compare script readme * Fix readme format issue * DI-580 Disable Serverless Framework Rollback (#543) Disable rollback to protect from broken state * DI-607 Turn back on address formatting (#544) Turn back on address formatting * DI-576 Deployment bucket objects encryption (#545) Kms encrypt objects within the deployment version * DI-561 Add Route53 Health Check (#541) * Add Route53 Health Check * Modify task branch checklist * DI-561 Rename alarm region variable (#548) Rename alarm region variable * DI-509 Document how to group change events (#505) * Update Infrastructure diagrams * Update Infrastructure diagrams * Add adr decision record * Fix Release Pipeline Terraform (#539) Fix release pipeline * DI-615 Blue Green deployment architecture (#549) * Move diagrams to future diagrams folder * Add decision records for blue/green * Fix architecture diagram * DI-651 Set AWS PowerTools Python Version (#554) Set AWS Powertools version back to 1.31.1 * DI-598 Comparion reports for error checking (#542) * Edited report format * Added reports forupdate errros * comment * Reporting out * comment * Readme * formatting changes * Unit test fixing * Changed ddb table locatiresource local * Fixing unit tests in code * Fixing unit tests in code * Comment * Changes * Multithreaded ddb scanning for speedup * Added new mock resource for ddb * Testings * Testings * Added unit test for error reports * Added unit test for error reports * Added unit test for error reports * Added unit test for error reports * Added unit test for error reports * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Added stuff for unit tests * Changed makefile python co…
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.