Skip to content

feat: add rule AZ-STOR-004 storage account diagnostic logging check#39

Merged
Vishnu2707 merged 2 commits into
openshield-org:devfrom
SHAURYAKSHARMA24:rule/az-stor-004-storage-diagnostic-logging
May 13, 2026
Merged

feat: add rule AZ-STOR-004 storage account diagnostic logging check#39
Vishnu2707 merged 2 commits into
openshield-org:devfrom
SHAURYAKSHARMA24:rule/az-stor-004-storage-diagnostic-logging

Conversation

@SHAURYAKSHARMA24
Copy link
Copy Markdown
Collaborator

Adds AZ-STOR-004 to detect storage accounts with diagnostic logging not fully enabled on blob, queue, or table services. Emits one finding per non-compliant service. Adds get_storage_service_logging() to AzureClient and fix_az_stor_004.sh playbook. Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1. Closes #23

Shaurya K Sharma added 2 commits May 9, 2026 19:22
Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1
Copy link
Copy Markdown
Member

@Vishnu2707 Vishnu2707 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

small issue in scanner/azure_client.py

HttpResponseError is used inside get_storage_service_logging(), but I don’t see the import added at the top.

please add:

from azure.core.exceptions import HttpResponseError

otherwise this will throw NameError when that exception path executes.

@SHAURYAKSHARMA24
Copy link
Copy Markdown
Collaborator Author

I checked, and it’s already included on line 6.

Copy link
Copy Markdown
Member

@Vishnu2707 Vishnu2707 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved!

@Vishnu2707 Vishnu2707 merged commit d4384fe into openshield-org:dev May 13, 2026
1 check passed
Vishnu2707 added a commit that referenced this pull request May 16, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes #30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Vishnu2707 added a commit that referenced this pull request May 24, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes #30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

* [RULE] AZ-CMP-003: VM without endpoint protection installed (#57)

* feat: add scanner rule AZ-CMP-003 — VM without endpoint protection installed

This script scans Azure VMs to check for the presence of recognized endpoint protection extensions. It logs findings for VMs without the required protection.

* feat: add remediation playbook fix_az_cmp_003.sh

This script installs endpoint protection on Azure VMs based on the operating system specified. It supports both Linux and Windows VMs.

* feat: add AZ-CMP-003 to CIS compliance framework

* feat: add AZ-CMP-003 to NIST compliance framework

* feat: add AZ-CMP-003 to ISO27001 compliance framework

* feat: add AZ-CMP-003 to SOC2 compliance framework

* feat: add get_vm_extensions method to AzureClient

Add method to retrieve VM extensions for a given VM.

* fix: correct indentation and return type in get_vm_extensions

* Add  1 more space in the code

* add 4 space beofre def 

Add method to retrieve VM extensions for a given VM.

* [DOCS] Add OpenShield learning and onboarding portal (#51)

* docs: add OpenShield learning portal

* Fix formatting for Learn OpenShield section

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Vishnu2707 added a commit that referenced this pull request May 24, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes #30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

* [RULE] AZ-CMP-003: VM without endpoint protection installed (#57)

* feat: add scanner rule AZ-CMP-003 — VM without endpoint protection installed

This script scans Azure VMs to check for the presence of recognized endpoint protection extensions. It logs findings for VMs without the required protection.

* feat: add remediation playbook fix_az_cmp_003.sh

This script installs endpoint protection on Azure VMs based on the operating system specified. It supports both Linux and Windows VMs.

* feat: add AZ-CMP-003 to CIS compliance framework

* feat: add AZ-CMP-003 to NIST compliance framework

* feat: add AZ-CMP-003 to ISO27001 compliance framework

* feat: add AZ-CMP-003 to SOC2 compliance framework

* feat: add get_vm_extensions method to AzureClient

Add method to retrieve VM extensions for a given VM.

* fix: correct indentation and return type in get_vm_extensions

* Add  1 more space in the code

* add 4 space beofre def 

Add method to retrieve VM extensions for a given VM.

* [DOCS] Add OpenShield learning and onboarding portal (#51)

* docs: add OpenShield learning portal

* Fix formatting for Learn OpenShield section

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* refactor: reuse database connection per request using Flask g (#41)

* fix: improve scan routes error handling and database reuse

* fix: add database connection reuse and DATABASE_URL validation to score.py

* fix: add database connection reuse, DATABASE_URL validation, and FileNotFoundError handling to compliance.py

* fix: enforce JWT_SECRET environment variable, remove hardcoded default

* ci: trigger fresh CI run

* fix: all requirements - g.db naming, teardown, close() method

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Co-authored-by: Safid Nadaf <137755124+safidnadaf@users.noreply.github.com>
Vishnu2707 added a commit that referenced this pull request May 25, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes #30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

* [RULE] AZ-CMP-003: VM without endpoint protection installed (#57)

* feat: add scanner rule AZ-CMP-003 — VM without endpoint protection installed

This script scans Azure VMs to check for the presence of recognized endpoint protection extensions. It logs findings for VMs without the required protection.

* feat: add remediation playbook fix_az_cmp_003.sh

This script installs endpoint protection on Azure VMs based on the operating system specified. It supports both Linux and Windows VMs.

* feat: add AZ-CMP-003 to CIS compliance framework

* feat: add AZ-CMP-003 to NIST compliance framework

* feat: add AZ-CMP-003 to ISO27001 compliance framework

* feat: add AZ-CMP-003 to SOC2 compliance framework

* feat: add get_vm_extensions method to AzureClient

Add method to retrieve VM extensions for a given VM.

* fix: correct indentation and return type in get_vm_extensions

* Add  1 more space in the code

* add 4 space beofre def 

Add method to retrieve VM extensions for a given VM.

* [DOCS] Add OpenShield learning and onboarding portal (#51)

* docs: add OpenShield learning portal

* Fix formatting for Learn OpenShield section

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* refactor: reuse database connection per request using Flask g (#41)

* fix: improve scan routes error handling and database reuse

* fix: add database connection reuse and DATABASE_URL validation to score.py

* fix: add database connection reuse, DATABASE_URL validation, and FileNotFoundError handling to compliance.py

* fix: enforce JWT_SECRET environment variable, remove hardcoded default

* ci: trigger fresh CI run

* fix: all requirements - g.db naming, teardown, close() method

* docs: add security policy, issue template, and README badges (#64)

* feat: add rule AZ-KV-004 Key Vault purge protection disabled (#55)

* feat: add rule AZ-KV-004 Key Vault purge protection disabled

* fix: address PR review feedback for AZ-KV-004

- Add SOC2 CC9.1 mapping to FRAMEWORKS dict
- Add AZ-KV-004 entries to all four compliance framework JSON files
- Add set -euo pipefail to playbook
- Add resource_group to metadata dict

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Co-authored-by: Safid Nadaf <137755124+safidnadaf@users.noreply.github.com>
Co-authored-by: Abdulbosit Abdurazzakov <2d9c6kh58x@privaterelay.appleid.com>
Vishnu2707 added a commit that referenced this pull request May 29, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes #30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

* [RULE] AZ-CMP-003: VM without endpoint protection installed (#57)

* feat: add scanner rule AZ-CMP-003 — VM without endpoint protection installed

This script scans Azure VMs to check for the presence of recognized endpoint protection extensions. It logs findings for VMs without the required protection.

* feat: add remediation playbook fix_az_cmp_003.sh

This script installs endpoint protection on Azure VMs based on the operating system specified. It supports both Linux and Windows VMs.

* feat: add AZ-CMP-003 to CIS compliance framework

* feat: add AZ-CMP-003 to NIST compliance framework

* feat: add AZ-CMP-003 to ISO27001 compliance framework

* feat: add AZ-CMP-003 to SOC2 compliance framework

* feat: add get_vm_extensions method to AzureClient

Add method to retrieve VM extensions for a given VM.

* fix: correct indentation and return type in get_vm_extensions

* Add  1 more space in the code

* add 4 space beofre def 

Add method to retrieve VM extensions for a given VM.

* [DOCS] Add OpenShield learning and onboarding portal (#51)

* docs: add OpenShield learning portal

* Fix formatting for Learn OpenShield section

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* refactor: reuse database connection per request using Flask g (#41)

* fix: improve scan routes error handling and database reuse

* fix: add database connection reuse and DATABASE_URL validation to score.py

* fix: add database connection reuse, DATABASE_URL validation, and FileNotFoundError handling to compliance.py

* fix: enforce JWT_SECRET environment variable, remove hardcoded default

* ci: trigger fresh CI run

* fix: all requirements - g.db naming, teardown, close() method

* docs: add security policy, issue template, and README badges (#64)

* feat: add rule AZ-KV-004 Key Vault purge protection disabled (#55)

* feat: add rule AZ-KV-004 Key Vault purge protection disabled

* fix: address PR review feedback for AZ-KV-004

- Add SOC2 CC9.1 mapping to FRAMEWORKS dict
- Add AZ-KV-004 entries to all four compliance framework JSON files
- Add set -euo pipefail to playbook
- Add resource_group to metadata dict

* feat: add AZ-STOR-005 geo-redundant storage rule (#74)

- scanner/rules/az_stor_005.py: detects storage accounts using LRS or ZRS
  (non-geo-redundant) replication; flags them as MEDIUM severity
- playbooks/cli/fix_az_stor_005.sh: CLI remediation to update storage account
  SKU to a geo-redundant option (Standard_GRS by default); validates target
  SKU against allowed geo-redundant values
- compliance/frameworks/*.json: adds AZ-STOR-005 entry to CIS Azure Benchmark
  (3.1), NIST CSF (PR.IP-4), ISO 27001 (A.17.2.1), and SOC 2 (A1.2)

Closes #71

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-DB-004 SQL Server firewall allows all Azure services (#70)

* feat: add rule AZ-DB-004 SQL Server firewall allows all Azure services

- Add scanner rule az_db_004.py detecting SQL Servers with Allow Azure services firewall rule enabled
- Add remediation playbook fix_az_db_004.sh
- Add get_sql_server_firewall_rules method to AzureClient
- Add AZ-DB-004 entries to all four compliance framework JSON files

* fix: add get_sql_server_firewall_rules to AzureClient

* fix: remove duplicate import, fix indentation, add return None to auditing policy

* docs: add 6 README badges (#79)

* feat: add AZ-KV-005 Key Vault certificate expiring within 30 days (#75)

* Remove duplicate import of MonitorManagementClient

* Add method to get Key Vault certificates

Added a new method to list certificates in a Key Vault.

* Add AZ-KV-005 rule for expiring Key Vault certificates

This script scans Azure Key Vaults for certificates that are expiring within 30 days and do not have auto-renewal enabled. It logs findings and provides remediation steps.

* Add script to enable auto-renewal for Key Vault certificate

This script enables auto-renewal for an expiring Key Vault certificate by updating its policy.

* Add controls for Azure Key Vault security measures

* Add AZ-KV-005 control for certificate maintenance

* Add controls for key management and availability

* Add SOC 2 controls for Azure Key Vault risk mitigation

* Fix indentation in get_key_vaults method

* Add azure-keyvault-certificates dependency

* Enhance script error handling with pipefail option

* Refactor lifetime_actions assignment for clarity

* Add control for expiring certificate maintenance

Added a new control for certificate maintenance in Azure Key Vault.

* fix: add missing comma in soc2.json after AZ-KV-005 entry

* fix: add missing comma in iso27001.json after AZ-KV-005 entry

* [RULE] AZ-CMP-004: VM without automatic OS patching enabled (#73)

* Added az_cmp_004.py to check VM patching status

This script checks Azure VMs for automatic OS patching status and collects findings for those without it enabled.

* Added script to enable automatic OS patching for VMs

This script enables automatic OS patching for both Windows and Linux VMs in Azure. It requires a resource group and VM name as input, defaulting to Windows if the OS type is not specified.

* Add control for OS patching requirement in CIS benchmark

* Add vulnerability management control to NIST CSF

* Added control AZ-CMP-004 for vulnerability management

* Added SOC 2 controls for endpoint protection and OS patching

* Fix JSON formatting in cis_azure_benchmark.json

* Fix JSON formatting in nist_csf.json

* Improve error handling in fix_az_cmp_004.sh

Updated script to use 'set -euo pipefail' for better error handling.

* Update patching condition for Windows configuration

Refine condition for patching approval based on patch mode.

* Fix indentation and formatting in az_cmp_004.py

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Co-authored-by: Safid Nadaf <137755124+safidnadaf@users.noreply.github.com>
Co-authored-by: Abdulbosit Abdurazzakov <2d9c6kh58x@privaterelay.appleid.com>
safidnadaf pushed a commit to safidnadaf/openshield that referenced this pull request May 30, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (openshield-org#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (openshield-org#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (openshield-org#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (openshield-org#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (openshield-org#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (openshield-org#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (openshield-org#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (openshield-org#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes openshield-org#30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (openshield-org#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (openshield-org#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (openshield-org#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (openshield-org#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (openshield-org#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (openshield-org#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
safidnadaf pushed a commit to safidnadaf/openshield that referenced this pull request May 30, 2026
* chore: add skeleton files and requirements

* fix: remove embedded git repo

* Core Structure Created

* feat: build complete core — scanner engine, 10 rules, API, playbooks, compliance mappings, docs

* docs: replace ASCII architecture with interactive Mermaid diagram

* feat: Sentinel integration — ingest.py, 4 KQL rules, setup guide (openshield-org#12)

* feat: add sentinel/ingest.py — Log Analytics ingestion via HMAC-SHA256

* feat: add sentinel/__init__.py

* feat: add KQL rule — HIGH severity finding detected

* feat: add KQL rule — misconfiguration wave detection

* feat: add KQL rule — new resource type critical detection

* Delete sentinel/rules directory

* Create rules

* Delete sentinel/rules

* Add KQL rule for high severity findings

* Add Misconfiguration Wave detection rule

* Add KQL rule for persistent misconfiguration detection

* Add KQL rule for new critical resource types

This rule identifies new resource types with critical findings that have occurred in the last 24 hours, excluding known types from the last 30 days.

* Add script to generate test findings in JSON format

This script generates test findings related to security compliance and saves them in a JSON file.

* Add Sentinel integration test plan and results

Added a comprehensive test plan for Sentinel integration, detailing test objectives, results, and acceptance criteria for various KQL rules and data ingestion.

* docs: add sentinel integration setup guide

Added a comprehensive setup guide for integrating Sentinel with Azure, covering prerequisites, workspace creation, activation, environment variable setup, ingestion, log verification, KQL rules deployment, and incident verification.

* fix: add AZ-STOR-003 compliance mappings, correct NIST control to PR.DS-3

* docs: add real-world breach scenarios for all 10 starter rules (openshield-org#15)

* feat: add AZ-KV-002 key vault public access rule and remediation playbook (openshield-org#14)

* docs: update README with rule count, roadmap progress and contributors

* feat: add network security rules AZ-NET-003 to AZ-NET-010 (openshield-org#16)

* Add az_net_003.py to check NSG rules for port 443

This script detects Network Security Groups (NSGs) with unrestricted inbound access on port 443 and provides remediation guidance.

* Add AZ-NET-004 rule for empty NSG detection

This script detects Network Security Groups (NSGs) that have no custom security rules configured, providing details for remediation.

* Add AZ-NET-005 rule for DDoS protection check

This script detects virtual networks in Azure that do not have DDoS protection enabled and provides remediation steps.

* feat: add rule AZ-NET-006 — public IP unassociated with any resource

This rule detects public IP addresses that are not associated with any resource, providing details for remediation.

* feat: add rule AZ-NET-007 — Application Gateway without WAF enabled

This rule detects Application Gateways that do not have WAF enabled, logging findings and providing remediation steps.

* feat: add rule AZ-NET-008 — load balancer with no backend pool

This rule detects load balancers in Azure that are not configured with a backend pool, indicating potential misconfiguration or unnecessary costs.

* feat: add rule AZ-NET-009 — VPN gateway using outdated IKE version

This script detects VPN gateways using the outdated IKEv1 protocol and provides remediation steps to migrate to IKEv2.

* feat: add rule AZ-NET-010 — subnet with no NSG attached

This script detects subnets in Azure that do not have a Network Security Group (NSG) attached, logging findings and providing remediation guidance.

* feat: add playbook fix_az_net_003.sh

This script updates the NSG rule to restrict inbound traffic on port 443 to a specified IP range.

* feat: add playbook fix_az_net_004.sh

This script adds a default deny-all inbound rule to a specified NSG.

* feat: add playbook fix_az_net_005.sh

This script enables DDoS protection on a specified virtual network in Azure. It checks for required parameters and provides usage instructions if they are missing.

* feat: add playbook fix_az_net_006.sh

This script deletes unassociated public IP addresses in Azure.

* feat: add playbook fix_az_net_007.sh

This script enables WAF on an Application Gateway, ensuring compliance with the AZ-NET-007 rule.

* feat: add playbook fix_az_net_008.sh

Script to remediate AZ-NET-008 by deleting empty load balancers.

* feat:add script to update VPN connection to IKEv2

This script updates a VPN connection to use IKEv2, ensuring compliance with the AZ-NET-009 rule.

* feat: add playbook fix_az_net_010.sh

This script attaches a specified network security group to a given subnet in a virtual network, ensuring compliance with the AZ-NET-010 rule.

* Clarify description and add note for public-facing services

Updated the description to clarify the risk of exposing port 443 and added a note regarding public-facing services.

* Change severity level from MEDIUM to HIGH

* fix: AZ-NET-005 severity changed to LOW — DDoS Standard high cost on small subscriptions

* Add note about NetworkManagementClient usage

Added a note regarding the creation of NetworkManagementClient directly and suggested a follow-up for consistency.

* Add note about NetworkManagementClient usage

Added a note regarding the use of NetworkManagementClient and suggested a follow-up for consistency.

* Add additional security controls to CIS Azure benchmark

* Refine control descriptions in nist_csf.json

Updated descriptions for various controls to enhance clarity and specificity regarding remote access management, data protection, and security measures.

* fix: add AZ-NET-003 to AZ-NET-010 to ISO27001 compliance framework

Updated descriptions for various controls to clarify compliance requirements and improve security guidance.

---------

Co-authored-by: Vishnu Ajith <86302373+Vishnu2707@users.noreply.github.com>

* Feat/az stor 003 (openshield-org#21)

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* feat: add rule AZ-STOR-003 storage lifecycle policy check

* docs: add SOC 2 Type II compliance framework mapping (openshield-org#33)

* docs: add SOC 2 Type II compliance framework mapping for all 20 rules

Added SOC 2 Type II framework with detailed controls for security measures and compliance requirements.

* feat: add soc2 to FRAMEWORK_FILE_MAP in finding.py

add soc2.json to FRAMEWORK_FILE_MAP in finding.py

* feat: add soc2 to SUPPORTED_FRAMEWORKS in compliance.py

Added 'soc2' to the list of supported compliance frameworks.

* Add SOC 2 controls for data protection and management

* Refactor/azure client network methods (openshield-org#22)

* refactor: add get_virtual_networks() and get_public_ip_addresses() to AzureClient

* Refactor DDoS protection check to use azure_client

* refactor: AZ-NET-006 now uses azure_client.get_public_ip_addresses()

* feat: add CI pipeline with 6 automated checks (openshield-org#34)

- Python syntax check on all rule files
  - Rule structure validation (RULE_ID, SEVERITY, FRAMEWORKS) + RULE_ID uniqueness
  - Hardcoded credential scan
  - Playbook existence + bash syntax check for every rule
  - Compliance JSON validation for all four framework files (inc. soc2.json)
  - API syntax check
  - Compliance vs rule cross-reference check
  - CI summary step with per-check pass/fail table (if: always)
  - Fix duplicate DESCRIPTION assignment in az_net_003.py
  - Add pyyaml to requirements.txt for local YAML validation
  - Add docs/ci-pipeline.md with local run commands and design rationale
  - Update CI_PIPELINE_GUIDE.md with final PR description

Closes openshield-org#30

* docs: update .github/ISSUE_TEMPLATE/new_rule.md to reflect current codebase state

* docs: update .github/PULL_REQUEST_TEMPLATE.md to reflect current codebase state

* docs: update CONTRIBUTING.md to reflect current codebase state

* docs: update README.md to reflect current codebase state

* docs: update compliance/frameworks/iso27001.json to reflect current codebase state

* docs: update compliance/frameworks/nist_csf.json to reflect current codebase state

* docs: update docs/adding-a-rule.md to reflect current codebase state

* docs: update docs/architecture.md to reflect current codebase state

* docs: update docs/az-stor-003-test-plan.md to reflect current codebase state

* docs: update docs/azure-setup.md to reflect current codebase state

* docs: update docs/ci-pipeline.md to reflect current codebase state

* docs: update docs/sentinel-setup.md to reflect current codebase state

* docs: update sentinel/TEST_PLAN.md to reflect current codebase state

* docs: update docs/api-reference.md to reflect current codebase state

* docs: update docs/rules-reference.md to reflect current codebase state

* docs: update README.md for professional open source style

* docs: update CONTRIBUTING.md for professional open source style

* docs: update docs/adding-a-rule.md for professional open source style

* docs: update deployment guide to use Render instead of Azure App Service

* feat: add rule AZ-STOR-004 storage account diagnostic logging check (openshield-org#39)

* feat: add rule AZ-STOR-004 storage account diagnostic logging check

Detects Azure storage accounts where diagnostic logging is not fully
enabled on blob, queue, or table services. Emits one finding per
non-compliant service (StorageRead, StorageWrite, StorageDelete must
all be enabled). Adds get_storage_service_logging() to AzureClient
using MonitorManagementClient. Includes remediation playbook that
enables all three services in one run.

Frameworks: CIS 3.3, NIST DE.CM-7, ISO 27001 A.12.4.1

* chore: add AZ-STOR-004 compliance mappings

---------

Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>

* feat: add rule AZ-IDN-003 Adds scanner rule AZ-IDN-003 detecting Entra ID  (openshield-org#48)

* feat: add scanner rule AZ-IDN-003 — guest user invitations not restricted to admins

* feat: add remediation playbook fix_az_idn_003.sh

This script restricts guest user invitations to only admins and users with the Guest Inviter role in Azure Active Directory.

* feat: add AZ-IDN-003 to CIS compliance framework

Added control for guest invite restrictions to enhance security.

* feat: add AZ-IDN-003 to NIST compliance framework

* feat: add AZ-IDN-003 to ISO27001 compliance framework

Added control AZ-IDN-003 for user registration and de-registration process.

* feat: add AZ-IDN-003 to SOC2 compliance framework

* feat: add rule AZ-CMP-002 — VM disk not protected by CMK or ADE (openshield-org#47)

* feat: add scanner rule AZ-CMP-002 — VM disk not protected by CMK or ADE

This script detects virtual machines whose disks use platform-managed encryption only and provides findings for compliance with CIS 7.2.

* feat: add remediation playbook fix_az_cmp_002.sh

This script enables Azure Disk Encryption on a specified virtual machine using a Key Vault for the disk encryption key.

* feat: add AZ-CMP-002 to CIS compliance framework

Added a new control for OS disk encryption requirements.

* feat: add AZ-CMP-002 to NIST compliance framework

* feat: add AZ-CMP-002 to ISO27001 compliance framework

Added control AZ-CMP-002 regarding cryptographic controls policy and its requirements.

* feat: add AZ-CMP-002 to SOC2 compliance framework

* fix: correct indentation in CIS AZ-CMP-002 entry

* feat: add remediation playbook fix_az_cmp_002.sh to correct location

This script enables Azure Disk Encryption on a specified virtual machine using a provided Key Vault for disk encryption.

* Delete fix_az_cmp_002.sh

* Feat/api deployment (openshield-org#46)

* feat: deploy API to Render with security hardening and CI/CD optimizations

* feat: finalize Render deployment with security hardening and Gunicorn import fix

* fix: GitHub Actions syntax and secret detection logic in deploy workflow

* ix: harden scan trigger route with detailed error handling and remove redundant DB initialization

* fix: implement global database connection management and harden all API routes

* ix: prevent insecure smoke tests on main branch by enforcing JWT_SECRET presence and prevent CI false negatives in playbook check by enforcing non-empty glob match

* fix: resolve Render startup crash and harden scan serialization against recursive objects

* fix: add missing six and cryptography dependencies for Azure SDK compatibility

* fix: increase CI wait time for Render build and add missing msrest dependencies

* feat: integrate real subscription ID into smoke tests and CI/CD pipeline

* feat: integrate real Azure_ ID's into smoke tests and CI/CD pipeline

* feat: add root welcome route to confirm API status

* fix: resolve specific CI credential flags in code and workflow while maintaining documentation standards

* fix: resolve IndentationError in CI compliance cross-reference check

* fix: resolve dependency issue and test on deployment

* fix: resolve somke test TC-21

* fix: RUN_REAL_SCAN not set → TC-13/TC-14 skip → 21/21 pass for new live API url test

* fix: scan.py deferred import from scanner.engine import ScanEngine was running before the subscription_id check

* fix: restrict deploy triggers to dev and main, enable RUN_REAL_SCAN for maintainer CI, and update test plan documentation

* feat: AZ-NET-011 Network Watcher not enabled in all regions (openshield-org#42)

* feat: add AZ-NET-011 Network Watcher rule, playbook and compliance mappings

* fix: add missing AzureClient methods, SOC2 mapping and fix playbook region

* fix: add SOC2 CC7.2 to FRAMEWORKS in az_net_011.py

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule a… (openshield-org#49)

* feat: add AZ-DB-003 PostgreSQL Flexible Server SSL enforcement rule and playbook

* fix: correct requirements.txt formatting for postgresqlflexibleserver

* fix: correct postgresqlflexibleservers package name and version

* fix: handle empty params gracefully and clean up playbook output

---------

Co-authored-by: Tanvir Farhad <tamimtarafder12@gmail.com>
Co-authored-by: PARTH J ROHIT <parthrohit60@gmail.com>
Co-authored-by: Ritik Sah <ritiksah141@gmail.com>
Co-authored-by: Shaurya K Sharma <shauryaksharma24@gmail.com>
Co-authored-by: Shaurya K Sharma <Sharma-SK@ulster.ac.uk>
Co-authored-by: Mahfuzur Rahman Emon <mahfuzur.emon01@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants