Skip to content

[Good First Issue] Conduct AI security audit of inference pipeline and API #24

@Oshgig

Description

@Oshgig

Overview

The ClimateVision API accepts image uploads and bounding boxes without rigorous security validation. Given the project's use by NGOs and government agencies, we need an AI security audit aligned with OWASP Agentic Top 10 and MITRE ATLAS frameworks to identify and mitigate vulnerabilities.

Scope

  • Create src/climatevision/security/api_security.py with:
    • Input payload size limits and validation
    • Bounding box sanitization (prevent injection/DoS)
    • Rate limiting per API key
    • File upload validation (magic bytes, extension whitelist)
  • Create src/climatevision/security/pipeline_guard.py with:
    • Adversarial input detection for uploaded images
    • Model output confidence thresholds to prevent poisoned predictions
  • Create scripts/security_scan.py CLI tool:
    • Scans all endpoints for OWASP-style vulnerabilities
    • Generates security_report.json with severity ratings and remediation steps
  • Create notebooks/08_security_audit.ipynb documenting findings
  • Add security tests to tests/test_security.py

Acceptance Criteria

  • All API endpoints pass security scan with zero critical findings
  • Adversarial inputs are rejected before reaching the model
  • Security report is generated on every release
  • Tests cover injection, overflow, and malformed input scenarios

Resources

Difficulty: Intermediate
Owner: Linda Oraegbunam (@obielin)
Labels: good first issue, security, backend, api

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions