Skip to content

Migrate to use swxsoc from sdc_aws_utils - #17

Merged
Alrobbertz merged 5 commits into
swxsoc:mainfrom
Alrobbertz:aws_utils_migration
Aug 5, 2026
Merged

Migrate to use swxsoc from sdc_aws_utils#17
Alrobbertz merged 5 commits into
swxsoc:mainfrom
Alrobbertz:aws_utils_migration

Conversation

@Alrobbertz

@Alrobbertz Alrobbertz commented Jul 29, 2026

Copy link
Copy Markdown
Member
  • Migrate from sdc_aws_utils to swxsoc library: Replace deprecated sdc_aws_utils package with consolidated swxsoc utilities for S3 I/O, config handling, and filename parsing; update all imports and function signatures accordingly (removes environment parameter from get_instrument_bucket())

  • Add comprehensive AGENTS.md documentation: Create AI-agent-ready guide documenting project overview, testing/build commands, architecture decisions, config baking strategy, and common development tasks to enable immediate productivity

  • Add ruff linting configuration and minor code cleanup (test imports, shebang, psycopg2-binary dependency) to standardize code quality across the project

@Alrobbertz
Alrobbertz marked this pull request as ready for review August 5, 2026 15:38
Copilot AI lite review requested due to automatic review settings August 5, 2026 15:38

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR migrates the Lambda processing codebase from sdc_aws_utils to the consolidated swxsoc package, updating imports/config reconfiguration in the processor and tests, and aligning dependency lists accordingly.

Changes:

  • Replaced sdc_aws_utils dependencies with swxsoc across dev and mission-specific requirements.
  • Updated processor code to use swxsoc S3/config/filename utilities and adjusted MetaTracker wiring accordingly.
  • Updated test fixtures/imports to use swxsoc.reconfigure() and added a ruff.toml lint ignore configuration.

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
ruff.toml Adds Ruff lint ignore configuration for the repo.
requirements.dev.txt Swaps sdc_aws_utils dependency for swxsoc in the dev/test environment.
lambda_function/tests/test_processor.py Consolidates imports and removes now-unneeded noqa markers; keeps logging config.
lambda_function/tests/conftest.py Switches mission reconfiguration to swxsoc.reconfigure().
lambda_function/swxsoc_pipeline-requirements.txt Updates pipeline dependency from sdc_aws_utils to swxsoc.
lambda_function/src/file_processor/file_processor.py Migrates AWS/config/filename handling to swxsoc APIs and updates MetaTracker parser usage.
lambda_function/padre-requirements.txt Updates PADRE Lambda dependency from sdc_aws_utils to swxsoc.
lambda_function/impax-requirements.txt Updates iMPAX Lambda dependency from sdc_aws_utils to swxsoc.
lambda_function/hermes-requirements.txt Updates HERMES Lambda dependency from sdc_aws_utils to swxsoc.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread requirements.dev.txt
Comment thread lambda_function/hermes-requirements.txt
Comment thread lambda_function/padre-requirements.txt
Comment thread lambda_function/impax-requirements.txt
Comment thread lambda_function/swxsoc_pipeline-requirements.txt
Comment thread lambda_function/src/file_processor/file_processor.py
@codecov

codecov Bot commented Aug 5, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 90.00000% with 1 line in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (main@c379701). Learn more about missing BASE report.

Files with missing lines Patch % Lines
...mbda_function/src/file_processor/file_processor.py 90.00% 1 Missing ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main      #17   +/-   ##
=======================================
  Coverage        ?   51.79%           
=======================================
  Files           ?        2           
  Lines           ?      195           
  Branches        ?        0           
=======================================
  Hits            ?      101           
  Misses          ?       94           
  Partials        ?        0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Alrobbertz
Alrobbertz merged commit ca05f3d into swxsoc:main Aug 5, 2026
5 checks passed
@Alrobbertz
Alrobbertz deleted the aws_utils_migration branch August 5, 2026 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants