Skip to content

#175: Add type-checked Pydantic training config#210

Merged
gelluisaac merged 1 commit into
Traqora:mainfrom
fadee26:feat/fix-training-config-idempotent-backfill-feature-pagination
May 30, 2026
Merged

#175: Add type-checked Pydantic training config#210
gelluisaac merged 1 commit into
Traqora:mainfrom
fadee26:feat/fix-training-config-idempotent-backfill-feature-pagination

Conversation

@fadee26

@fadee26 fadee26 commented May 28, 2026

Copy link
Copy Markdown
Contributor

Summary of Changes

This PR addresses three issues: #175, #182, #190

🔧 #175: Add type-checked API for training config

  • New file astroml/training/config.py with Pydantic models
  • Models: EarlyStoppingConfig, TemporalSplitConfig, OptimizerConfig, TrainingConfig
  • TrainingConfig includes from_yaml() and to_yaml() methods

📊 #182: Ingestion backfill idempotency

  • Added ProcessedLedger model in astroml/db/schema.py to track processed ledgers
  • Updated preprocess_to_parquet with skip_processed=True parameter
  • Skips ledgers marked as completed, and uses processing status for concurrency safety

#190: Feature extractor performance bottleneck

  • Replaced offset/limit with keyset pagination in pipeline_structural_importance.py
  • Fix missing Transaction import
  • Keyset pagination avoids full table scans for large datasets

closes #190
closes #182
closes #175

@drips-wave

drips-wave Bot commented May 28, 2026

Copy link
Copy Markdown

@fadee26 Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits

@gelluisaac gelluisaac merged commit 770aa06 into Traqora:main May 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature extractor concurrency bottleneck Ingestion backfill not idempotent Add type-checked API for astroml/training config

2 participants