Skip to content

refactor(streaming): unify preprocessing and add queued stream sources#113

Merged
DeepKnowledge1 merged 4 commits intoDeepKnowledge1:mainfrom
pythonscriptsPro:main
Dec 15, 2025
Merged

refactor(streaming): unify preprocessing and add queued stream sources#113
DeepKnowledge1 merged 4 commits intoDeepKnowledge1:mainfrom
pythonscriptsPro:main

Conversation

@pythonscriptsPro
Copy link
Copy Markdown
Contributor

@pythonscriptsPro pythonscriptsPro commented Dec 15, 2025

📝 Description

This PR refactors and hardens the streaming data pipeline to support reliable real-time inference.
It introduces queued, background-driven stream sources (Webcam, Video, MQTT, TCP) to decouple capture/receive rates from inference speed, and unifies preprocessing by moving all transform logic into the dataset layer.

The changes fix multiple streaming stability issues (thread lifecycle, blocking I/O, dataset length assumptions) and align streaming behavior with the existing offline dataset contract.

✨ Changes

Select the type of change in this PR:

  • 🚀 New feature (adds functionality without breaking existing behavior)
  • 🐞 Bug fix (resolves an issue without breaking existing behavior)
  • 🔄 Refactor (improves code structure without changing behavior)
  • ⚡ Performance improvement
  • 🎨 Style update (formatting/code style only)
  • 🧪 Tests (add/modify tests)
  • 📚 Documentation update
  • 📦 Build system change
  • 🚧 CI/CD configuration
  • 🔧 Chore (maintenance tasks)
  • 🔒 Security update
  • 💥 Breaking change (feature or fix that changes existing behavior)

✅ Checklist

Before submitting, confirm the following:

  • 📚 Documentation updated (if applicable)
  • 🧪 Tests added/updated (if applicable)
  • 🏷️ PR title follows conventional commits

🔍 For review guidelines, see the Code Review Checklist.

@DeepKnowledge1 DeepKnowledge1 merged commit 64057a5 into DeepKnowledge1:main Dec 15, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants