Skip to content

Fix problem between hueyqueue and plugins#366

Merged
cristian-tamblay merged 3 commits into
developfrom
fix/queue-plugins
Nov 5, 2025
Merged

Fix problem between hueyqueue and plugins#366
cristian-tamblay merged 3 commits into
developfrom
fix/queue-plugins

Conversation

@Felipedino
Copy link
Copy Markdown
Collaborator

This pull request introduces a new job class for synchronizing plugin components and integrates it into the plugin management endpoints. The main goal is to ensure that the ComponentRegistry stays in sync with the actual installed plugins whenever plugins are updated, registered, unregistered, or upgraded. The changes improve the reliability and consistency of plugin component management in the backend.

Plugin component synchronization:

  • Added a new SyncComponentsJob class in DashAI/back/job/sync_components_job.py, which checks for discrepancies between installed plugins and registered components, and updates the ComponentRegistry accordingly.

API endpoint integration:

  • Modified the update_plugin and upgrade_plugin endpoints in DashAI/back/api/api_v1/endpoints/plugins.py to inject a job_queue dependency and enqueue the SyncComponentsJob whenever plugin components are registered or unregistered. This ensures the registry is automatically synchronized after plugin changes. [1] [2] [3] [4] [5]

@cristian-tamblay
Copy link
Copy Markdown
Member

I uninstalled a plugin and it completely wiped every single component

INFO:DashAI.back.dependencies.registry.component_registry:Component removed: FastICA
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: VarianceThreshold
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: RegressionTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: OptunaOptimizer
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:OptunaOptimizer, TabularClassificationTask
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:OptunaOptimizer, TextClassificationTask
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:OptunaOptimizer, TranslationTask
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:OptunaOptimizer, RegressionTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: BagOfWordsConverter
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: Bleu
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:Bleu, TranslationTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: RMSE
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:RMSE, RegressionTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: Binarizer
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: StableDiffusionV3Model
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:StableDiffusionV3Model, TextToImageGenerationTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: SVC
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:SVC, TabularClassificationTask
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: DatasetJob
INFO:DashAI.back.dependencies.registry.component_registry:Component removed: RidgeRegression
INFO:DashAI.back.dependencies.registry.relationship_manager:Components successfully removed from registry:RidgeRegression, RegressionTask
[2025-11-04 18:04:02,474] INFO:huey:Worker-1:DashAI.back.dependencies.job_queues.huey_job_queue._execute_base_job: 9bf2ea6d-5a47-47bc-954a-14d4c1807f6d executed in 0.062s
INFO:huey:DashAI.back.dependencies.job_queues.huey_job_queue._execute_base_job: 9bf2ea6d-5a47-47bc-954a-14d4c1807f6d executed in 0.062s

Also i did the installation of deepseek after the uninstall, and it still removed every single component, and when i tried to use deepseek:

  File "C:\Users\crist\Documents\DashAI\DashAI\DashAI\back\job\generative_job.py", line 171, in run
    raise JobError(
DashAI.back.job.base_job.JobError: Task 'TextToTextGenerationTask' not found in registry.

Copy link
Copy Markdown
Member

@cristian-tamblay cristian-tamblay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is breaking the component registry

@cristian-tamblay cristian-tamblay merged commit 6c96ecb into develop Nov 5, 2025
30 of 31 checks passed
@cristian-tamblay cristian-tamblay deleted the fix/queue-plugins branch November 5, 2025 18:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants