Skip to content

Metadata explorer converter#335

Merged
cristian-tamblay merged 26 commits into
developfrom
feat/metadata-explorer-converter
Oct 23, 2025
Merged

Metadata explorer converter#335
cristian-tamblay merged 26 commits into
developfrom
feat/metadata-explorer-converter

Conversation

@Irozuku
Copy link
Copy Markdown
Collaborator

@Irozuku Irozuku commented Oct 17, 2025

This pull request introduces a comprehensive system for organizing and enriching converter classes in DashAI with new metadata, including visual previews, categories, and colors. It adds category base classes for converters, refactors existing converters to use these categories, and implements an API endpoint to serve component images, either from local files or URLs, with a fallback to a placeholder image. Additionally, it updates the configuration to support these enhancements.

Key changes:

Converter Categorization and Metadata Enrichment

  • Introduced category base classes (e.g., AdvancedPreprocessingConverter, SamplingConverter, etc.) in the new DashAI/back/converters/category/ directory, each specifying a category name and color. [1] [2] [3] [4] [5] [6] [7] [8]
  • Updated the BaseConverter class to include new metadata fields: IMAGE_PREVIEW, CATEGORY, and COLOR. The get_metadata method now returns these fields as part of the converter metadata. [1] [2]
  • Refactored all relevant converter classes to inherit from their respective category base classes and set the IMAGE_PREVIEW attribute. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]

API Enhancements

  • Added a new API endpoint /image/{component_name}/ to serve component images. The endpoint retrieves the image based on metadata, supports both local files and remote URLs, and falls back to a placeholder image if necessary. [1] [2]

Front

image image image image

@Irozuku Irozuku changed the title Feat/metadata explorer converter Metadata explorer converter Oct 17, 2025
@Irozuku Irozuku marked this pull request as ready for review October 20, 2025 13:04
@Irozuku Irozuku marked this pull request as draft October 20, 2025 13:08
@Irozuku Irozuku marked this pull request as ready for review October 20, 2025 13:21
@Irozuku Irozuku marked this pull request as draft October 20, 2025 13:21
@Irozuku Irozuku marked this pull request as ready for review October 20, 2025 13:24
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces a comprehensive metadata enrichment system for DashAI components (converters and explorers) with visual categorization. The changes add category, color, and image preview metadata to components, create a new API endpoint for serving component images, and redesign the frontend to display components in both list and grid views with improved visual elements.

Key changes:

  • Added category base classes for converters and explorers with predefined colors and categories
  • Enhanced base classes to include image preview, category, and color metadata fields
  • Implemented an API endpoint to serve component images with fallback to placeholder
  • Redesigned frontend with list/grid view toggle and hover previews
  • Removed the ConverterChain converter class

Reviewed Changes

Copilot reviewed 85 out of 136 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
DashAI/back/converters/base_converter.py Added IMAGE_PREVIEW, CATEGORY, and COLOR metadata fields to BaseConverter
DashAI/back/exploration/base_explorer.py Added IMAGE_PREVIEW, CATEGORY, and COLOR metadata fields to BaseExplorer
DashAI/back/converters/category/*.py New category base classes defining CATEGORY and COLOR for different converter types
DashAI/back/exploration/*_explorer.py New category base classes defining CATEGORY and COLOR for different explorer types
DashAI/back/converters/scikit_learn/*.py Updated converters to inherit from category classes and set IMAGE_PREVIEW
DashAI/back/converters/simple_converters/*.py Updated simple converters to inherit from BasicPreprocessingConverter
DashAI/back/converters/imbalanced_learn/*.py Updated sampling converters to inherit from SamplingConverter
DashAI/back/converters/hugging_face/embedding.py Updated to inherit from AdvancedPreprocessingConverter
DashAI/back/exploration/explorers/*.py Updated explorers to inherit from category classes and set IMAGE_PREVIEW
DashAI/back/api/api_v1/endpoints/components.py New endpoint to serve component images from local files or URLs
DashAI/back/config.py Added BACK_PATH configuration field
DashAI/back/dependencies/config_builder.py Added BACK_PATH to config dict
DashAI/back/initial_components.py Removed ConverterChain from initial components
DashAI/back/job/converter_job.py Removed ConverterChain instantiation logic
DashAI/front/src/components/notebooks/tool/*.jsx New components for list/grid views with image previews and hover info
DashAI/front/src/components/notebooks/RightBar.jsx Integrated new tool components with view mode toggle
DashAI/front/src/components/notebooks/DescriptionPanel.jsx Simplified to show only hover instruction
DashAI/front/src/components/notebooks/converterCreation/ConverterList.jsx Removed old converter list component
DashAI/front/src/components/notebooks/explorerCreation/ExplorerList.jsx Removed old explorer list component

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Comment thread DashAI/back/converters/category/advanced_preprocessing.py Outdated
Comment thread DashAI/back/converters/sklearn_wrapper.py Outdated
Comment thread DashAI/front/src/components/notebooks/tool/CategoryIcon.jsx Outdated
Comment thread DashAI/back/api/api_v1/endpoints/components.py
Comment thread DashAI/back/api/api_v1/endpoints/components.py Outdated
Comment thread DashAI/front/src/components/notebooks/tool/ToolListItem.jsx
@cristian-tamblay cristian-tamblay merged commit 9a8ec9f into develop Oct 23, 2025
23 checks passed
@cristian-tamblay cristian-tamblay deleted the feat/metadata-explorer-converter branch October 23, 2025 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants