Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Import dataset from FiftyOne #7607

Closed
2 tasks done
mmoollllee opened this issue Mar 14, 2024 · 1 comment
Closed
2 tasks done

Import dataset from FiftyOne #7607

mmoollllee opened this issue Mar 14, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@mmoollllee
Copy link

mmoollllee commented Mar 14, 2024

Actions before raising this issue

  • I searched the existing issues and did not find anything similar.
  • I read/searched the docs

Is your feature request related to a problem? Please describe.

First time useing datumaro. My goal ist to tile my dataset. I'm already failing with importing the dataset. I exported it with FiftyOne to COCO and CVAT Images so far. Both import attempts in Datumaro Python failed with errors like this.
I'm wondering what the best workflow is to transfer a dataset from Voxel51 FiftyOne to Datumaro?

Dataset.import_from(args.path, "cvat")
# datumaro.components.errors.DatasetImportError: Failed to import dataset 'cvat' at '/Users/user/Desktop/dataset-folder'.
Dataset.import_from(args.path, "coco_instances")
# datumaro.components.errors.DatasetImportError: Failed to import dataset 'coco_instances' at '/Users/user/Desktop/dataset-folder'.

Describe the solution you'd like

Best case
Provide a API to download data directly from FiftyOne.

Or
A example of how successfully import a dataset after exporting it from Fiftyone.

Additional context

I've tried COCO, VOC, CVAT & Yolo Format. None worked, but with different output using datum dinfo:

# YOLO
length: 157
categories: 
subsets: default
  'default':
    length: 157
    categories: 
# CVAT
Failed to import dataset 'cvat' at '/Users/user/Desktop/dataset-folder'.
# VOC
length: 157
categories: 
subsets: default
  'default':
    length: 157
    categories: 

As it doesn't print categories I checked the dataset.yaml in the YOLO Dataset:

names:
  0: van
  1: person
  ...
path: /Users/user/Desktop/dataset-folder
val: ./images/val/

With some folder structure and file renaming I get these errors with datum dinfo and COCO format.

2024-03-14 10:31:50,910 WARNING: Category id of '0' is reserved for no class (background) but category named 'bike' with id of '0' is found in /Users/user/Desktop/dataset-folder/annotations/instances_default.json. Please be warned that annotations with category id of '0' would have `None` as label. (https://openvinotoolkit.github.io/datumaro/latest/docs/explanation/formats/coco.html#import-coco-dataset)
2024-03-14 10:31:50,911 ERROR: Failed to parse revspec:
  Can't find project at 'Failed to find project at '/Users/user/Desktop/dataset-folder. Specify project path with '-p/--project' or in the target pathspec.'
  Failed to import dataset 'coco' at '/Users/user/Desktop/dataset-folder'.
@mmoollllee mmoollllee added the enhancement New feature or request label Mar 14, 2024
@mmoollllee
Copy link
Author

Sorry I'm wrong here... Correct issue here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant