Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

It is not possible to add your own dataset. #569

Closed
1 task done
Barmark-learn opened this issue Feb 11, 2024 · 7 comments
Closed
1 task done

It is not possible to add your own dataset. #569

Barmark-learn opened this issue Feb 11, 2024 · 7 comments
Labels
bug Something isn't working Stale

Comments

@Barmark-learn
Copy link

Search before asking

  • I have searched the HUB issues and found no similar bug report.

HUB Component

Datasets

Bug

I am trying to add my own dataset to the hub, but there is always an error: "The dataset images cannot be located.". I made the file structure as in the example, but it still won't load.
Error
Example_on_site
inside_my_folder
my_folder

Environment

-Computer: Lenovo, -OS: Windows 11

Minimal Reproducible Example

  1. Go to https://hub.ultralytics.com/home
  2. Select Datasets
  3. Try to upload

Additional

No response

@Barmark-learn Barmark-learn added the bug Something isn't working label Feb 11, 2024
Copy link

👋 Hello @Barmark-learn, thank you for raising an issue about Ultralytics HUB 🚀! Please visit our HUB Docs to learn more:

  • Quickstart. Start training and deploying YOLO models with HUB in seconds.
  • Datasets: Preparing and Uploading. Learn how to prepare and upload your datasets to HUB in YOLO format.
  • Projects: Creating and Managing. Group your models into projects for improved organization.
  • Models: Training and Exporting. Train YOLOv5 and YOLOv8 models on your custom datasets and export them to various formats for deployment.
  • Integrations. Explore different integration options for your trained models, such as TensorFlow, ONNX, OpenVINO, CoreML, and PaddlePaddle.
  • Ultralytics HUB App. Learn about the Ultralytics App for iOS and Android, which allows you to run models directly on your mobile device.
    • iOS. Learn about YOLO CoreML models accelerated on Apple's Neural Engine on iPhones and iPads.
    • Android. Explore TFLite acceleration on mobile devices.
  • Inference API. Understand how to use the Inference API for running your trained models in the cloud to generate predictions.

If this is a 🐛 Bug Report, please provide screenshots and steps to reproduce your problem to help us get started working on a fix.

If this is a ❓ Question, please provide as much information as possible, including dataset, model, environment details etc. so that we might provide the most helpful response.

We try to respond to all issues as promptly as possible. Thank you for your patience!

@UltralyticsAssistant
Copy link
Member

@Barmark-learn hello! I'm sorry to hear you're experiencing issues with adding your own dataset to the Ultralytics HUB. Let's try to troubleshoot this together. 🛠️

First, please ensure that your dataset directory structure strictly follows the required format as outlined in our documentation. The error message you're seeing typically indicates that there might be a mismatch in the expected file paths.

Here are a few things to double-check:

  • Confirm that your image files are indeed within the specified 'images' folder.
  • Verify that the annotations are correctly placed in the corresponding 'labels' folder and that they match the format specified in the documentation.
  • Make sure that there are no typos or discrepancies in the folder names or the paths within your dataset configuration.

If you've confirmed all the above and the issue persists, it might be helpful to review the dataset's configuration file for any errors or omissions.

For further detailed guidance on dataset structure and troubleshooting, please refer to the Ultralytics HUB Docs. If the problem continues after reviewing the documentation, please provide us with the exact error message and a description of your dataset structure so we can assist you more effectively.

We appreciate your patience and are here to help you get your dataset up and running! 🌟

@Burhan-Q
Copy link
Member

Burhan-Q commented Feb 19, 2024

@Barmark-learn I was troubleshooting this with someone recently. This is how I structured my directory and was able to get the data to upload (I only made a small dataset of 20 images for testing)

data
└───data-seg20
        ├───data.yaml
        ├───train
        │     ├───images
        │     └───labels
        └───valid
              ├───images
              └───labels

You can also verify your dataset locally for HUB using

from ultralytics.hub import check_dataset

check_dataset('Q:\data\data-seg20.zip', task="segment")

which will show (I was using segment data):

Starting HUB dataset checks for Q:\data\data-seg20.zip....

WARNING ⚠️ Skipping Q:\data\data-seg20.zip unzip as destination directory Q:\data\data-seg20 is not empty.

Scanning Q:\data\data-seg20\train\labels... 20 images, 0 backgrounds, 0 corrupt: 100%|██████████| 20/20 [00:00<00:00, 1254.80it/s]
New cache created: Q:\data\data-seg20\train\labels.cache
Statistics: 100%|██████████| 20/20 [00:00<?, ?it/s]

Scanning Q:\data\data-seg20\valid\labels... 20 images, 0 backgrounds, 0 corrupt: 100%|██████████| 20/20 [00:00<00:00, 1666.92it/s]
New cache created: Q:\data\data-seg20\valid\labels.cache
Statistics: 100%|██████████| 20/20 [00:00<?, ?it/s]

Checks completed correctly ✅. Upload this dataset to https://hub.ultralytics.com/datasets/.

@Barmark-learn
Copy link
Author

@Burhan-Q, Thanks for the advice, I'll try

@jackbrown333
Copy link

Pycharm tells me is correct, but i can't upload my datasets
Unzipping /Users/zhuxinchen/PycharmProjects/pythonProject3/i think i can.v1i.yolov5pytorch的副本.zip to /Users/zhuxinchen/PycharmProjects/pythonProject3/i think i can.v1i.yolov5pytorch...: 100%|██████████| 7/7 [00:00<00:00, 1199.89file/s]
Checks completed correctly ✅. Upload this dataset to https://hub.ultralytics.com/datasets/.
截屏2024-03-07 17 22 00

@Burhan-Q
Copy link
Member

Burhan-Q commented Mar 7, 2024

@jackbrown333 see examples in my comment here about what will work for dataset structuring for HUB

Copy link

github-actions bot commented Apr 7, 2024

👋 Hello there! We wanted to give you a friendly reminder that this issue has not had any recent activity and may be closed soon, but don't worry - you can always reopen it if needed. If you still have any questions or concerns, please feel free to let us know how we can help.

For additional resources and information, please see the links below:

Feel free to inform us of any other issues you discover or feature requests that come to mind in the future. Pull Requests (PRs) are also always welcomed!

Thank you for your contributions to YOLO 🚀 and Vision AI ⭐

@github-actions github-actions bot added the Stale label Apr 7, 2024
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Stale
Projects
None yet
Development

No branches or pull requests

4 participants