Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training stucked in 'plotting labels' #5611

Closed
1 task done
xiuluoNM opened this issue Nov 11, 2021 · 3 comments · Fixed by #5616
Closed
1 task done

Training stucked in 'plotting labels' #5611

xiuluoNM opened this issue Nov 11, 2021 · 3 comments · Fixed by #5616
Labels
question Further information is requested

Comments

@xiuluoNM
Copy link

Search before asking

Question

Hello,I'm very interested in yolov5, and I have trained several models before, but yesterday I meet a problem: when I'm training my custom data, it has stucked in cmd print 'plotting labels', and I tried everything but it can't continue. Following is the cmd

lines:
Transferred 364/370 items from yolov5s.pt
Scaled weight_decay = 0.0005
optimizer: SGD with parameter groups 59 weight, 70 weight (no decay), 62 bias
train: Scanning '..\smoke2\train\labels' images and labels...303 found, 0 missing, 0 empty, 0 corrupted: 100%|█| 303/30
train: New cache created: ..\smoke2\train\labels.cache
val: Scanning '..\smoke2\valid\labels' images and labels...6 found, 0 missing, 0 empty, 0 corrupted: 100%|█| 6/6 [00:03
val: New cache created: ..\smoke2\valid\labels.cache
Plotting labels...

(ff) D:\test\Yolov5_DeepSort_Pytorch-master-pig\yolov5>

I want to know why ....

Additional

No response

@xiuluoNM xiuluoNM added the question Further information is requested label Nov 11, 2021
@github-actions
Copy link
Contributor

github-actions bot commented Nov 11, 2021

👋 Hello @xiuluoNM, thank you for your interest in YOLOv5 🚀! Please visit our ⭐️ Tutorials to get started, where you can find quickstart guides for simple tasks like Custom Data Training all the way to advanced concepts like Hyperparameter Evolution.

If this is a 🐛 Bug Report, please provide screenshots and minimum viable code to reproduce your issue, otherwise we can not help you.

If this is a custom training ❓ Question, please provide as much information as possible, including dataset images, training logs, screenshots, and a public link to online W&B logging if available.

For business inquiries or professional support requests please visit https://ultralytics.com or email Glenn Jocher at glenn.jocher@ultralytics.com.

Requirements

Python>=3.6.0 with all requirements.txt installed including PyTorch>=1.7. To get started:

$ git clone https://github.com/ultralytics/yolov5
$ cd yolov5
$ pip install -r requirements.txt

Environments

YOLOv5 may be run in any of the following up-to-date verified environments (with all dependencies including CUDA/CUDNN, Python and PyTorch preinstalled):

Status

CI CPU testing

If this badge is green, all YOLOv5 GitHub Actions Continuous Integration (CI) tests are currently passing. CI tests verify correct operation of YOLOv5 training (train.py), validation (val.py), inference (detect.py) and export (export.py) on MacOS, Windows, and Ubuntu every 24 hours and on every commit.

@glenn-jocher
Copy link
Member

@xiuluoNM might be a possible duplicate of #5395

The conclusion there was that this was caused by an issue in freetype. Downgrading freetype to 2.10.4 fixed the issue.

glenn-jocher added a commit that referenced this issue Nov 11, 2021
@glenn-jocher glenn-jocher linked a pull request Nov 11, 2021 that will close this issue
glenn-jocher added a commit that referenced this issue Nov 11, 2021
* Improve plots.py robustness

Addresses issues #5374, #5395, #5611

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@glenn-jocher
Copy link
Member

@xiuluoNM good news 😃! Your original issue may now be fixed ✅ in PR #5616. This PR does not fix any underlying issues with matplotlib/freetype, but it does enclose plot_labels() in try: except and Timeout decorators to bypass it in case of issues. This means no label plots will be produced if errors/hangs are encountered, but training will proceed normally without issue.

yolov5/utils/plots.py

Lines 327 to 331 in def7a0f

@try_except # known issue https://github.com/ultralytics/yolov5/issues/5395
@Timeout(30) # known issue https://github.com/ultralytics/yolov5/issues/5611
def plot_labels(labels, names=(), save_dir=Path('')):
# plot dataset labels
print('Plotting labels... ')

To receive this update:

  • Gitgit pull from within your yolov5/ directory or git clone https://github.com/ultralytics/yolov5 again
  • PyTorch Hub – Force-reload model = torch.hub.load('ultralytics/yolov5', 'yolov5s', force_reload=True)
  • Notebooks – View updated notebooks Open In Colab Open In Kaggle
  • Dockersudo docker pull ultralytics/yolov5:latest to update your image Docker Pulls

Thank you for spotting this issue and informing us of the problem. Please let us know if this update resolves the issue for you, and feel free to inform us of any other issues you discover or feature requests that come to mind. Happy trainings with YOLOv5 🚀!

BjarneKuehl pushed a commit to fhkiel-mlaip/yolov5 that referenced this issue Aug 26, 2022
* Improve plots.py robustness

Addresses issues ultralytics#5374, ultralytics#5395, ultralytics#5611

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants