Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

All pipeline crashed with illegal image type!!! Any solution to catch the exception? #1435

Closed
donnyyou opened this issue Nov 4, 2019 · 1 comment
Labels
question Further information is requested

Comments

@donnyyou
Copy link

donnyyou commented Nov 4, 2019

When we use dali for images processing, all pipeline will crash due to some illegal image. I wonder how to catch the exception caused by this without all pipeline exiting.

@JanuszL JanuszL added the question Further information is requested label Nov 4, 2019
@JanuszL
Copy link
Contributor

JanuszL commented Nov 4, 2019

Hi,
As DALI works in a separate set thread under the hood independently from the main Python one it is very hard or even impossible to do it in the way you are asking. Also, there is the question of what should happen with other images in the batch that are fine - how to put it back to the pool used to generate batches.
However, DALI reports which image exactly causes probelms so you can fix your dataset.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants