IOError: cannot identify image file

I've started the build with debug parameters, the output is:

Traceback (most recent call last):
  File "/usr/local/bin/sigal", line 9, in 
    load_entry_point('sigal==0.6.0', 'console_scripts', 'sigal')()
  File "/usr/local/lib/python2.7/dist-packages/sigal/__init__.py", line 154, in main
    parser.dispatch()
  File "/usr/local/lib/python2.7/dist-packages/argh/helpers.py", line 53, in dispatch
    return dispatch(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 124, in dispatch
    for line in lines:
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 200, in _execute_command
    for line in result:
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 183, in _call
    result = args.function(*positional, **keywords)
  File "/usr/local/lib/python2.7/dist-packages/sigal/__init__.py", line 109, in build
    gal.build()
  File "/usr/local/lib/python2.7/dist-packages/sigal/gallery.py", line 239, in build
    process_file(files)
  File "/usr/local/lib/python2.7/dist-packages/sigal/gallery.py", line 311, in process_file
    return process_image(*args[1:])
  File "/usr/local/lib/python2.7/dist-packages/sigal/image.py", line 136, in process_image
    generate_image(filepath, outname, settings, options=options)
  File "/usr/local/lib/python2.7/dist-packages/sigal/image.py", line 64, in generate_image
    img = PILImage.open(source)
  File "/usr/local/lib/python2.7/dist-packages/PIL/Image.py", line 2025, in open
    raise IOError("cannot identify image file")
IOError: cannot identify image file

I have no idea, what cause the problem :)

This issue can be closed. The problem was, that some pictures are broken (size was only 16KB).

[saimn]

Thanks for the feedback,
Let's keep the issue opened for now, I will see to catch the exception and add an error log.

[markodvornik]

Maybe this is related. I got a bit different IOError. I suspect that the JPG file in my collection that caused fatal error got corrupted during ftp transfer. However if I run sigal only on that folder it goes trough without an error.

My sugestion would be that sigal keeps on processing the collection despite fatal error on one of the images. With large multimedia collections it's not that convenient to run sigal over and over again until all faulty images are singled out.

DEBUG: Processor: ResizeToFit
Traceback (most recent call last):
  File "/usr/local/bin/sigal", line 9, in <module>
    load_entry_point('sigal==0.6.0', 'console_scripts', 'sigal')()
  File "/usr/local/lib/python2.7/dist-packages/sigal/__init__.py", line 154, in main
    parser.dispatch()
  File "/usr/local/lib/python2.7/dist-packages/argh/helpers.py", line 53, in dispatch
    return dispatch(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 124, in dispatch
    for line in lines:
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 200, in _execute_command
    for line in result:
  File "/usr/local/lib/python2.7/dist-packages/argh/dispatching.py", line 183, in _call
    result = args.function(*positional, **keywords)
  File "/usr/local/lib/python2.7/dist-packages/sigal/__init__.py", line 109, in build
    gal.build()
  File "/usr/local/lib/python2.7/dist-packages/sigal/gallery.py", line 226, in build
    self.pool.map_async(worker, media_list).get(9999)
  File "/usr/lib/python2.7/multiprocessing/pool.py", line 528, in get
    raise self._value
IOError: image file is truncated (35 bytes not processed)

[tintamarre]

I had the same issue yesterday.

After verifying each image, I run Sigal again with less NCPU and it went trough without an error ...

[markodvornik]

NCPU didn't work for me.

[markodvornik]

The problem is in

img = PILImage.open(source)

when source is a broken image file (according to PIL). A dirty workaround would be to wrap generate_image & generate_thumbnail functions in image.py in try/except.

This workaround results in gallery being made, but with blank thumbnails and no preview for broken source images.

[saimn]

A dirty workaround would be to wrap generate_image & generate_thumbnail functions in image.py in try/except.

Yeah, that's something I must look at. Could you send me examples of broken file ?