Creating JPEG file from .heic files

[agharib]

Thanks for reporting your issue. Please make sure these boxes are checked before submitting your issue - thank you!

• I looked for a similar issue and couldn't find any.
• I tried with the latest version of GPAC. Installers available at http://gpac.io/downloads/gpac-nightly-builds/
• I give enough information for contributors to reproduce my issue (meaningful title, github labels, platform and compiler, command-line ...). I can share files anonymously with this dropbox: https://www.mediafire.com/filedrop/filedrop_hosted.php?drop=eec9e058a9486fe4e99c33021481d9e1826ca9dbc242a6cfaab0fe95da5e5d95

Detailed guidelines: http://gpac.io/2013/07/16/how-to-file-a-bug-properly/

Hi there,

I see on the GPAC post that there is an easy way to create HEIF files using mp4box... Apologies if this is clearly stated somewhere, but is there a way to get jpeg's from .heic files using mp4box? Any documentation/references would be greatly appreciated.

Thanks!

-Ahmed

[knopa]

Hey, have same issue

No chance to get how to convert from heif to jpg?

[rbouqueau]

You guys miss an important point: MP4Box can only manipulate the container. JPEG and HEVC are different codecs so you'll need to re-encode.

The easiest way to do the conversion is to use the Nokia tool to decode your HEIF content to RAW -formats to be precised). Then use a JPEG encoder to perform the RAW -> JPEG conversion.

[ericcj]

@rbouqueau It seemed like the below invocation of MP4Box is supposed to extract the raw tiles (in HEVC format) from the HEIC container, but as you can see they don't seem to be valid HEVC when I get them out even though they do work properly for the same test file when extracting them with the nokia library. Am I misunderstanding the MP4Box options or what exactly gpac supports? Thanks

$ ~/gpac/bin/gcc/MP4Box -info ~/test_001.heic
ICC colour profile not supported
ICC colour profile not supported
Root Meta type: "pict" - 52 resource item(s)
Primary Item - ID 49
Item #1 - ID 1 - Name:
Item #2 - ID 2 - Name:
...
Item #51 - ID 51 - Name:
File has no movie (moov) - static data container

$ ~/gpac/bin/gcc/MP4Box -dump-item 1:path=item1.hevc ~/test_001.heic

$ ffmpeg -i item1.hevc -frames:v 1 -vsync vfr -q:v 1 -y -an item1.bmp
item1.hevc: Invalid data found when processing input

[rbouqueau]

@ericcj I don't know if it is supposed to be HEVC compliant but I could reproduce your issue:
CC @cconcolato

$ wget http://nokiatech.github.io/heif/content/images/crowd_1440x960.heic
$ MP4Box -info crowd_1440x960.heic
Root Meta type: "pict" - 3 resource item(s)
Primary Item - ID 20002
Item #1 - ID 20002 - Name: HEVC Image
Item #2 - ID 20003 - Name: HEVC Image
File has no movie (moov) - static data container

$ MP4Box -dump-item 1:path=item1.hevc crowd_1440x960.heic

        Error: Bad Parameter

$ MP4Box -dump-item 20002:path=item1.hevc crowd_1440x960.heic

$ MP4Box -add item1.hevc item1.mp4
Cannot find HEVC start code
Error importing item1.hevc: BitStream Not Compliant

[cconcolato]

The extraction code is very generic. It takes the bytes of the item and outputs them. This works well when the resource is stored as is in the item. For HEIC, it's a bit tricky. The payload of the item is only the VCL NALU (IIRC), the SPS/PPS should be in an item property (hvcC). It's highly likely that the extraction does not extract the hvcC content because the notion of item property did not exist when we first wrote the item extraction code. Also the start code vs. length fields and maybe the emulation prevention bytes processing have to be added.

[avibrazil]

Apparently, MP4Box does not support HEIF/HEIC as generated by iOS 11 devices. Here are samples I took with my iPhone 7+ myself, useful for tests and debug.

https://avi.alkalay.net/clipboard/HEIF-iOS-11.zip

Zip file contains videos, regular photos, photos with depth and photo bursts.

I'm particularly interested in MP4Box support for iOS 11 HEIF tags and metadata.

This is what I get with GPAC 0.6.1 and 0.7.1 on Fedora Linux:

$ MP4Box -info IMG_4453.HEIC
[iso file] Read Box "infe" failed (Invalid IsoMedia File)
[iso file] Read Box "iinf" failed (Invalid IsoMedia File)
[iso file] Read Box "meta" failed (Invalid IsoMedia File)
Error opening file IMG_4453.HEIC: Invalid IsoMedia File

[jeanlf]

This is now fixed on git, thanks for the report

[deweydb]

@jeanlf is it possible that this commit while fixing it for most cases missed an edge case? I've got a file (IMG_5915.HEIC attached in the zip) that when i do:
MP4Box -info IMG_5915.HEIC
I get:

prof colour profile not supported 
prof colour profile not supported 
Root Meta type: "pict" - 52 resource item(s)
Primary Item - ID 49
Item #1 - ID 1 - Name: 
Item #2 - ID 2 - Name: 
Item #3 - ID 3 - Name: 
Item #4 - ID 4 - Name: 
Item #5 - ID 5 - Name: 
Item #6 - ID 6 - Name: 
Item #7 - ID 7 - Name: 
Item #8 - ID 8 - Name: 
Item #9 - ID 9 - Name: 
Item #10 - ID 10 - Name: 
Item #11 - ID 11 - Name: 
Item #12 - ID 12 - Name: 
Item #13 - ID 13 - Name: 
Item #14 - ID 14 - Name: 
Item #15 - ID 15 - Name: 
Item #16 - ID 16 - Name: 
Item #17 - ID 17 - Name: 
Item #18 - ID 18 - Name: 
Item #19 - ID 19 - Name: 
Item #20 - ID 20 - Name: 
Item #21 - ID 21 - Name: 
Item #22 - ID 22 - Name: 
Item #23 - ID 23 - Name: 
Item #24 - ID 24 - Name: 
Item #25 - ID 25 - Name: 
Item #26 - ID 26 - Name: 
Item #27 - ID 27 - Name: 
Item #28 - ID 28 - Name: 
Item #29 - ID 29 - Name: 
Item #30 - ID 30 - Name: 
Item #31 - ID 31 - Name: 
Item #32 - ID 32 - Name: 
Item #33 - ID 33 - Name: 
Item #34 - ID 34 - Name: 
Item #35 - ID 35 - Name: 
Item #36 - ID 36 - Name: 
Item #37 - ID 37 - Name: 
Item #38 - ID 38 - Name: 
Item #39 - ID 39 - Name: 
Item #40 - ID 40 - Name: 
Item #41 - ID 41 - Name: 
Item #42 - ID 42 - Name: 
Item #43 - ID 43 - Name: 
Item #44 - ID 44 - Name: 
Item #45 - ID 45 - Name: 
Item #46 - ID 46 - Name: 
Item #47 - ID 47 - Name: 
Item #48 - ID 48 - Name: 
Item #49 - ID 49 - Name: 
Item #50 - ID 50 - Name: 
Item #51 - ID 51 - Name: 
File has no movie (moov) - static data container

Then if I extract all of these:

for i in `seq 51`; do MP4Box -dump-item $i:path=item$i.hevc IMG_5915.HEIC; done

I get 51 files, item1.hevc through item51.hevc, for every extraction i get this warning:
prof colour profile not supported

Then if i continue, and convert these to PNG with ffmpeg nearly all of them convert successfully, but 2 fail:
ffmpeg -i item49.hevc -frames:v 1 -vsync vfr -q:v 1 -an image49.png�
item49.hevc: Invalid data found when processing input
ffmpeg -i item51.hevc -frames:v 1 -vsync vfr -q:v 1 -an image51.png
item51.hevc: Invalid data found when processing input

Although, it seems that image 48 is the bottom right corner of the image (because of the "letterboxing" visible). And that image 50 is some sort of thumbnail stored in an extra tile. So perhaps image 49 and image 51 are some other superfluous information? metadata stored in a "tile"?
HEIC Conversion.zip

[cconcolato]

item 49 and item 51 are not HEVC. 49 is a 'grid' item. 51 is EXIF metadata.

[deweydb]

@cconcolato Awesome! thanks for the help! So i guess maybe there would be some way of grabbing the EXIF metadata from 51 and applying it to the final image once the tiles are recombined?
Also, is there any way to tell from the metadata how many items there are per row in the image tile set? for example the one i posted above has 8 tiles per row.