Depth Images support

[bigcat88]

In this commit I have added an example of such heic file taken on iPhone.

Here is the primary image:

Here is the depth image:

Here is an Aux image(urn/apple_photo/2020/aux/hdrgainmap):

Does anyone need the opportunity to read them?

[wiggin15]

Yes please :)

[bigcat88]

I'll try to add support for depth image types in the next release

[bigcat88]

@wiggin15 If you need aux images support, please tell me in #117 where they can be used besides converting a photo to HDR?
And preferably some examples besides those generated by iPhone...

[bigcat88]

    im = Image.open("../tests/images/heif_other/pug.heic")
    depth_im = im.info["depth_images"][0]  # we know that there is a depth image
    # depth images are just `class HeifDepthImage(BaseImage)`, so work with them as usual pillow_heif's image 
    # depending on for what you need depth image you can convert it to numpy array or convert to pillow
    pil_im = depth_im.to_pillow()
    np_im = np.asarray(depth_im)
    print(pil_im)
    print(pil_im.info["metadata"])

<PIL.Image.Image image mode=L size=768x576 at 0x1069A7F50>
{'d_min': 1.498046875, 'd_max': 4.3828125, 'representation_type': 1, 'disparity_reference_view': 0, 'nonlinear_representation_model_size': 0}

[wiggin15]

Hi @bigcat88 thanks a lot for taking a look at this! We're trying to visualize datasets of photos taken by iPhone, so I have no examples outside this use case. Depth is important to our use case because we compare it to depth data created for the photos by external machine-learning algorithms. The HDR Gain Map data is less important to us specifically (but it could be nice for "completeness" of the visualization options we display to users).

[bigcat88]

done, new version is out

[gau-nernst]

    im = Image.open("../tests/images/heif_other/pug.heic")
    depth_im = im.info["depth_images"][0]  # we know that there is a depth image
    # depth images are just `class HeifDepthImage(BaseImage)`, so work with them as usual pillow_heif's image 
    # depending on for what you need depth image you can convert it to numpy array or convert to pillow
    pil_im = depth_im.to_pillow()
    np_im = np.asarray(depth_im)
    print(pil_im)
    print(pil_im.info["metadata"])

<PIL.Image.Image image mode=L size=768x576 at 0x1069A7F50>
{'d_min': 1.498046875, 'd_max': 4.3828125, 'representation_type': 1, 'disparity_reference_view': 0, 'nonlinear_representation_model_size': 0}

Hi @bigcat88, thank you for this useful library. Can you add this snippet to access depth image to the README file, so that it is more accessible? I keep going back to this issue just to see this snippet. I think others will appreciate this feature too :)

[bigcat88]

Good point, thanks and done!

[GaussianGuaicai]

Is there any support for save HEIF with depth images ？I try put it in im.info['depth_images'][0] and then im.save(), but the depth images wont save in file.

[bigcat88]

No, libheif does not currently have an API for this. I advise you to create a question there with a request to add such an API to their soon to be released version 1.18