EDWL (ECCV2022)

An Gia Vien and Chul Lee

Official PyTorch Code for "Exposure-Aware Dynamic Weighted Learning for Single-Shot HDR Imaging"

Paper link: https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136670429.pdf

Supplemental material document: https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136670429-supp.pdf

Introduction

We propose a novel single-shot high dynamic range (HDR) imaging algorithm based on exposure-aware dynamic weighted learning, which reconstructs an HDR image from a spatially varying exposure (SVE) raw image. First, we recover poorly exposed pixels by developing a network that learns local dynamic filters to exploit local neighboring pixels across color channels. Second, we develop another network that combines only valid features in well-exposed regions by learning exposure-aware feature fusion. Third, we synthesize the raw radiance map by adaptively combining the outputs of the two networks that have different characteristics with complementary information. Finally, a full-color HDR image is obtained by interpolating missing color information.

Requirements

• PyTorch 1.7.1/1.9.0
• Python 3.8.5/3.8.8
• mat73
• Matlab 2020a (for estimating evaluation metrics: pu-/log-PSNR, pu-MSSSIM, HDR-VDP, and HDR-VQM)

Set up

• Test data path (e.g., "Kalantari/")

• Output path (e.g., "test_results/")

• Weight path (e.g., "WEIGHTS_ECCV2022/")

• Download Kalantari data for testing from: https://drive.google.com/file/d/1bkyNjlMst8rz5xRI43uzkOwhtNiTMWI2/view?usp=sharing

• Download pretrained weights from: https://drive.google.com/file/d/1v32KDb7qwck7lJL59m5ei7eGeGA6Qvjx/view?usp=share_link

Usage

Running the test code:

    $ python Main_testing.py

We are in preparing to share train and evaluation metric estimation codes soon!

Citation

Please cite the following paper if you feel this repository useful.

    @inproceedings{EDWL,
        author    = {An Gia Vien and Chul Lee}, 
        title     = {Exposure-Aware Dynamic Weighted Learning for Single-Shot HDR Imaging}, 
        booktitle = {European Conference on Computer Vision},
        year      = {2022}
    }

License

See MIT License