Details

Autor(en) / Beteiligte

• Zhang, Jinsong
• Sunkavalli, Kalyan
• Hold-Geoffroy, Yannick
• Hadap, Sunil
• Eisenman, Jonathan
• Lalonde, Jean-Francois

Titel

All-Weather Deep Outdoor Lighting Estimation

Ist Teil von

• 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, p.10150-10158

Ort / Verlag

IEEE

Erscheinungsjahr

2019

Quelle

IEEE Xplore

Beschreibungen/Notizen

• We present a neural network that predicts HDR outdoor illumination from a single LDR image. At the heart of our work is a method to accurately learn HDR lighting from LDR panoramas under any weather condition. We achieve this by training another CNN (on a combination of synthetic and real images) to take as input an LDR panorama, and regress the parameters of the Lalonde-Mathews outdoor illumination model. This model is trained such that it a) reconstructs the appearance of the sky, and b) renders the appearance of objects lit by this illumination. We use this network to label a large-scale dataset of LDR panoramas with lighting parameters and use them to train our single image outdoor lighting estimation network. We demonstrate, via extensive experiments, that both our panorama and singe image networks outperform the state of the art, and unlike prior work, are able to handle weather conditions ranging from fully sunny to overcast skies.