DehazeNeRF: Multi-image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields

Wei Ting Chen*, Wang Yifan, Sy Yen Kuo, Gordon Wetzstein

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

Neural radiance fields (NeRFs) have demonstrated state-of-the-art performance for 3D computer vision tasks, including novel view synthesis and 3D shape reconstruction. However, these methods fail scattering medium, such as haze, is prevalent in the scene. To address this challenge, we introduce DehazeNeRF as a framework that robustly operates in hazy conditions. DehazeNeRF extends the volume rendering equation by adding physically realistic terms that model atmospheric scattering. By parameterizing these terms using suitable networks that match the physical properties, we introduce effective inductive biases, which, together with the proposed regularizations, allow DehazeNeRF to demonstrate successful multi-view haze removal, novel view synthesis, and 3D shape reconstruction where existing approaches failed. Our code and pretrained models can be found on this page.

Original languageEnglish
Title of host publicationProceedings - 2024 International Conference on 3D Vision, 3DV 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages247-256
Number of pages10
ISBN (Electronic)9798350362459
DOIs
StatePublished - 2024
Event11th International Conference on 3D Vision, 3DV 2024 - Davos, Switzerland
Duration: 18 03 202421 03 2024

Publication series

NameProceedings - 2024 International Conference on 3D Vision, 3DV 2024

Conference

Conference11th International Conference on 3D Vision, 3DV 2024
Country/TerritorySwitzerland
CityDavos
Period18/03/2421/03/24

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • 3D Reconstruction
  • Haze Removal
  • Neural radiance fields

Fingerprint

Dive into the research topics of 'DehazeNeRF: Multi-image Haze Removal and 3D Shape Reconstruction using Neural Radiance Fields'. Together they form a unique fingerprint.

Cite this