Missing Recovery: Single Image Reflection Removal Based on Auxiliary Prior Learning

Wei Ting Chen, Kuan Yu Chen, I. Hsiang Chen, Hao Yu Fang, Jian Jiun Ding, Sy Yen Kuo*

*Corresponding author for this work

Research output: Contribution to journalJournal Article peer-review

3 Scopus citations

Abstract

Photographs taken through a glass window are susceptible to disturbances due to reflection. Therefore, single image reflection removal is crucial to image quality enhancement. In this paper, a novel learning architecture that can address this ill-posed problem is proposed. First, a novel reflection removal pipeline was designed to reconstruct the missing information caused by the camera imaging process using the proposed missing recovery network. Second, to address the issues in existing reflection removal strategies, we revisit several auxiliary priors and integrate them by defining an energy function. To solve the energy function, a convolutional neural network-based optimization scheme was proposed. Finally, we investigated the dark channel responses of reflection and clean images and found an interesting way to distinguish between these two types of images. We prove this property mathematically and propose a novel loss function called dark channel loss to improve performance. Experiments show that the proposed method outperforms state-of-the-art reflection removal methods both quantitatively and qualitatively.

Original languageEnglish
Pages (from-to)643-656
Number of pages14
JournalIEEE Transactions on Image Processing
Volume32
DOIs
StatePublished - 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1992-2012 IEEE.

Keywords

  • auxiliary prior learning
  • dark channel loss
  • missing recovery
  • Single image reflection removal

Fingerprint

Dive into the research topics of 'Missing Recovery: Single Image Reflection Removal Based on Auxiliary Prior Learning'. Together they form a unique fingerprint.

Cite this