IDP: Image Denoising Using PoolFormer

Shou Kai Yin*, Jenhui Chen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recently, transformer-based models have achieved significant success in various computer vision tasks, with the attention-based token mixer module commonly believed to be the key factor. However, further research has shown that the attention-based token mixer module in transformers can be replaced by other methods, such as spatial multilayer perceptrons (MLPs) or Fourier transforms, to mix information between different tokens without sacrificing performance. Therefore, some have raised whether the success of transformers and its variants is not solely due to the attention-based token mixer module but rather to other factors. In a recent paper titled 'PoolFormer' the authors demonstrated that using a simple spatial pooling operation instead of the attention module in transformers can achieve competitive performance in object detection vision tasks. Based on this finding, we propose a low-computation model for image denoising based on the PoolFormer and an MLP + CNN Transformer decoder for image restoration. By reducing the computational complexity brought by the token mixer, the model still achieves a good peak signal-to-noise ratio (PSNR) in grayscale as well as in color image denoising. This suggests that, in low-level vision tasks such as denoising, simple attention modules can also achieve good results, particularly in grayscale image denoising.

Original languageEnglish
Title of host publicationProceedings - 2023 6th International Symposium on Computer, Consumer and Control, IS3C 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-43
Number of pages4
ISBN (Electronic)9798350301953
DOIs
StatePublished - 2023
Event6th International Symposium on Computer, Consumer and Control, IS3C 2023 - Taichung City, Taiwan
Duration: 30 06 202303 07 2023

Publication series

NameProceedings - 2023 6th International Symposium on Computer, Consumer and Control, IS3C 2023

Conference

Conference6th International Symposium on Computer, Consumer and Control, IS3C 2023
Country/TerritoryTaiwan
CityTaichung City
Period30/06/2303/07/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Fingerprint

Dive into the research topics of 'IDP: Image Denoising Using PoolFormer'. Together they form a unique fingerprint.

Cite this