UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
MFDNet: Multi-Frequency Deflare Network for efficient nighttime flare removal
Jiang, Yiguo1; Chen, Xuhang1,2,3; Pun, Chi Man1; Wang, Shuqiang2; Feng, Wei4
2024-07-04
Source PublicationVisual Computer
ISSN0178-2789
Abstract

When light is scattered or reflected accidentally in the lens, flare artifacts may appear in the captured photographs, affecting the photographs’ visual quality. The main challenge in flare removal is to eliminate various flare artifacts while preserving the original content of the image. To address this challenge, we propose a lightweight Multi-Frequency Deflare Network (MFDNet) based on the Laplacian Pyramid. Our network decomposes the flare-corrupted image into low- and high-frequency bands, effectively separating the illumination and content information in the image. The low-frequency part typically contains illumination information, while the high-frequency part contains detailed content information. So our MFDNet consists of two main modules: the Low-Frequency Flare Perception Module (LFFPM) to remove flare in the low-frequency part and the Hierarchical Fusion Reconstruction Module (HFRM) to reconstruct the flare-free image. Specifically, to perceive flare from a global perspective while retaining detailed information for image restoration, LFFPM utilizes Transformer to extract global information while utilizing a convolutional neural network to capture detailed local features. Then HFRM gradually fuses the outputs of LFFPM with the high-frequency component of the image through feature aggregation. Moreover, our MFDNet can reduce the computational cost by processing in multiple frequency bands instead of directly removing the flare on the input image. Experimental results demonstrate that our approach outperforms state-of-the-art methods in removing nighttime flare on real-world and synthetic images from the Flare7K dataset. Furthermore, the computational complexity of our model is remarkably low.

KeywordCnn Efficient Flare Removal Multi-frequency Transformer
DOI10.1007/s00371-024-03540-x
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering
WOS IDWOS:001262200800001
PublisherSPRINGER, ONE NEW YORK PLAZA, SUITE 4600 , NEW YORK, NY 10004, UNITED STATES
Scopus ID2-s2.0-85197924153
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorPun, Chi Man
Affiliation1.University of Macau, Macao
2.Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
3.Huizhou University, Huizhou, China
4.Tianjin University, Tianjin, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Jiang, Yiguo,Chen, Xuhang,Pun, Chi Man,et al. MFDNet: Multi-Frequency Deflare Network for efficient nighttime flare removal[J]. Visual Computer, 2024.
APA Jiang, Yiguo., Chen, Xuhang., Pun, Chi Man., Wang, Shuqiang., & Feng, Wei (2024). MFDNet: Multi-Frequency Deflare Network for efficient nighttime flare removal. Visual Computer.
MLA Jiang, Yiguo,et al."MFDNet: Multi-Frequency Deflare Network for efficient nighttime flare removal".Visual Computer (2024).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jiang, Yiguo]'s Articles
[Chen, Xuhang]'s Articles
[Pun, Chi Man]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jiang, Yiguo]'s Articles
[Chen, Xuhang]'s Articles
[Pun, Chi Man]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jiang, Yiguo]'s Articles
[Chen, Xuhang]'s Articles
[Pun, Chi Man]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.