Residential College | false |
Status | 已發表Published |
A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer | |
Lang, Shujun1; Liu, Xu2; Zhou, Mingliang1; Luo, Jun3; Pu, Huayan3; Zhuang, Xu4; Wang, Jason5; Wei, Xuekai6; Zhang, Taiping1; Feng, Yong1; Shang, Zhaowei1 | |
2024-03 | |
Source Publication | IEEE Transactions on Broadcasting |
ISSN | 0018-9316 |
Volume | 70Issue:1Pages:316-324 |
Abstract | In this paper, a full-reference image quality assessment (FR-IQA) model based on deep meta-learning and Conformer is proposed. We combine the Conformer architecture with a Siamese network to extract the feature vectors of the reference and distorted images and calculate the similarity of these feature vectors as the predicted score of the image. We use meta-learning to help the model identify different types of image distortion. First, because the information taken as input by the human visual system (HVS) ranges in scale from local to global, we use a Conformer network as a feature extractor to obtain the global and local features of the pristine and distorted images and use a Siamese network to reduce the number of parameters in our model. Second, we use meta-learning to carry out bilevel gradient descent from the query set to the support set in the training stage and fine-tune the model parameters on a few images with unknown distortion types in the testing stage to improve the generalization ability of the model. Experiments show that our method is competitive with existing FR-IQA methods on three standard IQA datasets. |
Keyword | Conformer Deep Learning Distortion Feature Extraction Full-reference Image Quality Assessment Image Quality Knowledge-driven Meta-learning Metalearning Task Analysis Visualization |
DOI | 10.1109/TBC.2023.3308349 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering ; Telecommunications |
WOS Subject | Engineering, Electrical & Electronic ; Telecommunications |
WOS ID | WOS:001077512600001 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 |
Scopus ID | 2-s2.0-85171559073 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING |
Co-First Author | Lang, Shujun |
Corresponding Author | Luo, Jun |
Affiliation | 1.School of Computer Science, Chongqing University, Chongqing, China 2.Academy of Advanced Interdisciplinary Research, Xidian University, Xi’an, China 3.State Key Laboratory of Mechanical Transmissions, Chongqing University, Chongqing, China 4.Guangdong Opel Mobile Communications Co., Ltd, OPPO, Chengdu, China 5.Guangdong Opel Mobile Communications Co., Ltd, OPPO, Nanjing, China 6.State Key Laboratory of Internet of Things for Smart City and the Department of Electrical and Computer Engineering, University of Macau, Macau, China |
Recommended Citation GB/T 7714 | Lang, Shujun,Liu, Xu,Zhou, Mingliang,et al. A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer[J]. IEEE Transactions on Broadcasting, 2024, 70(1), 316-324. |
APA | Lang, Shujun., Liu, Xu., Zhou, Mingliang., Luo, Jun., Pu, Huayan., Zhuang, Xu., Wang, Jason., Wei, Xuekai., Zhang, Taiping., Feng, Yong., & Shang, Zhaowei (2024). A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer. IEEE Transactions on Broadcasting, 70(1), 316-324. |
MLA | Lang, Shujun,et al."A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer".IEEE Transactions on Broadcasting 70.1(2024):316-324. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment