UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer
Lang, Shujun1; Liu, Xu2; Zhou, Mingliang1; Luo, Jun3; Pu, Huayan3; Zhuang, Xu4; Wang, Jason5; Wei, Xuekai6; Zhang, Taiping1; Feng, Yong1; Shang, Zhaowei1
2024-03
Source PublicationIEEE Transactions on Broadcasting
ISSN0018-9316
Volume70Issue:1Pages:316-324
Abstract

In this paper, a full-reference image quality assessment (FR-IQA) model based on deep meta-learning and Conformer is proposed. We combine the Conformer architecture with a Siamese network to extract the feature vectors of the reference and distorted images and calculate the similarity of these feature vectors as the predicted score of the image. We use meta-learning to help the model identify different types of image distortion. First, because the information taken as input by the human visual system (HVS) ranges in scale from local to global, we use a Conformer network as a feature extractor to obtain the global and local features of the pristine and distorted images and use a Siamese network to reduce the number of parameters in our model. Second, we use meta-learning to carry out bilevel gradient descent from the query set to the support set in the training stage and fine-tune the model parameters on a few images with unknown distortion types in the testing stage to improve the generalization ability of the model. Experiments show that our method is competitive with existing FR-IQA methods on three standard IQA datasets.

KeywordConformer Deep Learning Distortion Feature Extraction Full-reference Image Quality Assessment Image Quality Knowledge-driven Meta-learning Metalearning Task Analysis Visualization
DOI10.1109/TBC.2023.3308349
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering ; Telecommunications
WOS SubjectEngineering, Electrical & Electronic ; Telecommunications
WOS IDWOS:001077512600001
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85171559073
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Co-First AuthorLang, Shujun
Corresponding AuthorLuo, Jun
Affiliation1.School of Computer Science, Chongqing University, Chongqing, China
2.Academy of Advanced Interdisciplinary Research, Xidian University, Xi’an, China
3.State Key Laboratory of Mechanical Transmissions, Chongqing University, Chongqing, China
4.Guangdong Opel Mobile Communications Co., Ltd, OPPO, Chengdu, China
5.Guangdong Opel Mobile Communications Co., Ltd, OPPO, Nanjing, China
6.State Key Laboratory of Internet of Things for Smart City and the Department of Electrical and Computer Engineering, University of Macau, Macau, China
Recommended Citation
GB/T 7714
Lang, Shujun,Liu, Xu,Zhou, Mingliang,et al. A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer[J]. IEEE Transactions on Broadcasting, 2024, 70(1), 316-324.
APA Lang, Shujun., Liu, Xu., Zhou, Mingliang., Luo, Jun., Pu, Huayan., Zhuang, Xu., Wang, Jason., Wei, Xuekai., Zhang, Taiping., Feng, Yong., & Shang, Zhaowei (2024). A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer. IEEE Transactions on Broadcasting, 70(1), 316-324.
MLA Lang, Shujun,et al."A Full-Reference Image Quality Assessment Method via Deep Meta-Learning and Conformer".IEEE Transactions on Broadcasting 70.1(2024):316-324.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Lang, Shujun]'s Articles
[Liu, Xu]'s Articles
[Zhou, Mingliang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Lang, Shujun]'s Articles
[Liu, Xu]'s Articles
[Zhou, Mingliang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Lang, Shujun]'s Articles
[Liu, Xu]'s Articles
[Zhou, Mingliang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.