Residential College | false |
Status | 已發表Published |
Fast target-aware learning for few-shot video object segmentation | |
Yadang Chen1; Chuanyan HAO2; Zhi-Xin Yang3; Enhua WU4,5 | |
2022-08-08 | |
Source Publication | Science China Information Sciences |
ISSN | 1674-733X |
Volume | 65Issue:8Pages:182104 |
Abstract | Few-shot video object segmentation (FSVOS) aims to segment a specific object throughout a video sequence when only the first-frame annotation is given. In this study, we develop a fast target-aware learning approach for FSVOS, where the proposed approach adapts to new video sequences from its firstframe annotation through a lightweight procedure. The proposed network comprises two models. First, the meta knowledge model learns the general semantic features for the input video image and up-samples the coarse predicted mask to the original image size. Second, the target model adapts quickly from the limited support set. Concretely, during the online inference for testing the video, we first employ fast optimization techniques to train a powerful target model by minimizing the segmentation error in the first frame and then use it to predict the subsequent frames. During the offline training, we use a bilevel-optimization strategy to mimic the full testing procedure to train the meta knowledge model across multiple video sequences. The proposed method is trained only on an individual public video object segmentation (VOS) benchmark without additional training sets and compared favorably with state-of-the-art methods on DAVIS-2017, with a J &F overall score of 71.6%, and on YouTubeVOS-2018, with a J &F overall score of 75.4%. Meanwhile, a high inference speed of approximately 0.13 s per frame is maintained. |
Keyword | Video Object Segmentation Few-shot Target-aware Meta Knowledge Bilevel-optimization |
DOI | 10.1007/s11432-021-3396-7 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Information Systems ; Engineering, Electrical & Electronic |
WOS ID | WOS:000833497800007 |
Scopus ID | 2-s2.0-85135369630 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) Faculty of Science and Technology DEPARTMENT OF ELECTROMECHANICAL ENGINEERING |
Corresponding Author | Zhi-Xin Yang |
Affiliation | 1.Engineering Research Center of Digital Forensics, Ministry of Education, School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, China 2.School of Education Science and Technology, Nanjing University of Posts and Telecommunications, Nanjing 210023, China 3.State Key Laboratory of Internet of Things for Smart City, Department of Electromechanical Engineering, University of Macau, Macao 999078, China 4.State Key Laboratory of Computer Science, Institute of Software, University of Chinese Academy of Sciences, Beijing 100190, China 5.Faculty of Science and Technology, University of Macau, Macao 999078, China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Yadang Chen,Chuanyan HAO,Zhi-Xin Yang,et al. Fast target-aware learning for few-shot video object segmentation[J]. Science China Information Sciences, 2022, 65(8), 182104. |
APA | Yadang Chen., Chuanyan HAO., Zhi-Xin Yang., & Enhua WU (2022). Fast target-aware learning for few-shot video object segmentation. Science China Information Sciences, 65(8), 182104. |
MLA | Yadang Chen,et al."Fast target-aware learning for few-shot video object segmentation".Science China Information Sciences 65.8(2022):182104. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment