Residential College | false |
Status | 已發表Published |
Pre-trained SAM as data augmentation for image segmentation | |
Wu, Junjun1,2; Rao, Yunbo2![]() ![]() ![]() | |
2024-10 | |
Source Publication | CAAI Transactions on Intelligence Technology
![]() |
ISSN | 2468-6557 |
Abstract | Data augmentation plays an important role in training deep neural model by expanding the size and diversity of the dataset. Initially, data augmentation mainly involved some simple transformations of images. Later, in order to increase the diversity and complexity of data, more advanced methods appeared and evolved to sophisticated generative models. However, these methods required a mass of computation of training or searching. In this paper, a novel training-free method that utilises the Pre-Trained Segment Anything Model (SAM) model as a data augmentation tool (PTSAM-DA) is proposed to generate the augmented annotations for images. Without the need for training, it obtains prompt boxes from the original annotations and then feeds the boxes to the pre-trained SAM to generate diverse and improved annotations. In this way, annotations are augmented more ingenious than simple manipulations without incurring huge computation for training a data augmentation model. Multiple comparative experiments on three datasets are conducted, including an in-house dataset, ADE20K and COCO2017. On this in-house dataset, namely Agricultural Plot Segmentation Dataset, maximum improvements of 3.77% and 8.92% are gained in two mainstream metrics, mIoU and mAcc, respectively. Consequently, large vision models like SAM are proven to be promising not only in image segmentation but also in data augmentation. |
Keyword | Data Augmentation Image Segmentation Large Model Segment Anything Model |
DOI | 10.1049/cit2.12381 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:001336276800001 |
Publisher | WILEY, 111 RIVER ST, HOBOKEN 07030-5774, NJ |
Scopus ID | 2-s2.0-85205920704 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Rao, Yunbo; Zeng, Shaoning |
Affiliation | 1.Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China, Huzhou, China 2.School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, China 3.Pattern Analysis and Machine Intelligence Research Group, Department of Computer and Information Science, University of Macau, Macao, China |
Recommended Citation GB/T 7714 | Wu, Junjun,Rao, Yunbo,Zeng, Shaoning,et al. Pre-trained SAM as data augmentation for image segmentation[J]. CAAI Transactions on Intelligence Technology, 2024. |
APA | Wu, Junjun., Rao, Yunbo., Zeng, Shaoning., & Zhang, Bob (2024). Pre-trained SAM as data augmentation for image segmentation. CAAI Transactions on Intelligence Technology. |
MLA | Wu, Junjun,et al."Pre-trained SAM as data augmentation for image segmentation".CAAI Transactions on Intelligence Technology (2024). |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment