Residential Collegefalse
Status已發表Published
A High-Resolution Dataset for Instance Detection with Multi-View Instance Capture
Shen, Qianqian; Zhao, Yunhan; Kwon, Nahyun; Kim, Jeeeun; Li, Yanan; KONG SHU
2023-12
Conference NameConference on Neural Information Processing Systems
Conference DateDecember 9, 2023
Conference PlaceVancouver, Canada
Abstract

Instance detection (InsDet) is a long-lasting problem in robotics and computer vision, aiming to detect object instances (predefined by some visual examples) in a cluttered scene. Despite its practical significance, its advancement is overshadowed by Object Detection, which aims to detect objects belonging to some predefined classes. One major reason is that current InsDet datasets are too small in scale by today's standards. For example, the popular InsDet dataset GMU (published in 2016) has only 23 instances, far less than COCO (80 classes), a well-known object detection dataset published in 2014. We are motivated to introduce a new InsDet dataset and protocol. First, we define a realistic setup for InsDet: training data consists of multi-view instance captures, along with diverse scene images allowing synthesizing training images by pasting instance images on them with free box annotations. Second, we release a real-world database, which contains multi-view capture of 100 object instances, and high-resolution (6k x 8k) testing images. Third, we extensively study baseline methods for InsDet on our dataset, analyze their performance and suggest future work. Somewhat surprisingly, using the off-the-shelf class-agnostic segmentation model (Segment Anything Model, SAM) and the self-supervised feature representation DINOv2 performs the best, achieving >10 AP better than end-to-end trained InsDet models that repurpose object detectors (e.g., FasterRCNN and RetinaNet).

Document TypeConference paper
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Recommended Citation
GB/T 7714
Shen, Qianqian,Zhao, Yunhan,Kwon, Nahyun,et al. A High-Resolution Dataset for Instance Detection with Multi-View Instance Capture[C], 2023.
APA Shen, Qianqian., Zhao, Yunhan., Kwon, Nahyun., Kim, Jeeeun., Li, Yanan., & KONG SHU (2023). A High-Resolution Dataset for Instance Detection with Multi-View Instance Capture. .
Files in This Item: Download All
File Name/Size Publications Version Access License
InsDet-NeurIPS-DB202(14138KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Shen, Qianqian]'s Articles
[Zhao, Yunhan]'s Articles
[Kwon, Nahyun]'s Articles
Baidu academic
Similar articles in Baidu academic
[Shen, Qianqian]'s Articles
[Zhao, Yunhan]'s Articles
[Kwon, Nahyun]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Shen, Qianqian]'s Articles
[Zhao, Yunhan]'s Articles
[Kwon, Nahyun]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: InsDet-NeurIPS-DB2023.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.