UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
When, Where, and What? A Benchmark for Accident Anticipation and Localization with Large Language Models
Liao, Haicheng1; Li, Yongkang2; Wang, Chengyue1; Guan, Yanchen1; Tam, Kahou1; Tian, Chunlin1; Li, Li1; Xu, Chengzhong1; Li, Zhenning1
2024-11
Conference Name32nd ACM International Conference on Multimedia, MM 2024
Source PublicationMM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia
Pages8-17
Conference Date28 October 2024 - 1 November 2024
Conference PlaceMelbourne
CountryAustralia
PublisherAssociation for Computing Machinery, Inc
Abstract

As autonomous driving systems increasingly become part of daily transportation, the ability to accurately anticipate and mitigate potential traffic accidents is paramount. Traditional accident anticipation models primarily utilizing dashcam videos are adept at predicting when an accident may occur but fall short in localizing the incident and identifying involved entities. Addressing this gap, this study introduces a novel framework that integrates Large Language Models (LLMs) to enhance predictive capabilities across multiple dimensions-what, when, and where accidents might occur. We develop an innovative chain-based attention mechanism that dynamically adjusts to prioritize high-risk elements within complex driving scenes. This mechanism is complemented by a three-stage model that processes outputs from smaller models into detailed multimodal inputs for LLMs, thus enabling a more nuanced understanding of traffic dynamics. Empirical validation on the DAD, CCD, and A3D datasets demonstrates superior performance in Average Precision (AP) and Mean Time-To-Accident (mTTA), establishing new benchmarks for accident prediction technology. Our approach not only advances the technological framework for autonomous driving safety but also enhances human-AI interaction, making predictive insights generated by autonomous systems more intuitive and actionable.

KeywordAutonomous Driving Dynamic Object Attention Human-ai Interaction Large Language Models Traffic Accident Anticipation
DOI10.1145/3664647.3681326
URLView the original
Language英語English
Scopus ID2-s2.0-85209816001
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorLi, Zhenning
Affiliation1.University of Macau, Macao
2.University of Electronic Science and Technology of China, Chengdu, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Liao, Haicheng,Li, Yongkang,Wang, Chengyue,et al. When, Where, and What? A Benchmark for Accident Anticipation and Localization with Large Language Models[C]:Association for Computing Machinery, Inc, 2024, 8-17.
APA Liao, Haicheng., Li, Yongkang., Wang, Chengyue., Guan, Yanchen., Tam, Kahou., Tian, Chunlin., Li, Li., Xu, Chengzhong., & Li, Zhenning (2024). When, Where, and What? A Benchmark for Accident Anticipation and Localization with Large Language Models. MM 2024 - Proceedings of the 32nd ACM International Conference on Multimedia, 8-17.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liao, Haicheng]'s Articles
[Li, Yongkang]'s Articles
[Wang, Chengyue]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liao, Haicheng]'s Articles
[Li, Yongkang]'s Articles
[Wang, Chengyue]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liao, Haicheng]'s Articles
[Li, Yongkang]'s Articles
[Wang, Chengyue]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.