UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks
Yang, Xudong1; Yan, Hongli2; Zhang, Anguo3; Xu, Pan2; Pan, Sio Hang3,4; Vai, Mang I.4,5; Gao, Yueming1,2
2024-01
Source PublicationBiomedical Signal Processing and Control
ISSN1746-8094
Volume91Pages:105921
Abstract

Real-time emotion recognition via wearable devices is a pivotal component of health monitoring and human–computer interaction. To realize this objective, a spiking feed-forward neural networks (SFNNs) model was developed, which leverages six physiological signals from the psychophysiology of positive and negative emotions (POPANE) dataset to construct feature vectors. By converting well-trained artificial neural networks (ANNs) to spiking neural networks (SNNs) and employing weight normalization techniques, the SFNNs with data-based normalization achieved a maximum classification accuracy of 88.17% at a maximum input firing rate of 1000 Hz. In comparison to existing models, the SFNNs model integrates multimodal physiological signals to classify six discrete emotions, demonstrating high classification performance and rapid convergence speed, rendering it ideal for real-time emotion recognition. This work has potential applications in psychological diagnosis and medical rehabilitation through the use of wearable wristbands.

KeywordEmotion Recognition Feature Extraction Multimodal Physiological Signals Spiking Feed-forward Neural Networks Time Series Wearable Wristbands
DOI10.1016/j.bspc.2023.105921
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaEngineering
WOS SubjectEngineering, Biomedical
WOS IDWOS:001175067200001
PublisherELSEVIER SCI LTD, THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, OXON, ENGLAND
Scopus ID2-s2.0-85183450403
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF ANALOG AND MIXED-SIGNAL VLSI (UNIVERSITY OF MACAU)
INSTITUTE OF MICROELECTRONICS
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Corresponding AuthorGao, Yueming
Affiliation1.School of Advanced Manufacturing, Fuzhou University, Quanzhou, Fujian, 362251, China
2.College of Physical and Information Engineering, Fuzhou University, Fuzhou, Fujian, 350108, China
3.Institute of Microelectronics, University of Macau, Taipa, 999078, Macao
4.State Key Laboratory of Analog and Mixed-Signal VLSI, IME and FST-ECE, University of Macau, Taipa, 999078, Macao
5.Faculty of Science and Technology, University of Macau, Taipa, 999078, Macao
Recommended Citation
GB/T 7714
Yang, Xudong,Yan, Hongli,Zhang, Anguo,et al. Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks[J]. Biomedical Signal Processing and Control, 2024, 91, 105921.
APA Yang, Xudong., Yan, Hongli., Zhang, Anguo., Xu, Pan., Pan, Sio Hang., Vai, Mang I.., & Gao, Yueming (2024). Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks. Biomedical Signal Processing and Control, 91, 105921.
MLA Yang, Xudong,et al."Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks".Biomedical Signal Processing and Control 91(2024):105921.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang, Xudong]'s Articles
[Yan, Hongli]'s Articles
[Zhang, Anguo]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang, Xudong]'s Articles
[Yan, Hongli]'s Articles
[Zhang, Anguo]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang, Xudong]'s Articles
[Yan, Hongli]'s Articles
[Zhang, Anguo]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.