Residential College | false |
Status | 已發表Published |
Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks | |
Yang, Xudong1; Yan, Hongli2; Zhang, Anguo3; Xu, Pan2; Pan, Sio Hang3,4; Vai, Mang I.4,5; Gao, Yueming1,2 | |
2024-01 | |
Source Publication | Biomedical Signal Processing and Control |
ISSN | 1746-8094 |
Volume | 91Pages:105921 |
Abstract | Real-time emotion recognition via wearable devices is a pivotal component of health monitoring and human–computer interaction. To realize this objective, a spiking feed-forward neural networks (SFNNs) model was developed, which leverages six physiological signals from the psychophysiology of positive and negative emotions (POPANE) dataset to construct feature vectors. By converting well-trained artificial neural networks (ANNs) to spiking neural networks (SNNs) and employing weight normalization techniques, the SFNNs with data-based normalization achieved a maximum classification accuracy of 88.17% at a maximum input firing rate of 1000 Hz. In comparison to existing models, the SFNNs model integrates multimodal physiological signals to classify six discrete emotions, demonstrating high classification performance and rapid convergence speed, rendering it ideal for real-time emotion recognition. This work has potential applications in psychological diagnosis and medical rehabilitation through the use of wearable wristbands. |
Keyword | Emotion Recognition Feature Extraction Multimodal Physiological Signals Spiking Feed-forward Neural Networks Time Series Wearable Wristbands |
DOI | 10.1016/j.bspc.2023.105921 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Engineering |
WOS Subject | Engineering, Biomedical |
WOS ID | WOS:001175067200001 |
Publisher | ELSEVIER SCI LTD, THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, OXON, ENGLAND |
Scopus ID | 2-s2.0-85183450403 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology THE STATE KEY LABORATORY OF ANALOG AND MIXED-SIGNAL VLSI (UNIVERSITY OF MACAU) INSTITUTE OF MICROELECTRONICS DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING |
Corresponding Author | Gao, Yueming |
Affiliation | 1.School of Advanced Manufacturing, Fuzhou University, Quanzhou, Fujian, 362251, China 2.College of Physical and Information Engineering, Fuzhou University, Fuzhou, Fujian, 350108, China 3.Institute of Microelectronics, University of Macau, Taipa, 999078, Macao 4.State Key Laboratory of Analog and Mixed-Signal VLSI, IME and FST-ECE, University of Macau, Taipa, 999078, Macao 5.Faculty of Science and Technology, University of Macau, Taipa, 999078, Macao |
Recommended Citation GB/T 7714 | Yang, Xudong,Yan, Hongli,Zhang, Anguo,et al. Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks[J]. Biomedical Signal Processing and Control, 2024, 91, 105921. |
APA | Yang, Xudong., Yan, Hongli., Zhang, Anguo., Xu, Pan., Pan, Sio Hang., Vai, Mang I.., & Gao, Yueming (2024). Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks. Biomedical Signal Processing and Control, 91, 105921. |
MLA | Yang, Xudong,et al."Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks".Biomedical Signal Processing and Control 91(2024):105921. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment