Residential College | false |
Status | 已發表Published |
Novel Efficient RNN and LSTM-Like Architectures: Recurrent and Gated Broad Learning Systems and Their Applications for Text Classification | |
Du,Jie1; Vong,Chi Man2; Philip Chen,C. L.3 | |
2021-03-01 | |
Source Publication | IEEE Transactions on Cybernetics |
ABS Journal Level | 3 |
ISSN | 2168-2267 |
Volume | 51Issue:3Pages:1586-1597 |
Abstract | High accuracy of text classification can be achieved through simultaneous learning of multiple information, such as sequence information and word importance. In this article, a kind of flat neural networks called the broad learning system (BLS) is employed to derive two novel learning methods for text classification, including recurrent BLS (R-BLS) and long short-term memory (LSTM)-like architecture: gated BLS (G-BLS). The proposed two methods possess three advantages: 1) higher accuracy due to the simultaneous learning of multiple information, even compared to deep LSTM that extracts deeper but single information only; 2) significantly faster training time due to the noniterative learning in BLS, compared to LSTM; and 3) easy integration with other discriminant information for further improvement. The proposed methods have been evaluated over 13 real-world datasets from various types of text classification. From the experimental results, the proposed methods achieve higher accuracies than LSTM while taking significantly less training time on most evaluated datasets, especially when the LSTM is in deep architecture. Compared to R-BLS, G-BLS has an extra forget gate to control the flow of information (similar to LSTM) to further improve the accuracy on text classification so that G-BLS is more effective while R-BLS is more efficient. |
Keyword | Broad Learning System (Bls) Sequence Information Simultaneous Learning Text Classification Word Importance |
DOI | 10.1109/TCYB.2020.2969705 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Automation & Control Systems ; Computer Science |
WOS Subject | Automation & Control Systems ; Computer Science, Artificial Intelligence ; Computer Science, Cybernetics |
WOS ID | WOS:000619376300040 |
Scopus ID | 2-s2.0-85101145440 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Vong,Chi Man |
Affiliation | 1.National-Regional Key Technology Engineering Laboratory for Medical Ultrasound,Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging,School of Biomedical Engineering,Health Science Center,Shenzhen University,Shenzhen,518060,China 2.Department of Computer and Information Science,University of Macau,Macau,Macao 3.School of Computer Science and Engineering,South China University of Technology,Guangzhou,510641,China |
Corresponding Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Du,Jie,Vong,Chi Man,Philip Chen,C. L.. Novel Efficient RNN and LSTM-Like Architectures: Recurrent and Gated Broad Learning Systems and Their Applications for Text Classification[J]. IEEE Transactions on Cybernetics, 2021, 51(3), 1586-1597. |
APA | Du,Jie., Vong,Chi Man., & Philip Chen,C. L. (2021). Novel Efficient RNN and LSTM-Like Architectures: Recurrent and Gated Broad Learning Systems and Their Applications for Text Classification. IEEE Transactions on Cybernetics, 51(3), 1586-1597. |
MLA | Du,Jie,et al."Novel Efficient RNN and LSTM-Like Architectures: Recurrent and Gated Broad Learning Systems and Their Applications for Text Classification".IEEE Transactions on Cybernetics 51.3(2021):1586-1597. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment