Residential Collegefalse
Status已發表Published
Frequency Principle in Broad Learning System
Guang-Yong Chen1; Min Gan2; C. L. Philip Chen3; Hong-Tao Zhu4; Long Chen5
2021
Source PublicationIEEE Transactions on Neural Networks and Learning Systems
ISSN2162-237X
Volume33Issue:11Pages:6983-6989
Abstract

Deep neural networks have achieved breakthrough improvement in various application fields. Nevertheless, they usually suffer from a time-consuming training process because of the complicated structures of neural networks with a huge number of parameters. As an alternative, a fast and efficient discriminative broad learning system (BLS) is proposed, which takes the advantages of flat structure and incremental learning. The BLS has achieved outstanding performance in classification and regression problems. However, the previous studies ignored the reason why the BLS can generalize well. In this article, we focus on the interpretation from the viewpoint of the frequency domain. We discover the existence of the frequency principle in BLS, i.e., the BLS preferentially captures low-frequency components quickly and then fits the high frequencies during the incremental process of adding feature nodes and enhancement nodes. The frequency principle may be of great inspiration for expanding the application of BLS.

KeywordBroad Learning System (Bls) Computer Science Fourier Analysis Frequency Principle High Frequency Incremental Learning. Learning Systems Neural Networks Task Analysis Time Series Analysis Training
DOI10.1109/TNNLS.2021.3081568
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000732262800001
Scopus ID2-s2.0-85107178598
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorGuang-Yong Chen; Min Gan; C. L. Philip Chen; Long Chen
Affiliation1.College of Computer Science and Technology, Qingdao University, Qingdao 266071, China, and also with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350108, China.
2.College of Computer Science and Technology, Qingdao University, Qingdao 266071, China, and also with the College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350108, China (e-mail: [email protected]).
3.School of Computer Science and Engineering, South China University of Technology, Guangzhou 510641, China.
4.College of Mathematics and Computer Science, Fuzhou University, Fuzhou 350116, China.
5.Faculty of Science and Technology, University of Macau, Macau 99999, China.
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Guang-Yong Chen,Min Gan,C. L. Philip Chen,et al. Frequency Principle in Broad Learning System[J]. IEEE Transactions on Neural Networks and Learning Systems, 2021, 33(11), 6983-6989.
APA Guang-Yong Chen., Min Gan., C. L. Philip Chen., Hong-Tao Zhu., & Long Chen (2021). Frequency Principle in Broad Learning System. IEEE Transactions on Neural Networks and Learning Systems, 33(11), 6983-6989.
MLA Guang-Yong Chen,et al."Frequency Principle in Broad Learning System".IEEE Transactions on Neural Networks and Learning Systems 33.11(2021):6983-6989.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Guang-Yong Chen]'s Articles
[Min Gan]'s Articles
[C. L. Philip Chen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Guang-Yong Chen]'s Articles
[Min Gan]'s Articles
[C. L. Philip Chen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Guang-Yong Chen]'s Articles
[Min Gan]'s Articles
[C. L. Philip Chen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.