Residential College | false |
Status | 即將出版Forthcoming |
Analytical selection of hidden parameters through expanded enhancement matrix stability for functional-link neural networks and broad learning systems | |
Li, Yuchen1; Vong, Chi Man2; Chen, C. L.Phillip3; Wang, Shitong1![]() | |
2025-02-15 | |
Source Publication | Knowledge-Based Systems
![]() |
ISSN | 0950-7051 |
Volume | 310Pages:112923 |
Abstract | Functional-link neural network(FLNN) and its recent advancement, i.e., broad learning system(BLS), share the same mathematical essence in terms of the analytical solution to the parameters in their respective output layers. However, their performance often depends on an excessive number of enhancement nodes and the randomly assigned hidden parameters. This actually triggers a serious challenge: how to effectively select randomly assigned hidden parameters from the available candidates to simultaneously guarantee stronger generalization capability and fast training speed. In this study, we introduce the new concept of expanded enhancement matrix stability (EEMS) to address this challenge and identify the crucial factor for fast training in FLNN and BLS. We theoretically reveal the relationship between EEMS and the generalization capabilities of FLNN and BLS, in terms of the upper bounds of both the generalization error and the variance of cross-validation loss. Following this, we derive analytical (and hence fast) hidden parameter selection algorithms—EEMS-r and EEMS-cv—for both FLNN and BLS, based on EEMS with respect to the generalization error and the variance of cross-validation loss. Experimental results on 14 benchmarking datasets demonstrate the effectiveness of the proposed algorithms EEMS-r and EEMS-cv on most of the adopted datasets in enhancing generalization performance and reveal that a downsized structure of BLS may be empirically preset, in contrast to the standard BLS. |
Keyword | Functional-link Neural Networks Broad Learning Systems Generalization Expanded Enhancement Matrix Stability Hidden Parameter Selection |
DOI | 10.1016/j.knosys.2024.112923 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Artificial Intelligence |
WOS ID | WOS:001403180000001 |
Publisher | ELSEVIER, RADARWEG 29, 1043 NX AMSTERDAM, NETHERLANDS |
Scopus ID | 2-s2.0-85213237918 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Wang, Shitong |
Affiliation | 1.School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Lihu Avenue, Jiangsu, 214122, China 2.Department of Computer and Information Science, University of Macau, Macau, China 3.School of Computer Science and Engineering, South China University of Technology, Guangzhou, China |
Recommended Citation GB/T 7714 | Li, Yuchen,Vong, Chi Man,Chen, C. L.Phillip,et al. Analytical selection of hidden parameters through expanded enhancement matrix stability for functional-link neural networks and broad learning systems[J]. Knowledge-Based Systems, 2025, 310, 112923. |
APA | Li, Yuchen., Vong, Chi Man., Chen, C. L.Phillip., & Wang, Shitong (2025). Analytical selection of hidden parameters through expanded enhancement matrix stability for functional-link neural networks and broad learning systems. Knowledge-Based Systems, 310, 112923. |
MLA | Li, Yuchen,et al."Analytical selection of hidden parameters through expanded enhancement matrix stability for functional-link neural networks and broad learning systems".Knowledge-Based Systems 310(2025):112923. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment