Residential College | false |
Status | 已發表Published |
Comparison and Combination of Activation Functions in Broad Learning System | |
Lili Xu1,2; C. L. Philip Chen L.2,3,4 | |
2020-10-11 | |
Conference Name | 2020 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2020 |
Source Publication | Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics |
Volume | 2020-October |
Pages | 3537-3542 |
Conference Date | 11-14 October 2020 |
Conference Place | Toronto, ON, Canada |
Abstract | Activation function is a crucial component in artificial neural networks for its capability of converting linear function of input to complex nonlinear expression. It also plays an important role generating enhancement nodes in broad learning system(BLS). In this paper, we perform the comparison of 20 popular activation functions on different datasets in classification and regression. Among all selected activation functions, sigmoid leads to faster training process and greater approximation capability than others in general tasks. Meanwhile, the statistical analysis demonstrates that the type of activation function does not affect the performance of BLS too much. Afterwards, we assemble some best-performing activation functions to form a combination within convex restriction, which achieves better performance than corresponding base activation functions in standard BLS. |
Keyword | Activation Function Broad Learning System Classification Combination Method Regression |
DOI | 10.1109/SMC42975.2020.9282871 |
URL | View the original |
Indexed By | CPCI-S |
Language | 英語English |
WOS Research Area | Computer Science |
WOS Subject | Computer Science, Cybernetics ; Computer Science, Information Systems |
WOS ID | WOS:000687430603088 |
Scopus ID | 2-s2.0-85098859440 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Affiliation | 1.School of Applied Mathematics, Beijing Normal University, Zhuhai, China 2.Faculty of Science and Technology, University of Macau, Macau, China 3.School of Computer Science and Engineering, South China University of Technology, Guangzhou, China 4.College of Navigation, Dalian Maritime University, Dalian, China |
First Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Lili Xu,C. L. Philip Chen L.. Comparison and Combination of Activation Functions in Broad Learning System[C], 2020, 3537-3542. |
APA | Lili Xu., & C. L. Philip Chen L. (2020). Comparison and Combination of Activation Functions in Broad Learning System. Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2020-October, 3537-3542. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment