UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Comparison and Combination of Activation Functions in Broad Learning System
Lili Xu1,2; C. L. Philip Chen L.2,3,4
2020-10-11
Conference Name2020 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2020
Source PublicationConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
Volume2020-October
Pages3537-3542
Conference Date11-14 October 2020
Conference PlaceToronto, ON, Canada
Abstract

Activation function is a crucial component in artificial neural networks for its capability of converting linear function of input to complex nonlinear expression. It also plays an important role generating enhancement nodes in broad learning system(BLS). In this paper, we perform the comparison of 20 popular activation functions on different datasets in classification and regression. Among all selected activation functions, sigmoid leads to faster training process and greater approximation capability than others in general tasks. Meanwhile, the statistical analysis demonstrates that the type of activation function does not affect the performance of BLS too much. Afterwards, we assemble some best-performing activation functions to form a combination within convex restriction, which achieves better performance than corresponding base activation functions in standard BLS.

KeywordActivation Function Broad Learning System Classification Combination Method Regression
DOI10.1109/SMC42975.2020.9282871
URLView the original
Indexed ByCPCI-S
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Cybernetics ; Computer Science, Information Systems
WOS IDWOS:000687430603088
Scopus ID2-s2.0-85098859440
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Affiliation1.School of Applied Mathematics, Beijing Normal University, Zhuhai, China
2.Faculty of Science and Technology, University of Macau, Macau, China
3.School of Computer Science and Engineering, South China University of Technology, Guangzhou, China
4.College of Navigation, Dalian Maritime University, Dalian, China
First Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Lili Xu,C. L. Philip Chen L.. Comparison and Combination of Activation Functions in Broad Learning System[C], 2020, 3537-3542.
APA Lili Xu., & C. L. Philip Chen L. (2020). Comparison and Combination of Activation Functions in Broad Learning System. Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics, 2020-October, 3537-3542.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Lili Xu]'s Articles
[C. L. Philip Chen L.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Lili Xu]'s Articles
[C. L. Philip Chen L.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Lili Xu]'s Articles
[C. L. Philip Chen L.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.