An Inverse-Free and Scalable Sparse Bayesian Extreme Learning Machine for Classification Problems

UM > Faculty of Science and Technology > DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE

Status	已發表Published
	An Inverse-Free and Scalable Sparse Bayesian Extreme Learning Machine for Classification Problems
	Luo, J.H.; Vong, C. M.; Liu, Z.B.; Chen, C.Q.
	2021-06-01
Source Publication	IEEE Acess (SCI-E)
ISSN	2169-3536
Pages	1-9
Abstract	Sparse Bayesian Extreme Learning Machine (SBELM) constructs an extremely sparse and probabilistic model with low computational cost and high generalization. However, the update rule of hyperparameters (ARD prior) in SBELM involves using the diagonal elements from the inversion of the covariance matrix with the full training dataset, which raises the following two issues. Firstly, inverting the Hessian matrix may suffer ill-conditioning issues in some cases, which hinders SBELM from converging. Secondly, it may result in the memory-overflow issue with computational memory O(L3) (L: number of hidden nodes) to invert the big covariance matrix for updating the ARD priors. To address these issues, an inverse-free SBELM called QN-SBELM is proposed in this paper, which integrates the gradient-based Quasi-Newton (QN) method into SBELM to approximate the inverse covariance matrix. It takes O(L 2) computational complexity and is simultaneously scalable to large problems. QN-SBELM was evaluated on benchmark datasets of different sizes. Experimental results verify that QN-SBELM achieves more accurate results than SBELM with a sparser model, and also provides more stable solutions and a great extension to large-scale problems.
Keyword	Inverse-free quasi-Newton method sparse Bayesian extreme learning machine large classification sparse model
URL	View the original
Language	英語English
The Source to Article	PB_Publication
PUB ID	58817
Document Type	Journal article
Collection	DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding Author	Vong, C. M.
Recommended Citation GB/T 7714	Luo, J.H.,Vong, C. M.,Liu, Z.B.,et al. An Inverse-Free and Scalable Sparse Bayesian Extreme Learning Machine for Classification Problems[J]. IEEE Acess (SCI-E), 2021, 1-9.
APA	Luo, J.H.., Vong, C. M.., Liu, Z.B.., & Chen, C.Q. (2021). An Inverse-Free and Scalable Sparse Bayesian Extreme Learning Machine for Classification Problems. IEEE Acess (SCI-E), 1-9.
MLA	Luo, J.H.,et al."An Inverse-Free and Scalable Sparse Bayesian Extreme Learning Machine for Classification Problems".IEEE Acess (SCI-E) (2021):1-9.

Files in This Item:
There are no files associated with this item.

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Affiliation No.
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh