Residential Collegefalse
Status已發表Published
A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification
Feng, Shuang1; Philip Chen, C. L.2,3; Zhang, Chun Yang4
2020-07-01
Source PublicationIEEE Transactions on Fuzzy Systems
ISSN1063-6706
Volume28Issue:7Pages:1344-1355
Abstract

We establish a fuzzy deep model called the fuzzy deep belief net (FDBN) based on fuzzy restricted Boltzmann machines (FRBMs) due to their excellent generative and discriminative properties. The learning procedure of an FDBN is divided into a pretraining phase and a subsequent fine-tuning phase. In the pretraining phase, a group of FRBMs is trained in a greedy layerwise way: the first FRBM is trained by original samples, and the average values of the left and right probabilities produced by its hidden units are treated as the training data for subsequent FRBMs. The resulting FDBN is either a generative or a discriminative model depending on the choice of training a generative or a discriminative type of FRBM on top. Then, a hybrid learning approach is proposed to fine-tune this novel fuzzy deep model: the well pretrained fuzzy parameters are first defuzzified, and the FDBN with defuzzified parameters is fine-tuned by the wake-sleep or stochastic gradient descent algorithm. This hybrid strategy not only avoids learning an intractable fuzzy neural network, but also greatly improves the classification capability of the FDBN. The experimental results on MNIST, NORB, and 15 Scene databases indicate that the FDBN with the hybrid learning approach can handle high-dimensional raw images directly. It inherits the fine nature of the FRBM and outperforms some state-of-the-art discriminative models in classification accuracy. Moreover, it shows better capability of robustness than a deep belief net when encountering noisy data.

KeywordClassification Fuzzy Deep Model Fuzzy Restricted Boltzmann Machine (Frbm) Hybrid Learning
DOI10.1109/TFUZZ.2019.2902111
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS IDWOS:000545205300014
Scopus ID2-s2.0-85085662756
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding AuthorPhilip Chen, C. L.
Affiliation1.School of Applied Mathematics, Beijing Normal University, Zhuhai, 519087, China
2.Faculty of Science and Technology, University of Macau, 999078, Macao
3.Dalian Maritime Univ, Dept Nav, Dalian 116026, Peoples R China
4.School of Mathematics and Computer Science, Fuzhou University, Fuzhou, China
Corresponding Author AffilicationFaculty of Science and Technology
Recommended Citation
GB/T 7714
Feng, Shuang,Philip Chen, C. L.,Zhang, Chun Yang. A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification[J]. IEEE Transactions on Fuzzy Systems, 2020, 28(7), 1344-1355.
APA Feng, Shuang., Philip Chen, C. L.., & Zhang, Chun Yang (2020). A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification. IEEE Transactions on Fuzzy Systems, 28(7), 1344-1355.
MLA Feng, Shuang,et al."A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification".IEEE Transactions on Fuzzy Systems 28.7(2020):1344-1355.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Feng, Shuang]'s Articles
[Philip Chen, C. L.]'s Articles
[Zhang, Chun Yang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Feng, Shuang]'s Articles
[Philip Chen, C. L.]'s Articles
[Zhang, Chun Yang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Feng, Shuang]'s Articles
[Philip Chen, C. L.]'s Articles
[Zhang, Chun Yang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.