Residential College | false |
Status | 已發表Published |
A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification | |
Feng, Shuang1; Philip Chen, C. L.2,3; Zhang, Chun Yang4 | |
2020-07-01 | |
Source Publication | IEEE Transactions on Fuzzy Systems |
ISSN | 1063-6706 |
Volume | 28Issue:7Pages:1344-1355 |
Abstract | We establish a fuzzy deep model called the fuzzy deep belief net (FDBN) based on fuzzy restricted Boltzmann machines (FRBMs) due to their excellent generative and discriminative properties. The learning procedure of an FDBN is divided into a pretraining phase and a subsequent fine-tuning phase. In the pretraining phase, a group of FRBMs is trained in a greedy layerwise way: the first FRBM is trained by original samples, and the average values of the left and right probabilities produced by its hidden units are treated as the training data for subsequent FRBMs. The resulting FDBN is either a generative or a discriminative model depending on the choice of training a generative or a discriminative type of FRBM on top. Then, a hybrid learning approach is proposed to fine-tune this novel fuzzy deep model: the well pretrained fuzzy parameters are first defuzzified, and the FDBN with defuzzified parameters is fine-tuned by the wake-sleep or stochastic gradient descent algorithm. This hybrid strategy not only avoids learning an intractable fuzzy neural network, but also greatly improves the classification capability of the FDBN. The experimental results on MNIST, NORB, and 15 Scene databases indicate that the FDBN with the hybrid learning approach can handle high-dimensional raw images directly. It inherits the fine nature of the FRBM and outperforms some state-of-the-art discriminative models in classification accuracy. Moreover, it shows better capability of robustness than a deep belief net when encountering noisy data. |
Keyword | Classification Fuzzy Deep Model Fuzzy Restricted Boltzmann Machine (Frbm) Hybrid Learning |
DOI | 10.1109/TFUZZ.2019.2902111 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
WOS ID | WOS:000545205300014 |
Scopus ID | 2-s2.0-85085662756 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Corresponding Author | Philip Chen, C. L. |
Affiliation | 1.School of Applied Mathematics, Beijing Normal University, Zhuhai, 519087, China 2.Faculty of Science and Technology, University of Macau, 999078, Macao 3.Dalian Maritime Univ, Dept Nav, Dalian 116026, Peoples R China 4.School of Mathematics and Computer Science, Fuzhou University, Fuzhou, China |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Feng, Shuang,Philip Chen, C. L.,Zhang, Chun Yang. A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification[J]. IEEE Transactions on Fuzzy Systems, 2020, 28(7), 1344-1355. |
APA | Feng, Shuang., Philip Chen, C. L.., & Zhang, Chun Yang (2020). A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification. IEEE Transactions on Fuzzy Systems, 28(7), 1344-1355. |
MLA | Feng, Shuang,et al."A Fuzzy Deep Model Based on Fuzzy Restricted Boltzmann Machines for High-Dimensional Data Classification".IEEE Transactions on Fuzzy Systems 28.7(2020):1344-1355. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment