Residential College | false |
Status | 已發表Published |
Fuzzy restricted boltzmann machine and deep belief network: A comparison on image reconstruction | |
Shuang F.2; Chen C.L.P.2 | |
2017-11-27 | |
Conference Name | IEEE International Conference on Systems, Man, and Cybernetics (SMC) |
Source Publication | 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 |
Volume | 2017-January |
Pages | 1828-1833 |
Conference Date | OCT 05-08, 2017 |
Conference Place | Banff, CANADA |
Abstract | The fuzzy restricted Boltzmann machine (FRBM) is demonstrated to have better generative and discriminative capabilities than traditional RBM. We now further investigate and compare the generative ability of DBN with FRBM on image reconstruction. The DBN is pre-trained by stacking RBMs layer by layer and then fine-tuned by the wake-sleep algorithm. Then the FRBM, RBM and DBN are compared in detail under different conditions on the MNIST and Extended Yale B data sets. The experiment results again indicate that the FRBM outperforms RBM: it can achieve smaller average reconstruction errors (AREs) given the same number of hidden units and learning time. When compared to DBNs, the FRBM can achieve smaller AREs in less learning time than the two-layer DBN with equal hidden size. Moreover, when we increase the training epochs, the FRBM shows a better ARE and a slight increase of (or still less) learning time than corresponding two-layer and threelayer DBNs with double number of hidden units. Hence we make a preliminary conclusion that the FRBM with m hidden units possesses the close generative capability to DBN with 2m hidden units in reconstructing images. |
Keyword | Dbn Frbm Generative Image Reconstruction |
DOI | 10.1109/SMC.2017.8122882 |
URL | View the original |
Language | 英語English |
WOS ID | WOS:000427598701147 |
Scopus ID | 2-s2.0-85044173919 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | University of Macau |
Affiliation | 1.Beijing Normal University 2.Universidade de Macau |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Shuang F.,Chen C.L.P.. Fuzzy restricted boltzmann machine and deep belief network: A comparison on image reconstruction[C], 2017, 1828-1833. |
APA | Shuang F.., & Chen C.L.P. (2017). Fuzzy restricted boltzmann machine and deep belief network: A comparison on image reconstruction. 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017, 2017-January, 1828-1833. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment