Residential College | false |
Status | 已發表Published |
Optimize real-valued RBM with Bidirectional Autoencoder | |
Feng Q.; Chen L.; Chen C.L.P. | |
2016-01-25 | |
Conference Name | International Conference on Fuzzy Theory and Its Applications (IFUZZY) |
Source Publication | iFUZZY 2015 - 2015 International Conference on Fuzzy Theory and Its Applications, Conference Digest |
Pages | 22-27 |
Conference Date | NOV 18-20, 2015 |
Conference Place | Yilan, TAIWAN |
Abstract | Deep learning increasingly attracted attention after the fast training method of Restricted Boltzmann Machine(RBM) isproposed[1]. Many researches directly constructed deep architecture with stack RBMs to learn the representation of the data, few studied the optimization method to get good RBM parameters. Here proposes a new optimization method for real-valued RBM by minimizing the reconstructed error. Firstly, build and initialize Bidirectional Autoencoder(Bi-Ae). Secondly, minimize the cost function with Stochastic Gradient Descent (SGD) to get the parameters. Thirdly, convert the Bi-AE into RBM with the most suitable parameters. Experiments are executed on the MNIST dataset. Compared with PSO and likelihood maximum optimization methods, the reconstructed errors of the proposed method is 4.02% smaller than the result from error[1], which is advanced. |
Keyword | Back Propagation Bidirectional Autoencoder Rbm Optimization Sgd |
DOI | 10.1109/iFUZZY.2015.7391888 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS ID | WOS:000380618900005 |
Scopus ID | 2-s2.0-84966638792 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE |
Affiliation | Universidade de Macau |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Feng Q.,Chen L.,Chen C.L.P.. Optimize real-valued RBM with Bidirectional Autoencoder[C], 2016, 22-27. |
APA | Feng Q.., Chen L.., & Chen C.L.P. (2016). Optimize real-valued RBM with Bidirectional Autoencoder. iFUZZY 2015 - 2015 International Conference on Fuzzy Theory and Its Applications, Conference Digest, 22-27. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment