Residential College | false |
Status | 已發表Published |
Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling | |
Bin Zou1; Luoqing Li1; Zongben Xu2; Tao Luo2; Yuan Yan Tang3 | |
2013-02 | |
Source Publication | IEEE Transactions on Neural Networks and Learning Systems |
ISSN | 2162-237X |
Volume | 24Issue:2Pages:288-300 |
Abstract | Fisher linear discriminant (FLD) is a well-known method for dimensionality reduction and classification that projects high-dimensional data onto a low-dimensional space where the data achieves maximum class separability. The previous works describing the generalization ability of FLD have usually been based on the assumption of independent and identically distributed (i.i.d.) samples. In this paper, we go far beyond this classical framework by studying the generalization ability of FLD based on Markov sampling. We first establish the bounds on the generalization performance of FLD based on uniformly ergodic Markov chain (u.e.M.c.) samples, and prove that FLD based on u.e.M.c. samples is consistent. By following the enlightening idea from Markov chain Monto Carlo methods, we also introduce a Markov sampling algorithm for FLD to generate u.e.M.c. samples from a given data of finite size. Through simulation studies and numerical studies on benchmark repository using FLD, we find that FLD based on u.e.M.c. samples generated by Markov sampling can provide smaller misclassification rates compared to i.i.d. samples. |
Keyword | Fisher Linear Discriminant (Fld) Generalization Performance Markov Sampling Uniformly Ergodic Markov Chain |
DOI | 10.1109/TNNLS.2012.2230406 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Engineering |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic |
WOS ID | WOS:000313715000009 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141 USA |
Scopus ID | 2-s2.0-84894071719 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | University of Macau |
Corresponding Author | Bin Zou; Luoqing Li; Zongben Xu; Tao Luo; Yuan Yan Tang |
Affiliation | 1.Faculty of Mathematics and Computer Science, Hubei University, Wuhan 430062, China 2.Institute for Information and System Science, Xi’an Jiaotong University, Xi’an 710049, China 3.Faculty of Science and Technology, University of Macau, Macau 999078, China |
Corresponding Author Affilication | Faculty of Science and Technology |
Recommended Citation GB/T 7714 | Bin Zou,Luoqing Li,Zongben Xu,et al. Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling[J]. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(2), 288-300. |
APA | Bin Zou., Luoqing Li., Zongben Xu., Tao Luo., & Yuan Yan Tang (2013). Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling. IEEE Transactions on Neural Networks and Learning Systems, 24(2), 288-300. |
MLA | Bin Zou,et al."Generalization Performance of Fisher Linear Discriminant Based on Markov Sampling".IEEE Transactions on Neural Networks and Learning Systems 24.2(2013):288-300. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment