Residential College | false |
Status | 已發表Published |
SVM-Boosting based on Markov resampling: Theory and algorithm | |
Jiang, Hongwei1; Zou, Bin1; Xu, Chen2; Xu, Jie3; Tang, Yuan Yan4 | |
2020-11-01 | |
Source Publication | NEURAL NETWORKS |
ISSN | 0893-6080 |
Volume | 131Pages:276-290 |
Abstract | In this article we introduce the idea of Markov resampling for Boosting methods. We first prove that Boosting algorithm with general convex loss function based on uniformly ergodic Markov chain (u.e.M.c.) examples is consistent and establish its fast convergence rate. We apply Boosting algorithm based on Markov resampling to Support Vector Machine (SVM), and introduce two new resampling-based Boosting algorithms: SVM-Boosting based on Markov resampling (SVM-BM) and improved SVM-Boosting based on Markov resampling (ISVM-BM). In contrast with SVM-BM, ISVM-BM uses the support vectors to calculate the weights of base classifiers. The numerical studies based on benchmark datasets show that the proposed two resampling-based SVM Boosting algorithms for linear base classifiers have smaller misclassification rates, less total time of sampling and training compared to three classical AdaBoost algorithms: Gentle AdaBoost, Real AdaBoost, Modest AdaBoost. In addition, we compare the proposed SVM-BM algorithm with the widely used and efficient gradient Boosting algorithm-XGBoost (eXtreme Gradient Boosting), SVM-AdaBoost and present some useful discussions on the technical parameters. |
Keyword | Boosting Consistency Resampling Uniformly Ergodic Markov Chain (U.e.m.c.) |
DOI | 10.1016/j.neunet.2020.07.036 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Computer Science ; Neurosciences & Neurology |
WOS Subject | Computer Science, Artificial Intelligence ; Neurosciences |
WOS ID | WOS:000581746300022 |
Publisher | PERGAMON-ELSEVIER SCIENCE LTD, THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND |
Scopus ID | 2-s2.0-85089515916 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology |
Corresponding Author | Zou, Bin; Xu, Jie |
Affiliation | 1.Faculty of Mathematics and Statistics, Hubei Key Laboratory of Applied Mathematics, Hubei University, Wuhan, 430062, China 2.Department of Mathematics and Statistics, University of Ottawa, Ottawa, ON K1N 6N5, Canada 3.Faculty of Computer Science and Information Engineering, Hubei University, Wuhan, 430062, China 4.Faculty of Science and Technology, University of Macau, China |
Recommended Citation GB/T 7714 | Jiang, Hongwei,Zou, Bin,Xu, Chen,et al. SVM-Boosting based on Markov resampling: Theory and algorithm[J]. NEURAL NETWORKS, 2020, 131, 276-290. |
APA | Jiang, Hongwei., Zou, Bin., Xu, Chen., Xu, Jie., & Tang, Yuan Yan (2020). SVM-Boosting based on Markov resampling: Theory and algorithm. NEURAL NETWORKS, 131, 276-290. |
MLA | Jiang, Hongwei,et al."SVM-Boosting based on Markov resampling: Theory and algorithm".NEURAL NETWORKS 131(2020):276-290. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment