UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
SVM-Boosting based on Markov resampling: Theory and algorithm
Jiang, Hongwei1; Zou, Bin1; Xu, Chen2; Xu, Jie3; Tang, Yuan Yan4
2020-11-01
Source PublicationNEURAL NETWORKS
ISSN0893-6080
Volume131Pages:276-290
Abstract

In this article we introduce the idea of Markov resampling for Boosting methods. We first prove that Boosting algorithm with general convex loss function based on uniformly ergodic Markov chain (u.e.M.c.) examples is consistent and establish its fast convergence rate. We apply Boosting algorithm based on Markov resampling to Support Vector Machine (SVM), and introduce two new resampling-based Boosting algorithms: SVM-Boosting based on Markov resampling (SVM-BM) and improved SVM-Boosting based on Markov resampling (ISVM-BM). In contrast with SVM-BM, ISVM-BM uses the support vectors to calculate the weights of base classifiers. The numerical studies based on benchmark datasets show that the proposed two resampling-based SVM Boosting algorithms for linear base classifiers have smaller misclassification rates, less total time of sampling and training compared to three classical AdaBoost algorithms: Gentle AdaBoost, Real AdaBoost, Modest AdaBoost. In addition, we compare the proposed SVM-BM algorithm with the widely used and efficient gradient Boosting algorithm-XGBoost (eXtreme Gradient Boosting), SVM-AdaBoost and present some useful discussions on the technical parameters.

KeywordBoosting Consistency Resampling Uniformly Ergodic Markov Chain (U.e.m.c.)
DOI10.1016/j.neunet.2020.07.036
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science ; Neurosciences & Neurology
WOS SubjectComputer Science, Artificial Intelligence ; Neurosciences
WOS IDWOS:000581746300022
PublisherPERGAMON-ELSEVIER SCIENCE LTD, THE BOULEVARD, LANGFORD LANE, KIDLINGTON, OXFORD OX5 1GB, ENGLAND
Scopus ID2-s2.0-85089515916
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
Corresponding AuthorZou, Bin; Xu, Jie
Affiliation1.Faculty of Mathematics and Statistics, Hubei Key Laboratory of Applied Mathematics, Hubei University, Wuhan, 430062, China
2.Department of Mathematics and Statistics, University of Ottawa, Ottawa, ON K1N 6N5, Canada
3.Faculty of Computer Science and Information Engineering, Hubei University, Wuhan, 430062, China
4.Faculty of Science and Technology, University of Macau, China
Recommended Citation
GB/T 7714
Jiang, Hongwei,Zou, Bin,Xu, Chen,et al. SVM-Boosting based on Markov resampling: Theory and algorithm[J]. NEURAL NETWORKS, 2020, 131, 276-290.
APA Jiang, Hongwei., Zou, Bin., Xu, Chen., Xu, Jie., & Tang, Yuan Yan (2020). SVM-Boosting based on Markov resampling: Theory and algorithm. NEURAL NETWORKS, 131, 276-290.
MLA Jiang, Hongwei,et al."SVM-Boosting based on Markov resampling: Theory and algorithm".NEURAL NETWORKS 131(2020):276-290.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jiang, Hongwei]'s Articles
[Zou, Bin]'s Articles
[Xu, Chen]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jiang, Hongwei]'s Articles
[Zou, Bin]'s Articles
[Xu, Chen]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jiang, Hongwei]'s Articles
[Zou, Bin]'s Articles
[Xu, Chen]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.