iSentenizer-$\mu$: Multilingual Sentence Boundary Detection Model

UM > Faculty of Science and Technology > DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE

Status	已發表Published
	iSentenizer-$\mu$: Multilingual Sentence Boundary Detection Model
	Wong, D. F.; Chao, L. S.; Zeng, X.
	2014-11-01
Source Publication	The Scientific World Journal
ISSN	1537744X
Pages	1-10 (SCI: Q2, IF: 1.219)
Abstract	Sentence boundary detection (SBD) system is normally quite sensitive to genres of data that the system is trained on. The genres of data are often referred to the shifts of text topics and new language domains. Although new detection models can be retrained for different languages or new text genres, previous model has to be thrown away and the creation process has to be restarted from scratch. In this paper, we present a multilingual sentence boundary detection system (iSentenizer-𝜇) for Danish, German, English, Spanish, Dutch, French, Italian, Portuguese, Greek, Finnish, and Swedish languages.The proposed system is able to detect the sentence boundaries of a mixture of different text genres and languages with high accuracy.We employ i+Learning algorithm, an incremental tree learning architecture, for constructing the system. iSentenizer-𝜇, under the incremental learning framework, is adaptable to text of different topics and Roman-alphabet languages, by merging new data into existing model to learn the new knowledge incrementally by revision instead of retraining. The system has been extensively evaluated on different languages and text genres and has been compared against two state-of-the-art SBD systems, Punkt and MaxEnt. The experimental results show that the proposed system outperforms the other systems on all datasets.
Keyword	Sentence boundary detection sentenizer multi-language sentence tokenization
Language	英語English
The Source to Article	PB_Publication
PUB ID	12104
Document Type	Journal article
Collection	DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
Corresponding Author	Wong, D. F.
Recommended Citation GB/T 7714	Wong, D. F.,Chao, L. S.,Zeng, X.. iSentenizer-$\mu$: Multilingual Sentence Boundary Detection Model[J]. The Scientific World Journal, 2014, 1-10 (SCI: Q2, IF: 1.219).
APA	Wong, D. F.., Chao, L. S.., & Zeng, X. (2014). iSentenizer-$\mu$: Multilingual Sentence Boundary Detection Model. The Scientific World Journal, 1-10 (SCI: Q2, IF: 1.219).
MLA	Wong, D. F.,et al."iSentenizer-$\mu$: Multilingual Sentence Boundary Detection Model".The Scientific World Journal (2014):1-10 (SCI: Q2, IF: 1.219).

Files in This Item:
There are no files associated with this item.

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Affiliation No.
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh