Residential Collegefalse
Status已發表Published
I sentenizer-: Multilingual sentence boundary detection model
Wong D.F.; Chao L.S.; Zeng X.
2014
Source PublicationThe Scientific World Journal
ISSN1537744X
Volume2014
Abstract

Sentence boundary detection (SBD) system is normally quite sensitive to genres of data that the system is trained on. The genres of data are often referred to the shifts of text topics and new languages domains. Although new detection models can be retrained for different languages or new text genres, previous model has to be thrown away and the creation process has to be restarted from scratch. In this paper, we present a multilingual sentence boundary detection system (iSentenizer-) for Danish, German, English, Spanish, Dutch, French, Italian, Portuguese, Greek, Finnish, and Swedish languages. The proposed system is able to detect the sentence boundaries of a mixture of different text genres and languages with high accuracy. We employ i Learning algorithm, an incremental tree learning architecture, for constructing the system. iSentenizer-, under the incremental learning framework, is adaptable to text of different topics and Roman-alphabet languages, by merging new data into existing model to learn the new knowledge incrementally by revision instead of retraining. The system has been extensively evaluated on different languages and text genres and has been compared against two state-of-the-art SBD systems, Punkt and MaxEnt. The experimental results show that the proposed system outperforms the other systems on all datasets. © 2014 Derek F. Wong et al.

DOI10.1155/2014/196574
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaScience & Technology - Other Topics
WOS SubjectMultidisciplinary Sciences
WOS IDWOS:000335039800001
Scopus ID2-s2.0-84900037461
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
AffiliationUniversidade de Macau
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Wong D.F.,Chao L.S.,Zeng X.. I sentenizer-: Multilingual sentence boundary detection model[J]. The Scientific World Journal, 2014, 2014.
APA Wong D.F.., Chao L.S.., & Zeng X. (2014). I sentenizer-: Multilingual sentence boundary detection model. The Scientific World Journal, 2014.
MLA Wong D.F.,et al."I sentenizer-: Multilingual sentence boundary detection model".The Scientific World Journal 2014(2014).
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wong D.F.]'s Articles
[Chao L.S.]'s Articles
[Zeng X.]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wong D.F.]'s Articles
[Chao L.S.]'s Articles
[Zeng X.]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wong D.F.]'s Articles
[Chao L.S.]'s Articles
[Zeng X.]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.