Skip to content

Publications

Detail of publication

Citation

Skorkovská, L. : Application of Lemmatization and Summarization Methods in Topic Identification Module for Large Scale Language Modeling Data Filtering . Text, Speech and Dialogue, Lecture Notes in Computer Science, vol. 7499, p. 191-198, Springer, Heidelberg, 2012.

Download PDF

PDF

Additional information


Springerlink

Abstract

The paper presents experiments with the topic identification module which is a part of a complex system for acquisition and storing large volumes of text data. The topic identification module processes each acquired data item and assigns it topics from a defined topic hierarchy. The topic hierarchy is quite extensive – it contains about 450 topics and topic categories. It can easily happen that for some narrowly focused topic there is not enough data for the topic identification training. Lemmatization is shown to improve the results when dealing with sparse data in the area of information retrieval, therefore the effects of lemmatization on topic identification results is studied in the paper. On the other hand, since the system is used for processing large amounts of data, a summarization method was implemented and the effect of using only the summary of an article on the topic identification accuracy is studied.

Detail of publication

Title: Application of Lemmatization and Summarization Methods in Topic Identification Module for Large Scale Language Modeling Data Filtering
Author: Skorkovská, L.
Language: English
Date of publication: 3 Sep 2012
Year: 2012
Type of publication: Papers in journals
Title of journal or book: Text, Speech and Dialogue
Series: Lecture Notes in Computer Science
Číslo vydání: 7499
Page: 191 - 198
DOI: 10.1007/978-3-642-32790-2_23
ISBN: 978-3-642-32789-6
ISSN: 0302-9743
Publisher: Springer
Address: Heidelberg
Date: 3 Sep 2012 - 7 Sep 2012
/ 2013-09-10 15:01:40 /

Keywords

topic identification, lemmatization, summarization, language modeling

BibTeX

@ARTICLE{SkorkovskaL_2012_Applicationof,
 author = {Skorkovsk\'{a}, L.},
 title = {Application of Lemmatization and Summarization Methods in Topic Identification Module for Large Scale Language Modeling Data Filtering},
 year = {2012},
 publisher = {Springer},
 journal = {Text, Speech and Dialogue},
 address = {Heidelberg},
 volume = {7499},
 pages = {191-198},
 series = {Lecture Notes in Computer Science},
 ISBN = {978-3-642-32789-6},
 ISSN = {0302-9743},
 doi = {10.1007/978-3-642-32790-2_23},
 url = {http://www.kky.zcu.cz/en/publications/SkorkovskaL_2012_Applicationof},
}