Ljubešić, Nikola, informatičar

Bilingual lexicon extraction from comparable corpora: a comparative study / Ljubešić, Nikola ; Fišer, Darja ; Vintar, Špela ; Pollak, Senja. - str.

This paper presents a comparative study of the impact of the key parameters for bilingual lexicon extraction for nouns from comparable corpora. The parameters we analyzed are: corpus size and comparability, dictionary size and type, feature selection for context vectors and window size, and association and similarity measures. Evaluation against the gold standard shows that window size of 7 with encoded position yields best results. The consistently best-performing association and similarity measures are Jensen-Shannon divergence with log-likelihood. We have shown that very good results can be achieved with small-sized but purpose-built seed lexicons and that problems arising from dissimilarities between the source and the target corpus can be compensated with their sufficient size.


Fišer, Darja ; Vintar, Špela ; Pollak, Senja ;

Powered by Koha