Normal view MARC view ISBD view

The slWaC Corpus of the Slovene Web / Tomaž Erjavec ; Nikola Ljubešić ; Nataša Logar.

By: Erjavec, Tomaž.
Contributor(s): Ljubešić, Nikola, informatičar [aut] | Logar, Nataša [aut].
Material type: ArticleArticlePublisher: 2015Description: 35-42 str.Other title: The slWaC Corpus of the Slovene Web [Naslov na engleskom:].Subject(s): jezične tehnologije | 5.04 | language technologies; corpus linguistics; World Wide Web; Slovene language | language technologies; corpus linguistics; World Wide Web; Slovene languageOnline resources: Elektronička verzija In: Informatica (Ljubljana) 39 (2015), 1 ; str. 35-42Summary: The availability of large collections of text (language corpora) is crucial for empirically supported linguis- tic investigations of various languages ; however, such corpora are complicated and expensive to collect. In recent years corpora made from texts on the World Wide Web have become an attractive alternative to traditional corpora, as they can be made automatically, contain varied text types of contemporary lan- guage, and are quite large. The paper describes version 2 of slWaC, a Web corpus of Slovene containing 1.2 billion tokens. The corpus extends the first version of slWaC with new materials and updates the corpus compilation pipeline. The paper describes the process of corpus compilation with a focus on near-duplicate removal, presents the linguistic annotation, format and accessibility of the corpus via Web concordancers. It then investigates the content of the corpus using the method of frequency profiling, by comparing its lemma and part-of-speech annotations with three corpora: the first version of slWaC, with Gigafida, the one billion word reference corpus of Slovene, and KRES, the hundred million word reference balanced corpus of Slovene.
Tags from this library: No tags from this library for this title. Log in to add tags.
No physical items for this record

The availability of large collections of text (language corpora) is crucial for empirically supported linguis- tic investigations of various languages ; however, such corpora are complicated and expensive to collect. In recent years corpora made from texts on the World Wide Web have become an attractive alternative to traditional corpora, as they can be made automatically, contain varied text types of contemporary lan- guage, and are quite large. The paper describes version 2 of slWaC, a Web corpus of Slovene containing 1.2 billion tokens. The corpus extends the first version of slWaC with new materials and updates the corpus compilation pipeline. The paper describes the process of corpus compilation with a focus on near-duplicate removal, presents the linguistic annotation, format and accessibility of the corpus via Web concordancers. It then investigates the content of the corpus using the method of frequency profiling, by comparing its lemma and part-of-speech annotations with three corpora: the first version of slWaC, with Gigafida, the one billion word reference corpus of Slovene, and KRES, the hundred million word reference balanced corpus of Slovene.

Projekt MZOS projekt

ENG

There are no comments for this item.

Log in to your account to post a comment.

Powered by Koha

//