OLAC Record
oai:lindat.mff.cuni.cz:11234/1-1933

Metadata
Title:Czech Grammar Agreement Dataset for Evaluation of Language Models
Bibliographic Citation:http://hdl.handle.net/11234/1-1933
Creator:Baisa, Vít
Date (W3CDTF):2017-01-10T19:42:18Z
Date Available:2017-01-10T19:42:18Z
Description:AGREE is a dataset and task for evaluation of language models based on grammar agreement in Czech. The dataset consists of sentences with marked suffixes of past tense verbs. The task is to choose the right verb suffix which depends on gender, number and animacy of subject. It is challenging for language models because 1) Czech is morphologically rich, 2) it has relatively free word order, 3) high out-of-vocabulary (OOV) ratio, 4) predicate and subject can be far from each other, 5) subjects can be unexpressed and 6) various semantic rules may apply. The task provides a straightforward and easily reproducible way of evaluating language models on a morphologically rich language.
Identifier (URI):http://hdl.handle.net/11234/1-1933
Language:Czech
Language (ISO639):ces
Publisher:Masaryk University, NLP Centre
Rights:Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
http://creativecommons.org/licenses/by-sa/4.0/
Subject:agreement
past tense verb suffix
language model
training data
Type:corpus
Type (DCMI):Text
Type (OLAC):primary_text

OLAC Info

Archive:  LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University
Description:  http://www.language-archives.org/archive/lindat.mff.cuni.cz
GetRecord:  OAI-PMH request for OLAC format
GetRecord:  Pre-generated XML file

OAI Info

OaiIdentifier:  oai:lindat.mff.cuni.cz:11234/1-1933
DateStamp:  2021-06-29
GetRecord:  OAI-PMH request for simple DC format

Search Info

Citation: Baisa, Vít. 2017. Masaryk University, NLP Centre.
Terms: area_Europe country_CZ dcmi_Text iso639_ces olac_primary_text


http://www.language-archives.org/item.php/oai:lindat.mff.cuni.cz:11234/1-1933
Up-to-date as of: Thu Oct 5 0:40:33 EDT 2023