Research Repository

Creating language resources for under-resourced languages: methodologies, and experiments with Arabic

El-Haj, Mahmoud and Kruschwitz, Udo and Fox, Chris (2015) 'Creating language resources for under-resourced languages: methodologies, and experiments with Arabic.' Language Resources and Evaluation, 49 (3). 549 - 580. ISSN 1574-020X

ELHAJ_LREV.pdf - Accepted Version

Download (1MB) | Preview


Language resources are important for those working on computational methods to analyse and study languages. These resources are needed to help advancing the research in fields such as natural language processing, machine learning, information retrieval and text analysis in general. We describe the creation of useful resources for languages that currently lack them, taking resources for Arabic summarisation as a case study. We illustrate three different paradigms for creating language resources, namely: (1) using crowdsourcing to produce a small resource rapidly and relatively cheaply; (2) translating an existing gold-standard dataset, which is relatively easy but potentially of lower quality; and (3) using manual effort with appropriately skilled human participants to create a resource that is more expensive but of high quality. The last of these was used as a test collection for TAC-2011. An evaluation of the resources is also presented.

Item Type: Article
Uncontrolled Keywords: Resources, Summarisation, Arabic, Under-resourced languages
Subjects: P Language and Literature > P Philology. Linguistics
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Jim Jamieson
Date Deposited: 03 Dec 2014 10:31
Last Modified: 10 Jun 2020 17:15

Actions (login required)

View Item View Item