Research Repository

Creating language resources for under-resourced languages: methodologies, and experiments with Arabic

El-Haj, M and Kruschwitz, U and Fox, C (2015) 'Creating language resources for under-resourced languages: methodologies, and experiments with Arabic.' Language Resources and Evaluation, 49 (3). 549 - 580. ISSN 1574-020X

[img]
Preview
Text
ELHAJ_LREV.pdf - Draft Version

Download (1MB) | Preview

Abstract

© 2014, Springer Science+Business Media Dordrecht. Language resources are important for those working on computational methods to analyse and study languages. These resources are needed to help advancing the research in fields such as natural language processing, machine learning, information retrieval and text analysis in general. We describe the creation of useful resources for languages that currently lack them, taking resources for Arabic summarisation as a case study. We illustrate three different paradigms for creating language resources, namely: (1) using crowdsourcing to produce a small resource rapidly and relatively cheaply; (2) translating an existing gold-standard dataset, which is relatively easy but potentially of lower quality; and (3) using manual effort with appropriately skilled human participants to create a resource that is more expensive but of high quality. The last of these was used as a test collection for TAC-2011. An evaluation of the resources is also presented.

Item Type: Article
Subjects: P Language and Literature > P Philology. Linguistics
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Jim Jamieson
Date Deposited: 03 Dec 2014 10:31
Last Modified: 23 Jan 2019 01:15
URI: http://repository.essex.ac.uk/id/eprint/11956

Actions (login required)

View Item View Item