Research Repository

Overview of ImageCLEF 2018: Challenges, Datasets and Evaluation

Ionescu, Bogdan and Müller, Henning and Villegas, Mauricio and Garcia Seco De Herrera, Alba and Eickhoff, Carsten and Andrearczyk, Vincent and Dicente Cid, Yashin and Liauchuk, Vitali and Kovalev, Vassili and Hasan, Sadid A and Ling, Yuan and Farri, Oladimeji and Liu, Joey and Lungren, Matthew and Dang-Nguyen, Duc-Tien and Piras, Luca and Riegler, Michael and Zhou, Liting and Lux, Mathias and Gurrin, Cathal (2018) Overview of ImageCLEF 2018: Challenges, Datasets and Evaluation. In: 9th International Conference of the CLEF Association, CLEF 2018, 2018-09-10 - 2018-09-14, Avignon, France.

paper_188(1).pdf - Accepted Version

Download (388kB) | Preview


This paper presents an overview of the ImageCLEF 2018 evaluation campaign, an event that was organized as part of the CLEF (Conference and Labs of the Evaluation Forum) Labs 2018. ImageCLEF is an ongoing initiative (it started in 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval with the aim of providing information access to collections of images in various usage scenarios and domains. In 2018, the 16th edition of ImageCLEF ran three main tasks and a pilot task: (1) a caption prediction task that aims at predicting the caption of a figure from the biomedical literature based only on the figure image; (2) a tuberculosis task that aims at detecting the tuberculosis type, severity and drug resistance from CT (Computed Tomography) volumes of the lung; (3) a LifeLog task (videos, images and other sources) about daily activities understanding and moment retrieval, and (4) a pilot task on visual question answering where systems are tasked with answering medical questions. The strong participation, with over 100 research groups registering and 31 submitting results for the tasks, shows an increasing interest in this benchmarking campaign.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published proceedings: Experimental IR Meets Multilinguality, Multimodality, and Interaction 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018, Proceedings. Part of the Lecture Notes in Computer Science book series (LNCS, volume 11018)
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 22 Jan 2020 15:16
Last Modified: 23 Sep 2022 19:28

Actions (login required)

View Item View Item