Research Repository

The 2021 ImageCLEF Benchmark: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications

Ionescu, Bogdan and Müller, Henning and Péteri, Renaud and Ben Abacha, Asma and Demner-Fushman, Dina and Hasan, Sadid A and Sarrouti, Mourad and Pelka, Obioma and Friedrich, Christoph and Garcia Seco De Herrera, Alba and Jacutprakart, Janadhip and Kovalev, Vassili and Kozlovski, Serge and Liauchuk, Vitali and Dicente Cid, Yashin and Chamberlain, Jon and Clark, Adrian and Campello, Antonio and Moustahfid, Hassan and Oliver, Thomas and Schulz, Abigail and Brie, Paul and Berari, Raul and Fichou, Dimitri and Tautenau, Andrei and Dogariu, Mihai and Stefan, Liviu Daniel and Constantin, Mihai Gabriel and Deshayes, Jerome and Popescu, Adrian (2021) The 2021 ImageCLEF Benchmark: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications. In: 43rd European Conference on Information Retrieval (ECIR 2021), 2021-03-28 - 2021-04-01, Lucca, Italy.

ECIR_2021_ImageCLEF.pdf - Accepted Version

Download (4MB) | Preview


This paper presents the ideas for the 2021 ImageCLEF lab that will be organized as part of the Conference and Labs of the Evaluation Forum — CLEF Labs 2021 in Bucharest, Romania. ImageCLEF is an ongoing evaluation initiative (active since 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and domains. In 2021, the 19th edition of ImageCLEF will organize four main tasks: (i) a Medical task addressing visual question answering, a concept annotation and a tuberculosis classification task, (ii) a Coral task addressing the annotation and localisation of substrates in coral reef images, (iii) a DrawnUI task addressing the creation of websites from either a drawing or a screenshot by detecting the different elements present on the design and a new (iv) Aware task addressing the prediction of real-life consequences of online photo sharing. The strong participation in 2020, despite the COVID pandemic, with over 115 research groups registering and 40 submitting over 295 runs for the tasks shows an important interest in this benchmarking campaign. We expect the new tasks to attract at least as many researchers for 2021.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published proceedings: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 02 Feb 2022 14:50
Last Modified: 23 Sep 2022 19:44

Actions (login required)

View Item View Item