Jacutprakart, Janadhip and Andrade, Francisco Parrilla and Cuan, Rodolfo and Compean, Arely Aceves and Papanastasiou, Giorgos and Garcia Seco De Herrera, Alba (2021) NLIP-Essex-ITESM at ImageCLEFcaption 2021 task: Deep learning-based information retrieval and multi-label classification towards improving medical image understanding. In: CLEF 2021 Working Notes, 2021-09-21 - 2022-01-24, Bucharest, Romania.
Jacutprakart, Janadhip and Andrade, Francisco Parrilla and Cuan, Rodolfo and Compean, Arely Aceves and Papanastasiou, Giorgos and Garcia Seco De Herrera, Alba (2021) NLIP-Essex-ITESM at ImageCLEFcaption 2021 task: Deep learning-based information retrieval and multi-label classification towards improving medical image understanding. In: CLEF 2021 Working Notes, 2021-09-21 - 2022-01-24, Bucharest, Romania.
Jacutprakart, Janadhip and Andrade, Francisco Parrilla and Cuan, Rodolfo and Compean, Arely Aceves and Papanastasiou, Giorgos and Garcia Seco De Herrera, Alba (2021) NLIP-Essex-ITESM at ImageCLEFcaption 2021 task: Deep learning-based information retrieval and multi-label classification towards improving medical image understanding. In: CLEF 2021 Working Notes, 2021-09-21 - 2022-01-24, Bucharest, Romania.
Abstract
This work presents the NLIP-Essex-ITESM team's participation in the concept detection sub-task of the ImageCLEFcaption 2021 task. We developed a method to predict health outcomes from medical images by processing concepts from radiology reports and their associated medical images. Our aim is to improved medical image understanding and provide sophisticated tools to automate the thorough analysis of multi-modal medical images. In this paper, two deep learning- and k-NN-based methods of a) Information Retrieval and b) Multi-label Classification were developed and assessed. In addition, a Densenet-121 and an EfficientNet were used to train and extract imaging features. Our team achieved the second-highest score when the Information Retrieval method was used (F1-score bench-marking was 0.469). Further investigations are underway in the setting of improving health outcome predictions from multi-modal medical images. Code and pre-trained models are available at https://github.com/fjpa121197/ImageCLEF2021.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 27 Sep 2022 11:46 |
Last Modified: | 27 Sep 2022 11:48 |
URI: | http://repository.essex.ac.uk/id/eprint/32077 |
Available files
Filename: ImageCLEF_paper-103.pdf
Licence: Creative Commons: Attribution 3.0