Kalliatakis, Grigorios and Ehsan, Shoaib and Leonardis, Ales and Fasli, Maria and McDonald-Maier, Klaus D (2019) Exploring Object-Centric and Scene-Centric CNN Features and their Complementarity for Human Rights Violations Recognition in Images. IEEE Access, 7. pp. 10045-10056. DOI https://doi.org/10.1109/access.2019.2891745
Kalliatakis, Grigorios and Ehsan, Shoaib and Leonardis, Ales and Fasli, Maria and McDonald-Maier, Klaus D (2019) Exploring Object-Centric and Scene-Centric CNN Features and their Complementarity for Human Rights Violations Recognition in Images. IEEE Access, 7. pp. 10045-10056. DOI https://doi.org/10.1109/access.2019.2891745
Kalliatakis, Grigorios and Ehsan, Shoaib and Leonardis, Ales and Fasli, Maria and McDonald-Maier, Klaus D (2019) Exploring Object-Centric and Scene-Centric CNN Features and their Complementarity for Human Rights Violations Recognition in Images. IEEE Access, 7. pp. 10045-10056. DOI https://doi.org/10.1109/access.2019.2891745
Abstract
Identifying potential abuses of human rights through imagery is a novel and challenging task in the field of computer vision, that will enable to expose human rights violations over large-scale data that may otherwise be impossible. While standard databases for object and scene categorisation contain hundreds of different classes, the largest available dataset of human rights violations contains only 4 classes. Here, we introduce the ‘Human Rights Archive Database’ (HRA), a verified-by-experts repository of 3050 human rights violations photographs, labelled with human rights semantic categories, comprising a list of the types of human rights abuses encountered at present. With the HRA dataset and a two-phase transfer learning scheme, we fine-tuned the state-of-the-art deep convolutional neural networks (CNNs) to provide human rights violations classification CNNs (HRA-CNNs). We also present extensive experiments refined to evaluate how well object-centric and scene-centric CNN features can be combined for the task of recognising human rights abuses. With this, we show that HRA database poses a challenge at a higher level for the well studied representation learning methods, and provide a benchmark in the task of human rights violations recognition in visual context. We expect this dataset can help to open up new horizons on creating systems able of recognising rich information about human rights violations.
Item Type: | Article |
---|---|
Additional Information: | 19 pages, 13 figures; Submitted to PLOS ONE |
Uncontrolled Keywords: | Computer Vision , Image Interpretation , Visual Recognition , Convolutional Neural Networks , Human Rights Abuses Recognition |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 11 Jan 2019 16:44 |
Last Modified: | 30 Oct 2024 20:45 |
URI: | http://repository.essex.ac.uk/id/eprint/23790 |
Available files
Filename: 08606079.pdf
Licence: Creative Commons: Attribution 3.0