Research Repository

Core clustering as a tool for tackling noise in cluster labels

Cordeiro de Amorim, Renato and Makarenkov, Vladimir and Mirkin, Boris (2019) 'Core clustering as a tool for tackling noise in cluster labels.' Journal of Classification. ISSN 0176-4268

[img]
Preview
Text
ImprovingUnrel_n.pdf - Accepted Version

Download (252kB) | Preview

Abstract

Real-world data sets often contain mislabelled entities. This can be particularly problematic if the data set is being used by a supervised classification algorithm at its learning phase. In this case the accuracy of this classification algorithm, when applied to unlabelled data, is likely to suffer considerably. In this paper we introduce a clustering-based method capable of reducing the number of mislabelled entities in data sets. Our method can be summarised as follows: (i) cluster the data set; (ii) select the entities that have the most potential to be assigned to correct clusters; (iii) use the entities of the previous step to define the core clusters and map them to the labels using a confusion matrix; (iv) use the core clusters and our cluster membership criterion to correct the labels of the remaining entities. We perform numerous experiments to validate our method empirically using k-nearest neighbour classifiers as a benchmark. We experiment with both synthetic and real-world data sets with different proportions of mislabelled entities. Our experiments demonstrate that the proposed method produces promising results. Thus, it could be used as a pre-processing data correction step of a supervised machine learning algorithm.

Item Type: Article
Uncontrolled Keywords: label noise, clustering, k-means, core clustering, Minkowski distance
Subjects: Q Science > QA Mathematics
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Elements
Date Deposited: 16 May 2019 10:00
Last Modified: 30 Mar 2020 01:00
URI: http://repository.essex.ac.uk/id/eprint/24422

Actions (login required)

View Item View Item