Research Repository

Context-aware learning for finite mixture models

Perdikis, Serafeim and Leeb, Robert and Chavarriaga, Ricardo and Millán, José del R (2015) Context-aware learning for finite mixture models. Working Paper. Arxiv. (Unpublished)


Download (2MB) | Preview


This work introduces algorithms able to exploit contextual information in order to improve maximum-likelihood (ML) parameter estimation in finite mixture models (FMM), demonstrating their benefits and properties in several scenarios. The proposed algorithms are derived in a probabilistic framework with regard to situations where the regular FMM graphs can be extended with context-related variables, respecting the standard expectation-maximization (EM) methodology and, thus, rendering explicit supervision completely redundant. We show that, by direct application of the missing information principle, the compared algorithms' learning behaviour operates between the extremities of supervised and unsupervised learning, proportionally to the information content of contextual assistance. Our simulation results demonstrate the superiority of context-aware FMM training as compared to conventional unsupervised training in terms of estimation precision, standard errors, convergence rates and classification accuracy or regression fitness in various scenarios, while also highlighting important differences among the outlined situations. Finally, the improved classification outcome of contextually enhanced FMMs is showcased in a brain-computer interface application scenario.

Item Type: Monograph (Working Paper)
Uncontrolled Keywords: stat.ML, stat.ML
Divisions: Faculty of Science and Health > Computer Science and Electronic Engineering, School of
Depositing User: Elements
Date Deposited: 13 Aug 2019 12:24
Last Modified: 13 Aug 2019 13:15

Actions (login required)

View Item View Item