León, Javier and Escobar, Juan José and Ortiz, Andrés and Ortega, Julio and González, Jesús and Martín-Smith, Pedro and Gan, John Q and Damas, Miguel (2020) Deep learning for EEG-based Motor Imagery classification: Accuracy-cost trade-off. PLoS One, 15 (6). e0234178-e0234178. DOI https://doi.org/10.1371/journal.pone.0234178
León, Javier and Escobar, Juan José and Ortiz, Andrés and Ortega, Julio and González, Jesús and Martín-Smith, Pedro and Gan, John Q and Damas, Miguel (2020) Deep learning for EEG-based Motor Imagery classification: Accuracy-cost trade-off. PLoS One, 15 (6). e0234178-e0234178. DOI https://doi.org/10.1371/journal.pone.0234178
León, Javier and Escobar, Juan José and Ortiz, Andrés and Ortega, Julio and González, Jesús and Martín-Smith, Pedro and Gan, John Q and Damas, Miguel (2020) Deep learning for EEG-based Motor Imagery classification: Accuracy-cost trade-off. PLoS One, 15 (6). e0234178-e0234178. DOI https://doi.org/10.1371/journal.pone.0234178
Abstract
Electroencephalography (EEG) datasets are often small and high dimensional, owing to cumbersome recording processes. In these conditions, powerful machine learning techniques are essential to deal with the large amount of information and overcome the curse of dimensionality. Artificial Neural Networks (ANNs) have achieved promising performance in EEG-based Brain-Computer Interface (BCI) applications, but they involve computationally intensive training algorithms and hyperparameter optimization methods. Thus, an awareness of the quality-cost trade-off, although usually overlooked, is highly beneficial. In this paper, we apply a hyperparameter optimization procedure based on Genetic Algorithms to Convolutional Neural Networks (CNNs), Feed-Forward Neural Networks (FFNNs), and Recurrent Neural Networks (RNNs), all of them purposely shallow. We compare their relative quality and energy-time cost, but we also analyze the variability in the structural complexity of networks of the same type with similar accuracies. The experimental results show that the optimization procedure improves accuracy in all models, and that CNN models with only one hidden convolutional layer can equal or slightly outperform a 6-layer Deep Belief Network. FFNN and RNN were not able to reach the same quality, although the cost was significantly lower. The results also highlight the fact that size within the same type of network is not necessarily correlated with accuracy, as smaller models can and do match, or even surpass, bigger ones in performance. In this regard, overfitting is likely a contributing factor since deep learning approaches struggle with limited training examples.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Humans; Electroencephalography; Motor Activity; Signal Processing, Computer-Assisted; Adult; Middle Aged; Female; Male; Young Adult; Brain-Computer Interfaces; Deep Learning; Imagery, Psychotherapy |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 17 Jun 2020 13:25 |
Last Modified: | 30 Oct 2024 17:29 |
URI: | http://repository.essex.ac.uk/id/eprint/27890 |
Available files
Filename: PLOS_ONE_2020.pdf
Licence: Creative Commons: Attribution 3.0