Research Repository

Multi-Scale Learning for Multimodal Neurophysiological Signals: Gait Pattern Classification as An Example

Duan, Feng and Lv, Yizhi and Sun, Zhe and Li, Junhua (2022) 'Multi-Scale Learning for Multimodal Neurophysiological Signals: Gait Pattern Classification as An Example.' Neural Processing Letters, 54 (3). pp. 2455-2470. ISSN 1370-4621

[img] Text
2022_Journal_NPL.pdf - Accepted Version
Restricted to Repository staff only until 6 May 2023.

Download (986kB) | Request a copy


Neurophysiological signals are manifestations of the underlying brain activity, and they contain an abundance of neural information. The decoding and understanding of these signals is useful to develop robotic exoskeletons, benefitting device-aided motor rehabilitation. To this date, numerous efforts have been car- ried out to explore the relations between neurophysiological signals and locomotor capacity. Most of these studies focused on a single modality of neurophysiological signal and ignored its multiple modalities. In this study, the modalities from two kinds of biosensors were fused (electroencephalogram (EEG) and electromyogram (EMG)), and a novel deep learning model was proposed (multi-scale learning, MSL) to classify four walking patterns. The EEG and EMG data were collected during a walking experiment, where different walking conditions with and without exoskeleton-aided assistance were implemented (i.e. free-walking and exoskeleton- aided walking at zero, low, and high assistive forces). The performance achieved by the MSL model was compared to that of existing models, and the results show that multimodal MSL achieved the highest performance in terms of clas- sification accuracy (89.33%). Moreover, the comparisons in our study show that an improved classification performance was obtained when a full 62-channel EEG setting was used compared to using a subset of 20 channels located on the senso- rimotor region. This work contributes to the improvement of neurophysiological signal decoding and promotes the development of rehabilitation technologies as well as exoskeleton-aided applications.

Item Type: Article
Uncontrolled Keywords: Convolutional Neural Network; Multi-Scale; EEG; EMG; Exoskeleton; Walking
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 17 Jan 2022 12:47
Last Modified: 22 Nov 2022 22:02

Actions (login required)

View Item View Item