Research Repository

Hybrid lip shape feature extraction and recognition for human-machine interaction

Zhang, Yi and Liu, Jiao and Luo, Yuan and Hu, osheng (2013) 'Hybrid lip shape feature extraction and recognition for human-machine interaction.' International Journal of Modelling, Identification and Control, 18 (3). p. 191. ISSN 1746-6172

Full text not available from this repository.


Dumb and deaf people are unable to interact with robots using traditional voice-based human-machine interfaces (HMI). Lip motion is a useful way for these people to communicate with machines, even for normal people in extremely noisy environments. However, the recognition of lip motion is a difficult task since the region of interest (ROI) is non-linear and noisy. This paper proposes a novel lip shape feature extraction method to deal with the difficulty, based on hybrid dual-tree complex wavelet transform (DT-CWT) and discrete cosine transform (DCT). The approximate shift invariance of DT-CWT is utilised to make the same lip shape have the same feature vector when the lips are in different positions in the ROI. Then, DCT is used to extract coefficients from the feature vector generated by DT-CWT, and to choose the larger coefficients to obtain the key information of lip shape and reduce the dimensions of a feature vector. The experimental results show that this method can greatly improve the accuracy of lip shape recognition, and enhance the robustness of the lip shape-based HMI. © 2013 Inderscience Enterprises Ltd.

Item Type: Article
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 12 Jan 2015 13:40
Last Modified: 15 Jan 2022 00:45

Actions (login required)

View Item View Item