Liu, Qiang and Li, Ruihao and Hu, Huosheng and Gu, Dongbing (2016) Using semantic maps for room recognition to aid visually impaired people. In: 2016 22nd International Conference on Automation and Computing (ICAC), 2016-09-07 - 2016-09-08.
Liu, Qiang and Li, Ruihao and Hu, Huosheng and Gu, Dongbing (2016) Using semantic maps for room recognition to aid visually impaired people. In: 2016 22nd International Conference on Automation and Computing (ICAC), 2016-09-07 - 2016-09-08.
Liu, Qiang and Li, Ruihao and Hu, Huosheng and Gu, Dongbing (2016) Using semantic maps for room recognition to aid visually impaired people. In: 2016 22nd International Conference on Automation and Computing (ICAC), 2016-09-07 - 2016-09-08.
Abstract
Millions of people in the world suffer from vision impairment or even vision loss. Guide sticks and dogs have been deployed to lead them around various obstacles. However, both of them are not capable of interacting with human users who normally rely on conceptual knowledge or semantic contents of the environment. This paper first builds a 3D semantic indoor environment map with an RGB-D sensor. Then, the map is used for room recognition during the revisits based on appearance by applying a convolutional neural network. Representative objects extracted from the semantic map are used to diagnose and eliminate errors during room recognition. The proposed method result in a 97.8% accuracy even with lighting condition and small object location changes.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | Published proceedings: 2016 22nd International Conference on Automation and Computing, ICAC 2016: Tackling the New Challenges in Automation and Computing |
Uncontrolled Keywords: | Semantic map; room recognition; visually impaired people; convolutional neural network; HMI |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 27 Feb 2017 16:31 |
Last Modified: | 30 Oct 2024 16:53 |
URI: | http://repository.essex.ac.uk/id/eprint/19045 |