Research Repository

A direct visual-inertial sensor fusion approach in multi-state constraint Kalman filter

Jianjun, Gui and Dongbing, Gu (2015) A direct visual-inertial sensor fusion approach in multi-state constraint Kalman filter. In: 2015 34th Chinese Control Conference (CCC), 2015-07-28 - 2015-07-30.

Full text not available from this repository.


Pose estimation only using a monocular camera and an inertial sensor triggers increasing popularity in recent years. In this paper, we propose a method, that tightly combines direct image information (intensity and gradient) from monocular camera with inertial information from three-axis gyroscope and accelerometer in a multi-state constraint Kalman filter (MSCKF) based framework to perform an effective pose estimation. In contrast to other pose estimation methods using vision, our solution gets rid of traditional feature extraction and expression, instead using image patches with distinct gradient to represent a visual measurement from environment. We adopt sequential inertial information and the poses between two consecutive keyframes to construct the state vector, imposing constraints on the poses and marginalising out expired ones, which would reduce the computational complexity linear to the number of selected patches. Furthermore, we view the data from the inertial sensor as intrinsic information applied in filter propagation, providing fast rate estimation for the state. The result of our method has been tested on real flying data of a micro aerial vehicle in indoor and outdoor environments.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Published proceedings: Chinese Control Conference, CCC
Uncontrolled Keywords: Visual-Inertial Odometry; Multi-Sensor Fusion; Pose Estimation
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Science and Health
Faculty of Science and Health > Computer Science and Electronic Engineering, School of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 15 Sep 2015 08:30
Last Modified: 23 Sep 2022 18:46

Actions (login required)

View Item View Item