Feng, Tuo and Gu, Dongbing (2024) RSTNet: Recurrent Spatial-Temporal Networks for Estimating Depth and Ego-Motion. IEEE Transactions on Emerging Topics in Computational Intelligence, 8 (3). pp. 2375-2385. DOI https://doi.org/10.1109/TETCI.2024.3360329
Feng, Tuo and Gu, Dongbing (2024) RSTNet: Recurrent Spatial-Temporal Networks for Estimating Depth and Ego-Motion. IEEE Transactions on Emerging Topics in Computational Intelligence, 8 (3). pp. 2375-2385. DOI https://doi.org/10.1109/TETCI.2024.3360329
Feng, Tuo and Gu, Dongbing (2024) RSTNet: Recurrent Spatial-Temporal Networks for Estimating Depth and Ego-Motion. IEEE Transactions on Emerging Topics in Computational Intelligence, 8 (3). pp. 2375-2385. DOI https://doi.org/10.1109/TETCI.2024.3360329
Abstract
Depth map and ego-motion estimations from monocular consecutive images are challenging to unsupervised learning Visual Odometry (VO) approaches. This paper proposes a novel VO architecture: Recurrent Spatial-Temporal Network (RSTNet), which can estimate the depth map and ego-motion from monocular consecutive images. The main contributions in this paper include a novel RST-encoder layer and its corresponding RST-decoder layer, which can preserve and recover spatial and temporal features from inputs. Our RSTNet extracts appearance features from input images, and extracts structure and temporal features from intermediate results for ego-motion estimation. Our RSTNet also includes a pre-trained network to detect dynamic objects from the difference between full and rigid optical flows. A novel auto-mask scheme is designed in the loss function to deal with some challenging scenes. Our evaluation results on the KITTI odometry benchmark show our RSTNet outperforms some of the existing unsupervised learning approaches.
Item Type: | Article |
---|---|
Uncontrolled Keywords: | Localisation; visual odometry; SLAM; depth and ego-motion estimation; deep learning SLAM |
Divisions: | Faculty of Science and Health Faculty of Science and Health > Computer Science and Electronic Engineering, School of |
SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
Depositing User: | Unnamed user with email elements@essex.ac.uk |
Date Deposited: | 20 Mar 2024 15:35 |
Last Modified: | 30 Oct 2024 19:21 |
URI: | http://repository.essex.ac.uk/id/eprint/37644 |
Available files
Filename: RSTNet_TETCI-2.pdf