Predictive RGBD Simultaneous Localization and Mapping (SLAM) Systems for Robotics and Intelligent Vehicles

3D perception, the ability to perceive depth and spatial relationships in the world, is fundamental to human cognition and holds immense potential across various sensing domains including robots and intelligent vehicles. The emergence of deep learning-based techniques offers a compelling alternative, potentially enabling 3D vision from monocular camera inputs without additional hardware modifications.
This tutorial will delve into the principles and applications of traditional 3D sensing and computer vision methods for intelligent vehicles. Subsequently, we will introduce predictive 3D sensing based on deep learning, covering fundamental concepts, common architectures, and training data requirements. We will use simultaneous localization and mapping (SLAM) and autonomous driving as illustrations. Issues such as compatibility with monocular cameras and seamless integration into existing sensor systems without requiring additional hardware modifications will also be discussed in this tutorial.