• Home
  • Search
  • Cross-Modal 360° Depth Completion and Reconstruction for Large-Scale Indoor Environment
  • Cite Icon33
  • https://doi.org/10.1109/tits.2022.3155925Copy DOI Icon

Cross-Modal 360° Depth Completion and Reconstruction for Large-Scale Indoor Environment

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In a large-scale epidemic, reducing direct contact among medical personnel, attendants and patients has become a necessary means of epidemic prevention and control. Intelligent vehicles and mobile robots in the hospital environment, such as disinfection vehicles, logistics vehicles, nursing robots, and guiding robots, play an important role in improving the operational efficiency of the medical system and promoting epidemic prevention and governance. Powerful capabilities of environmental spatial perception and reconstruction are the keys to accurate localization, navigation, and obstacle avoidance for intelligent vehicles and autonomous robots in such operations. Omnidirectional perception is becoming increasingly important and proliferative in autonomous vehicles and robots since its wide field of view significantly enhances the perception ability. However, the lack of dense and accurate 360° depth datasets has brought the challenge to the omnidirectional perception. In this paper, we propose a depth-sensing and reconstruction system to address this challenge in the large-scale indoor environment. First, we design an omnidirectional depth completion convolutional neural network model, in which a spherical normalized convolutional and the unit sphere area-based loss are introduced to extract features from cross-modal omnidirectional input with unequal sparsity and deal with the imbalanced data distribution and distortion in the panoramic input. In addition, we present a 3D reconstruction system by integrating our depth completion into omnidirectional localization and dense mapping. We evaluate our method on 360D large-scale indoor datasets and real-world sequences of a challenging hospital scene. Extensive experiments show that the proposed method outperforms the other state-of-the-art (SoTA) approaches in terms of depth completion and 3D reconstruction.

Similar Papers
  • Research Article
  • Citations52

RETRACTED: Applications of fuzzy control to nonlinear time-delay systems using the linear matrix inequality fuzzy Lyapunov method

  • Oct 18, 2011
  • Journal of Vibration and Control
  • Cheng-Wu Chen +3
  • Addendum
  • Citations4

Retraction notice

  • Feb 06, 2013
  • Journal of Vibration and Control
  • M L Lin +1
  • Research Article
  • Citations79

RETRACTED: Identification and monitoring of bridge health from ambient vibration data

  • Nov 12, 2010
  • Journal of Vibration and Control
  • T.Y Liu +5
  • Addendum
  • Citations1

Retraction notice

  • Apr 10, 2013
  • Journal of Vibration and Control
  • Chen-Yuan Peter Chen +4
  • Research Article
  • Citations32

Rigid Point Set Registration Based on Cubature Kalman Filter and Its Application in Intelligent Vehicles

  • Jun 01, 2018
  • IEEE Transactions on Intelligent Transportation Systems
  • Liang Li +3
  • Conference Article

Design and Experiment of Sensor Circuit for Intelligent Logistics Vehicle

  • Dec 11, 2020
  • Zhiwei Kou +6
  • Research Article

비전 시스템을 가지는 자율주행 이동로봇을 위한 퍼지 규칙을 이용한 경로 계획

  • Feb 01, 2003
  • Journal of Korean Institute of Intelligent Systems
  • Jae-Hoon Kim +2
  • Research Article
  • Citations1

Fuzzy Configuration Space for Moving Obstacle Avoidance of Autonomous Mobile Robots

  • Jan 20, 2006
  • Journal of Advanced Computational Intelligence and Intelligent Informatics
  • Jorge Guerra +2
  • Research Article

Global–local Path Planning and Four-wheel-steering-based Tracking Control Architecture for Obstacle Avoidance of Industrial Autonomous Mobile Robots

  • Mar 12, 2026
  • Journal of Institute of Control Robotics and Systems
  • Changseok Kim +5
  • Book Chapter
  • Citations2

Design and verification of real-time systems

  • Jan 01, 1998
  • John W Baugh
  • Research Article
  • Citations60

Real-Time Active SLAM and Obstacle Avoidance for an Autonomous Robot Based on Stereo Vision

  • Mar 11, 2019
  • Cybernetics and Systems
  • V S Kalogeiton +3
  • Conference Article
  • Citations55

Image matching in large scale indoor environment

  • Jun 01, 2009
  • Hongwen Kang +3
  • Conference Article
  • Citations1

Geomagnetic Field based Human Search and Following for Autonomous Robots

  • Jun 10, 2018
  • Sen Wang +2
  • Conference Article
  • Citations28

Fusion of Stereo and Still Monocular Depth Estimates in a Self-Supervised Learning Context

  • May 01, 2018
  • Diogo Martins +2
  • Research Article
  • Citations1

Introduction to the Special Issue on the Man and the Machine

  • Jun 01, 2016
  • European Journal of Risk Regulation
  • Thomas Burri +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.