• Home
  • Search
  • Deep Architecture With Cross Guidance Between Single Image and Sparse LiDAR Data for Depth Completion
  • Cite Icon46
  • https://doi.org/10.1109/access.2020.2990212Copy DOI Icon

Deep Architecture With Cross Guidance Between Single Image and Sparse LiDAR Data for Depth Completion

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

It is challenging to apply depth maps generated from sparse laser scan data to computer vision tasks, such as robot vision and autonomous driving, because of the sparsity and noise in the data. To overcome this problem, depth completion tasks have been proposed to produce a dense depth map from sparse LiDAR data and a single RGB image. In this study, we developed a deep convolutional architecture with cross guidance for multi-modal feature fusion to compensate for the lack of representation power of their modality. Two encoders, which are part of the proposed architecture, receive different modalities as inputs. They interact with each other by exchanging information in each stage through the attention mechanism during encoding. We also propose a residual atrous spatial pyramid block, comprising multiple dilated convolutions with different dilation rates, which are used to derive highly significant features. The experimental results of the KITTI depth completion benchmark dataset demonstrate that the proposed architecture shows higher performance than that of the other models trained in a two-dimensional space without pre-training or fine-tuning other datasets.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations8

NNNet: New Normal Guided Depth Completion From Sparse LiDAR Data and Single Color Image

  • Jan 01, 2022
  • IEEE Access
  • Jiade Liu +1
  • Dissertation

Investigation on Segmentation, Recognition and 3D Reconstruction of Objects Based on LiDAR Data Or MRI

  • May 01, 2015
  • Shijun Tang
  • PDF
  • Research Article
  • Citations6

Model-Based Retrieval of Forest Parameters From Sentinel-1 Coherence and Backscatter Time Series

  • Jan 01, 2023
  • IEEE Geoscience and Remote Sensing Letters
  • M Lavalle +5
  • Conference Article
  • Citations320

A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images

  • Oct 01, 2017
  • Jun Li +2
  • PDF
  • Research Article
  • Citations7

Lightweight and Energy-Aware Monocular Depth Estimation Models for IoT Embedded Devices: Challenges and Performances in Terrestrial and Underwater Scenarios †

  • Feb 16, 2023
  • Sensors (Basel, Switzerland)
  • Lorenzo Papa +4
  • Book Chapter

CNN Approach for Monocular Depth Estimation: Ear Case Study

  • Dec 01, 2021
  • Roberto Magherini +5
  • Book Chapter
  • Citations171

A Multi-scale CNN for Affordance Segmentation in RGB Images

  • Jan 01, 2016
  • Anirban Roy +1
  • Research Article
  • Citations2

가중 메디안 필터를 이용한 16채널 라이다의 깊이정보 업샘플링

  • May 31, 2021
  • Journal of Institute of Control, Robotics and Systems
  • Hyun-Bin Lim +4
  • Research Article
  • Citations64

SemAttNet: Toward Attention-Based Semantic Aware Guided Depth Completion

  • Jan 01, 2022
  • IEEE Access
  • Danish Nazir +4
  • Research Article
  • Citations13

Multi-stage cascaded deconvolution for depth map and surface normal prediction from single image

  • Jul 06, 2018
  • Pattern Recognition Letters
  • Ram Prasad Padhy +4
  • Conference Article

Self-Supervised Monocular Depth Estimation Based on Dual-Branch DepthNet and Multi-Attention Fusion

  • Jan 01, 2025
  • Yuanyuan Wang
  • Conference Article
  • Citations4

MonoSOD: Monocular Salient Object Detection based on Predicted Depth

  • May 30, 2021
  • George Dimas +2
  • Research Article
  • Citations2

Point Cloud Wall Projection for Realistic Road Data Augmentation.

  • Dec 20, 2024
  • Sensors (Basel, Switzerland)
  • Kana Kim +4
  • Research Article
  • Citations4

Spacecraft depth completion from sparse LiDAR data under adverse illumination

  • Aug 01, 2025
  • Aerospace Science and Technology
  • Ao Xiang +1
  • Conference Article
  • Citations114

Autolabeling 3D Objects With Differentiable Rendering of SDF Shape Priors

  • Jun 01, 2020
  • Sergey Zakharov +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.