• Home
  • Search
  • End-to-End Self-Driving Using Deep Neural Networks with Multi-auxiliary Tasks
  • Cite Icon35
  • https://doi.org/10.1007/s42154-019-00057-1Copy DOI Icon

End-to-End Self-Driving Using Deep Neural Networks with Multi-auxiliary Tasks

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

End-to-end self-driving is a method that directly maps raw visual images to vehicle control signals using deep convolutional neural network (CNN). Although prediction of steering angle has achieved good result in single task, the current approach does not effectively simultaneously predict the steering angle and the speed. In this paper, various end-to-end multi-task deep learning networks using deep convolutional neural network combined with long short-term memory recurrent neural network (CNN-LSTM) are designed and compared, which could obtain not only the visual spatial information but also the dynamic temporal information in the driving scenarios, and improve steering angle and speed predictions. Furthermore, two auxiliary tasks based on semantic segmentation and object detection are proposed to improve the understanding of driving scenarios. Experiments are conducted on the public Udacity dataset and a newly collected Guangzhou Automotive Cooperate dataset. The results show that the proposed network architecture could predict steering angles and vehicle speed accurately. In addition, the impact of multi-auxiliary tasks on the network performance is analyzed by visualization method, which shows the salient map of network. Finally, the proposed network architecture has been well verified on the autonomous driving simulation platform Grand Theft Auto V (GTAV) and experimental road with an average takeover rate of two times per 10 km.

Similar Papers
  • Research Article
  • Citations175

Deep distributed convolutional neural networks: Universality

  • Nov 01, 2018
  • Analysis and Applications
  • Ding-Xuan Zhou
  • PDF
  • Research Article
  • Citations7

Comprehensive Study for Breast Cancer Using Deep Learning and Traditional Machine Learning

  • Apr 12, 2022
  • ZANCO JOURNAL OF PURE AND APPLIED SCIENCES
  • Chiman Haydar Salh +1
  • PDF
  • Research Article
  • Citations16

An Interactive Visualization for Feature Localization in Deep Neural Networks

  • Jul 23, 2020
  • Frontiers in Artificial Intelligence
  • Martin Zurowietz +1
  • Research Article
  • Citations8

Adversarial Robustness of Deep Convolutional Neural Network-based Image Recognition Models: A Review

  • Aug 28, 2021
  • 雷达学报
  • Hao Sun +4
  • Research Article
  • Citations104

Maxout neurons for deep convolutional and LSTM neural networks in speech recognition

  • Dec 17, 2015
  • Speech Communication
  • Meng Cai +1
  • Conference Article
  • Citations6

Health Indicator Construction of Rolling Bearings Based on Deep Convolutional Neural Network Considering Phase Degradation

  • May 01, 2019
  • Daoming She +1
  • Conference Article
  • Citations55

Audio and face video emotion recognition in the wild using deep neural networks and small datasets

  • Oct 31, 2016
  • Wan Ding +6
  • Conference Article

Bottleneck and Embedding Representation of Speech for DNN-based Language and Speaker Recognition

  • Nov 21, 2018
  • Alicia Lozano-Diez +2
  • PDF
  • Research Article
  • Citations183

Stress detection using deep neural networks

  • Dec 01, 2020
  • BMC Medical Informatics and Decision Making
  • Russell Li +1
  • Research Article

DQFCNN: A New Deep Learning Architecture for Bird Species Classification Based on Images

  • Apr 30, 2025
  • Journal of Circuits, Systems and Computers
  • Pralhad Gavali +1
  • Research Article
  • Citations19

Feature Extraction and Classification Using Deep Convolutional Neural Networks

  • Jan 17, 2018
  • Journal of Cyber Security and Mobility
  • Jyostna Devi Bodapati +1
  • Research Article
  • Citations4

Deep Learning Framework of Convolutional Neural Network (CNN) and Attention CNN for Early Diagnosis of Alzheimer's Disease

  • Jan 01, 2023
  • International Journal of Advances in Applied Computational Intelligence
  • Hoda K Mohamed +2
  • Conference Article
  • Citations10

Application of shared backbone DNNs in ADAS perception systems

  • Jan 04, 2021
  • Mikhail G Lobanov +1
  • Research Article
  • Citations1

Fighting against COVID‐19: Innovations and applications

  • May 29, 2023
  • International Journal of Imaging Systems and Technology
  • Yudong Zhang
  • Research Article
  • Citations24

Hyper-parameter optimization of convolutional neural network based on particle swarm optimization algorithm

  • Dec 01, 2021
  • Bulletin of Electrical Engineering and Informatics
  • Zainab Fouad +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.