Traffic sign recognition based on the NVIDIA Jetson TX1 embedded system using convolutional neural networks

Traffic sign recognition system is a great important part of intelligent transportation system and advanced auxiliary driving system, and it is a key problem to improve the accuracy and real-time performance of traffic sign detection in reality.Considering to the perspective of accuracy and real-time of traffic sign detection and recognition, this article built the traffic sign detection and recognition method based on MATLAB. Finally, the paper proved the conclusion, and future traffic sign detection and recognition need to be further research topics and practical application prospect.

With the notion of smart cities transforming cities into digital societies and making people's lives easier in every way, Intelligent Transportation Systems have become an integral element among all. The Intelligent Transportation System (ITS) attempts to improve traffic efficiency by reducing congestion and ensuring the safety and comfort of commuters in real time. Traffic sign detection and recognition is one of the multifaceted conjunctive fields of research in ITS. In this paper, we address the issue of the TSR (traffic sign recognition) problem, i.e., classification of traffic signs along the roadside which plays a crucial role in developing advanced driver assistance and autonomous driving systems. CNN's network design has a huge impact on its performance and convergence. As a result, we use the Genetic Algorithm (GA) to automate the task of selecting a high-performance CNN (Convolutional Neural Network) Architecture for the GTSRB (German Traffic Sign Recognition Benchmark) dataset. The model is optimized through GA using multiple network configurations in the search space. Our model takes into account the limitations of the dataset, and we use certain data augmentation approaches to address the issues. We were able to attain an average accuracy of 98.2% which demonstrates the state-of-the-art performance on the publicly available dataset.KeywordsConvolutional neural networkGenetic algorithmMulticlass classificationDeep learningModel optimization

Traffic sign recognition systems (TSR) are a hot research topic because of their importance in the field of driver safety. Major car companies are developing smart driving systems for this purpose. TSR was introduced in 2022 in some luxury cars, such as the Cadillac XT4 and Mercedes-Benz GLS. TSR is a driver assistance feature that can be used to advise and warn the driver about possible road limitations along the current route. The development of the TSR system aims at two objectives; the first is to develop a fast and inexpensive system that can be added to economic vehicles. The second objective is to apply safe leadership automatically when accessing a fast and reliable TSR system. Following laws can be made compulsory by the vehicle itself, such as not exceeding speed in the event of a speed limit. (except in emergencies).There are many issues and challenges facing the researcher that works on the detection and recognition of traffic signs, such as bad weather, various illumination, occlusion, spped of cars.This research paper aims to present a proposal that facilitates access to a fast, reliable, and low-cost system. The proposed TSR is based on combining the You Only Lock Once (YOLOv5) network with a convolution neural network (CNN) that enhances the accuracy of detection and recognition in addition to speeding up the processing. Two datasets were used for training models. The YOLOv5 was trained on the GTSDB, while CNN was trained on the GTSRB.YOLOv5 is used to detect the traffic signs in the input image. The detected signs are bounded by boxes and labeled according to the group that belongs to them (the dataset is clustered into four groups (prohibitory, mandatory, danger, and others)), and then each bounded box is segmented from the rest of the image background. The segmented image (including the traffic sign) is input to the CNN to be classified into one of the 43 traffic signs.This proposed system achieved an average of 94% detection accuracy by using YOLO and 99.95% classification accuracy in CNN, with a processing time of 0.031 seconds per frame. In real-time applications, this low computation time can improve the system's stability and dependability.

In this paper, an FPGA-based traffic sign recognition system is introduced for driver assistance applications. The system incorporates two major operations, traffic sign detection and recognition. The algorithms presented include hue detection for potential sign detection, morphological filters for noise reduction, labeling and Hausdorff distance calculation for template recognition. A new hardware platform is presented that combines a Zynq-7000 FPGA processing system and custom IP peripherals together. A frame-work for embedded system development on ARM CPU cores and FPGA fabric is introduced. The proposed hardware platform achieves up to 8 times speed-up compared to the existing FPGA based solutions.

An accident is the cry of a lifetime. The role of traffic signs is most important in preventing or mitigating accidents. In many cases, while driving, traffic signs are not visible in the conventional approach; if traffic sign detection and recognition can alert the driver of important sign guidance ahead, it will help in accident mitigation. Traffic sign recognition plays a monumental role in expert systems, such as traffic assistance driving systems and automatic driving systems. The prime purpose of this paper is to design and identify a computer-based system that can spontaneously detect the direction of a road sign. For this research work, we have created our own dataset, which is called the Bangladeshi Traffic Sign Recognition Benchmark (BTSRB) dataset. The dataset, BTSRB, was created by capturing images from different angles and under different parameters and conditions. A total of 7320 images were collected to create this comprehensive database. This dataset called BTSRB all the images collected from Bangladesh. In this paper, we used five different types of models (CNN, Inception V3, MobileNetV2, ResNet50, and VGG16), which are pre-trained on the ImageNet dataset. Later, we finetuned the pre-trained model and used transfer learning. The main challenge of this research is collecting datasets from a country like Bangladesh, where no recognized dataset is available. When compared to another model, the accuracy of this model is greater than 91%. This paper emphasizes the significance of traffic sign recognition in expert systems and the necessity for a well-established dataset in nations where such resources are not readily available.

Worldwide, traffic safety is a strong concern as traffic accidents are one of the leading causes of death. In this context, advanced driver assistance systems (ADAS) and autonomous vehicles are traffic management measures aimed at improving road safety and flow. Automatic detection and recognition of traffic signs are important for intelligent vehicles and ADAS systems. This work proposes a pipeline of digital image processing (DIP) techniques, machine learning (ML), and temporal coherence to perform the detection and recognition of Brazilian traffic signs in videos aiming an application for real-time systems to help in traffic safety and to reduce the number of fatal accidents. We are mainly interested in recognizing signs of speed limit group, no overtaking and obligatory passage, thus our detection considers the traffic sign with a circular shape and red border. For detection, the red color segmentation and the Hough transform are used to find circular regions that will be classified through the SVM algorithm in sign and not sign. For recognition of these signs, the support vector machines (SVM) are used. For speed limit signs the thresholding and contours are used to segment the digits for later classification. Our proposed method achieved an accuracy of 0.82 in detection, an increase of 18% in the number of recognized frames and 0.96 in the recognition stage using temporal coherence.

info:eu-repo/semantics/published

Advanced driver assistance systems (ADASs) and autonomous vehicles are expected to increase safety, lower energy and fuel consumption, and lower pollutants from road traffic. The advanced driver assistance system’s major features include lane detection and tracking. Finding color line marks on the road is the technique of lane detection. The process of lane tracking aims to help the vehicle continue traveling along a predetermined course. Hence, automatic detection of lanes using convolutional neural networks (CNNs) models has gained popularity in the current economic development. This paper also aims at detecting various objects using convolutional neural networks. In this work, we offer object classification and detection, a demanding topic in computer vision and image processing. As a result, we deployed convolutional neural networks on the Keras platform with TensorFlow support. The experimental results illustrate the amount of time needed to train, test, and generate the model using a constrained computing environment. Here, we trained the system for about 80 images which have taken a couple of seconds to detect with better accuracy. Traffic sign recognition is carried out, which is a significant area of research in ADAS. It is crucial for driverless vehicles and is frequently used to read stationary or moving road signs along the side of the road. A comprehensive recognition system is made up of traffic sign detection (TSD) and categorization (TSC). The paper also aimed at traffic sign recognition, which is crucial to consider, because traffic sign recognition is typically applied to portable devices. The model’s detection accuracy is ensured as long as the speed is maintained. The model developed in this study is 99.89% accurate.

This paper presents an algorithm for most prominent component of active vehicle safety applications, namely the detection and recognition of traffic signs. In the detection stage, HOG feature descriptors combined with SVM classifiers are used to determine the location of points that are high likely to be the potential traffic signs in the scene. Once the search space for traffic sign recognition is reduced through first stage, SURF, FAST and Harris algorithms are used to extract the keypoints in these potential traffic sign regions and BRIEF feature descriptors are used to define the neighbourhood around these keypoints. Model traffic signs are then compared to the regions that are detected to be potential traffic signs in the current traffic scene to determine the type of the traffic sign. In order to extract keypoints, the performance of a variety of feature descriptors are analyzed. Proposed method is tested on video sequences acquired by the camera mounted on a vehicle cruising inner city traffic.With %90 success rate, experimental results suggest that SURF algorithm outperforms the other algorithms in recognizing traffic signs.

Shape Classification for Traffic Sign Recognition

Traffic Sign Recognition (TSR) system is a significant component of Intelligent Transport System (ITS) as traffic signs assist the drivers to drive more safely and efficiently. This paper represents a new approach for TSR system where detection of traffic sign is carried out using fuzzy rules based color segmentation method and recognition is accomplished using Speeded Up Robust Features(SURF) descriptor, trained by artificial neural network (ANN) classifier. In the detection step, the region of interest (sign area) is segmented using a set of fuzzy rules depending on the hue and saturation values of each pixel in the HSV color space, post processed to filter unwanted region. Finally the recognition of the traffic sign is implemented using ANN classifier upon the training of SURF features descriptor. The proposed system simulated on offline road scene images captured under different illumination conditions. The detection algorithm shows a high robustness and the recognition rate is quite satisfactory. The performance of the ANN model is illustrated in terms of cross entropy, confusion matrix and receiver operating characteristic (ROC) curves. Also, performances of some classifier such as Support Vector Machine (SVM), Decision Trees, Ensembles Learners (Adaboost) and K-Nearest Neighbor (KNN) classifier are assessed with ANN approach. The simulation results illustrate that recognition using ANN model is higher than classifiers stated above.

Locating roadworks sites via detecting change in lateral positions of traffic signs measured relative to the ego-car

To avoid road accidents and for safe driving, a proper traffic sign recognition and classification is necessary. It is also an important part of intelligent transport systems and driverless vehicles. This article outlines the different ways to recognize and classify traffic signs. Various types of algorithms are used to recognize text-based, shape-based and color-based traffic signs. With the development of Artificial Intelligence, deep learning models are becoming more popular. CNN models are used for both detection and classification. Self-driving cars must learn to obey road signs in order to drive safely and smoothly. A transfer learning-based approach to traffic sign recognition and classification is used to reduce data costs. This survey analyses different machine learning and deep learning based methods for traffic sign recognition. The traffic sign recognition and classifications are applicable in intelligent transport system, driving autonomous vehicle, conducting road surveys, improving road safety and infrastructure.

In this paper, we propose a traffic sign recognition algorithm based on support vector machine (SVM) and convolutional neural network (CNN) for the traffic sign recognition of intelligent transportation and unmanned vehicle. In the detection of traffic signs, by using color features, firstly we convert the RGB color space to HSV color space, which can get the regions of interest (ROI). Then extract the Histogram of Oriented Gradient (HOG) features, and determine whether it is traffic sign by support vector machine (SVM). This algorithm can successfully detect traffic signs with a high detecting rate. The following is the classification of the detected traffic signs, by using a kind of convolutional neural network, which fuse the RGB information of a picture. In the end, the `German traffic signs' dataset is used to verify the accuracy. Experimental results show that the proposed algorithm can effectively recognize traffic signs, achieving high accuracy and the algorithm complexity is lower.

Automatic detection and recognition of traffic sign has been a topic of great interest in advanced driver assistance system. It enhances vehicle and driver safety by providing the condition and state of the road to the drivers. However, visual occlusion and ambiguities in the real-world scenario make the traffic sign recognition a challenging task. This paper presents an Automatic Traffic Sign Detection and Recognition (ATSDR) system, involving three modules: segmentation, detection, and recognition. Region of Interest (ROI) is extracted using multiple thresholding schemes with a novel environmental selection strategy. Then, the traffic sign detection is carried out using correlation computation between log-polar mapped inner regions and the reference template. Finally, recognition is performed using Support Vector Machine (SVM) classifier. Our proposed system achieved a recognition accuracy of 98.3 % and the experimental results demonstrates the robustness of traffic sign detection and recognition in real-world scenario.