Traffic Sign Recognition using SURF: Speeded up robust feature descriptor and artificial neural network classifier

Traffic Sign Recognition (TSR) system is a significant component of Intelligent Transport System (ITS) as traffic signs assist the drivers to drive more safely and efficiently. This paper represents a new approach for TSR system where detection of traffic sign is carried out using fuzzy rules based color segmentation method and recognition is accomplished using Speeded Up Robust Features(SURF) descriptor, trained by artificial neural network (ANN) classifier. In the detection step, the region of interest (sign area) is segmented using a set of fuzzy rules depending on the hue and saturation values of each pixel in the HSV color space, post processed to filter unwanted region. Finally the recognition of the traffic sign is implemented using ANN classifier upon the training of SURF features descriptor. The proposed system simulated on offline road scene images captured under different illumination conditions. The detection algorithm shows a high robustness and the recognition rate is quite satisfactory. The performance of the ANN model is illustrated in terms of cross entropy, confusion matrix and receiver operating characteristic (ROC) curves. Also, performances of some classifier such as Support Vector Machine (SVM), Decision Trees, Ensembles Learners (Adaboost) and K-Nearest Neighbor (KNN) classifier are assessed with ANN approach. The simulation results illustrate that recognition using ANN model is higher than classifiers stated above.

Locating roadworks sites via detecting change in lateral positions of traffic signs measured relative to the ego-car

Automatic detection and recognition of traffic sign has been a topic of great interest in advanced driver assistance system. It enhances vehicle and driver safety by providing the condition and state of the road to the drivers. However, visual occlusion and ambiguities in the real-world scenario make the traffic sign recognition a challenging task. This paper presents an Automatic Traffic Sign Detection and Recognition (ATSDR) system, involving three modules: segmentation, detection, and recognition. Region of Interest (ROI) is extracted using multiple thresholding schemes with a novel environmental selection strategy. Then, the traffic sign detection is carried out using correlation computation between log-polar mapped inner regions and the reference template. Finally, recognition is performed using Support Vector Machine (SVM) classifier. Our proposed system achieved a recognition accuracy of 98.3 % and the experimental results demonstrates the robustness of traffic sign detection and recognition in real-world scenario.

Traffic sign detection and recognition systems include a variety of applications like autonomous driving, road sign inventory, and driver support systems. Machine learning algorithms provide useful tools for traffic sign identification tasks. However, classification algorithms depend on the preprocessing stage to obtain high accuracy rates. This paper proposes a road sign characterization method based on oriented gradient maps and the Karhunen-Loeve transform in order to improve classification performance. Dimensionality reduction may be important for portable applications on resource constrained devices like FPGAs; therefore, our approach focuses on achieving a good classification accuracy by using a reduced amount of attributes compared to some state-of-the-art methods. The proposed method was tested using German Traffic Sign Recognition Benchmark, reaching a dimensionality reduction of 99.3% and a classification accuracy of 95.9% with a Multi-Layer Perceptron.

Traffic sign recognition system is a great important part of intelligent transportation system and advanced auxiliary driving system, and it is a key problem to improve the accuracy and real-time performance of traffic sign detection in reality.Considering to the perspective of accuracy and real-time of traffic sign detection and recognition, this article built the traffic sign detection and recognition method based on MATLAB. Finally, the paper proved the conclusion, and future traffic sign detection and recognition need to be further research topics and practical application prospect.

In this paper, we discuss theoretical foundations and a practical realization of a real-time traffic sign detection, tracking and recognition system operating on board of a vehicle. In the proposed framework, a generic detector refinement procedure based on mean shift clustering is introduced. This technique is shown to improve the detection accuracy and reduce the number of false positives for a broad class of object detectors for which a soft response’s confidence can be sensibly estimated. The track of an already established candidate is maintained over time using an instance-specific tracking function that encodes the relationship between a unique feature representation of the target object and the affine distortions it is subject to. We show that this function can be learned on-the-fly via regression from random transformations applied to the image of the object in known pose. Secondly, we demonstrate its capability of reconstructing the full-face view of a sign from substantial view angles. In the recognition stage, a concept of class similarity measure learned from image pairs is discussed and its realization using SimBoost, a novel version of AdaBoost algorithm, is analyzed. Suitability of the proposed method for solving multi-class traffic sign classification problems is shown experimentally for different feature representations of an image. Overall performance of our system is evaluated based on a prototype C++ implementation. Illustrative output generated by this demo application is provided as a supplementary material attached to this paper.

The Traffic Sign Recognition (TSR) system is an essential part of traffic management, being support system for driver and intelligent vehicle. Traffic Sign Detection (TSD) is the prerequisite step of the automatic TSR system. This paper proposes a TSD framework by exploring fuzzy image processing and invariant geometric moments. In this framework, fuzzy inference system is applied to convert the HSV image into gray tone. Then, statistical threshold is used for the segmentation. After shape verification of every connected component using Hu moments and Quadratic Discriminant Analysis (QDA) model, the candidate signs are detected by referencing bounding box parameters. The framework is simulated in different complex scenarios of day and night mode. Experimental result shows that its performance is satisfactory and recommendable with the state of the art research. The proposed framework yields 94.86% F-measure in case of Bangladesh road signs and 93.01% in German road signs.

Worldwide, traffic safety is a strong concern as traffic accidents are one of the leading causes of death. In this context, advanced driver assistance systems (ADAS) and autonomous vehicles are traffic management measures aimed at improving road safety and flow. Automatic detection and recognition of traffic signs are important for intelligent vehicles and ADAS systems. This work proposes a pipeline of digital image processing (DIP) techniques, machine learning (ML), and temporal coherence to perform the detection and recognition of Brazilian traffic signs in videos aiming an application for real-time systems to help in traffic safety and to reduce the number of fatal accidents. We are mainly interested in recognizing signs of speed limit group, no overtaking and obligatory passage, thus our detection considers the traffic sign with a circular shape and red border. For detection, the red color segmentation and the Hough transform are used to find circular regions that will be classified through the SVM algorithm in sign and not sign. For recognition of these signs, the support vector machines (SVM) are used. For speed limit signs the thresholding and contours are used to segment the digits for later classification. Our proposed method achieved an accuracy of 0.82 in detection, an increase of 18% in the number of recognized frames and 0.96 in the recognition stage using temporal coherence.

Traffic sign recognition systems (TSR) are a hot research topic because of their importance in the field of driver safety. Major car companies are developing smart driving systems for this purpose. TSR was introduced in 2022 in some luxury cars, such as the Cadillac XT4 and Mercedes-Benz GLS. TSR is a driver assistance feature that can be used to advise and warn the driver about possible road limitations along the current route. The development of the TSR system aims at two objectives; the first is to develop a fast and inexpensive system that can be added to economic vehicles. The second objective is to apply safe leadership automatically when accessing a fast and reliable TSR system. Following laws can be made compulsory by the vehicle itself, such as not exceeding speed in the event of a speed limit. (except in emergencies).There are many issues and challenges facing the researcher that works on the detection and recognition of traffic signs, such as bad weather, various illumination, occlusion, spped of cars.This research paper aims to present a proposal that facilitates access to a fast, reliable, and low-cost system. The proposed TSR is based on combining the You Only Lock Once (YOLOv5) network with a convolution neural network (CNN) that enhances the accuracy of detection and recognition in addition to speeding up the processing. Two datasets were used for training models. The YOLOv5 was trained on the GTSDB, while CNN was trained on the GTSRB.YOLOv5 is used to detect the traffic signs in the input image. The detected signs are bounded by boxes and labeled according to the group that belongs to them (the dataset is clustered into four groups (prohibitory, mandatory, danger, and others)), and then each bounded box is segmented from the rest of the image background. The segmented image (including the traffic sign) is input to the CNN to be classified into one of the 43 traffic signs.This proposed system achieved an average of 94% detection accuracy by using YOLO and 99.95% classification accuracy in CNN, with a processing time of 0.031 seconds per frame. In real-time applications, this low computation time can improve the system's stability and dependability.

To avoid road accidents and for safe driving, a proper traffic sign recognition and classification is necessary. It is also an important part of intelligent transport systems and driverless vehicles. This article outlines the different ways to recognize and classify traffic signs. Various types of algorithms are used to recognize text-based, shape-based and color-based traffic signs. With the development of Artificial Intelligence, deep learning models are becoming more popular. CNN models are used for both detection and classification. Self-driving cars must learn to obey road signs in order to drive safely and smoothly. A transfer learning-based approach to traffic sign recognition and classification is used to reduce data costs. This survey analyses different machine learning and deep learning based methods for traffic sign recognition. The traffic sign recognition and classifications are applicable in intelligent transport system, driving autonomous vehicle, conducting road surveys, improving road safety and infrastructure.

Nowadays, the number of road accident in Malaysia is increasing expeditiously. One of the ways to reduce the number of road accident is through the development of the advanced driving assistance system (ADAS) by professional engineers. Several ADAS system has been proposed by taking into consideration the delay tolerance and the accuracy of the system itself. In this work, a traffic sign recognition system has been developed to increase the safety of the road users by installing the system inside the car for driver’s awareness. TensorFlow algorithm has been considered in this work for object recognition through machine learning due to its high accuracy. The algorithm is embedded in the Raspberry Pi 3 for processing and analysis to detect the traffic sign from the real-time video recording from Raspberry Pi camera NoIR. This work aims to study the accuracy, delay and reliability of the developed system using a Raspberry Pi 3 processor considering several scenarios related to the state of the environment and the condition of the traffic signs. A real-time testbed implementation has been conducted considering twenty different traffic signs and the results show that the system has more than 90% accuracy and is reliable with an acceptable delay.

Traffic Sign Detection and Recognition is an important component of intelligent transportation systems. It has captured the attention of the computer vision community for several decades. In this paper, we propose a new traffic sign detection and recognition approach consisting of color segmentation, shape classification and recognition stages. In the first stage, the image is segmented using look-up tables and thresholding on the HSI color space. The second stage uses Distance to borders (DtBs) features and random forest classifier to detect circular, triangular and rectangular shapes among the segmented ROIs. The last stage consists in the recognition of the detected signs. It is performed using Random Forest as classifier and histogram of oriented gradients (HOG) together with local self-similarity (LSS) as features. Experimental results show that the proposed method achieves high recall, precision, and correct classification accuracy ratios, and is robust to various adverse situations.

The ability of autonomous driving systems to recognize traffic signs in a variety of environmental conditions is crucial to their reliability. This study uses convolutional neural networks (CNNs) to provide a novel method for improving the accuracy of traffic sign recognition systems under challenging weather situations. The research focuses on developing a CNN-based model that is trained using the augmented German Traffic Sign Recognition Benchmark (GTSRB) dataset, which contains over 50,000 labeled images of road signs across 43 categories. To attempt to overcome the limitations of traditional CNN models under adverse environmental conditions, this work presents adaptive feature extraction layers that are especially made to reduce visibility problems brought on by rain, fog, and snow. By taking a comprehensive approach, the model uses advanced data augmentation methods to simulate different weather scenarios, greatly increasing the diversity of the training dataset. Through an analysis of theoretical and practical aspects, the study demonstrates how CNNs enhance the accuracy and efficiency of road sign detection systems in a different weather condition. Research evaluates the model's effectiveness using metrics such as precision, recall, and F1-score, proving its capability to reduce false positives and accurately detect relevant road sign instances. Additionally, the paper highlights the importance of careful dataset preparation and augmentation, model optimization, and training enhancements to improve the performance of road sign detection systems. The results of this research offer benefits for intelligent transport systems, autonomous driving, and road safety, pointing towards further advancements in precise and dependable road sign recognition technology.

An accident is the cry of a lifetime. The role of traffic signs is most important in preventing or mitigating accidents. In many cases, while driving, traffic signs are not visible in the conventional approach; if traffic sign detection and recognition can alert the driver of important sign guidance ahead, it will help in accident mitigation. Traffic sign recognition plays a monumental role in expert systems, such as traffic assistance driving systems and automatic driving systems. The prime purpose of this paper is to design and identify a computer-based system that can spontaneously detect the direction of a road sign. For this research work, we have created our own dataset, which is called the Bangladeshi Traffic Sign Recognition Benchmark (BTSRB) dataset. The dataset, BTSRB, was created by capturing images from different angles and under different parameters and conditions. A total of 7320 images were collected to create this comprehensive database. This dataset called BTSRB all the images collected from Bangladesh. In this paper, we used five different types of models (CNN, Inception V3, MobileNetV2, ResNet50, and VGG16), which are pre-trained on the ImageNet dataset. Later, we finetuned the pre-trained model and used transfer learning. The main challenge of this research is collecting datasets from a country like Bangladesh, where no recognized dataset is available. When compared to another model, the accuracy of this model is greater than 91%. This paper emphasizes the significance of traffic sign recognition in expert systems and the necessity for a well-established dataset in nations where such resources are not readily available.

Road signs are essential for providing information to drivers. Understanding road signs are essential for ensuring traffic safety because doing so can stop 4484 accidents. The identification of traffic signs has been the focus of research in recent decades. Accurate real-time recognition is the cornerstone of a robust but underdeveloped traffic sign recognition system. This study provides drivers with real-time voice-advice traffic sign recognition technology. This system is composed of two subsystems. Using a trained convolutional neural network, the first recognizes and detects traffic signs (CNN). When the system notices a particular traffic sign, the text-to-speech engine is employed to play a voice message to the driver. An efficient- CNN model is built on the reference data set using deep learning methods for search and real-time search. This system's advantage is that it recognizes traffic signs and guides the car even if the driver overlooks, ignores, or doesn't understand them. Say. These technologies are also necessary for the development of autonomous vehicles.