Real-Time Traffic Sign Detection and Recognition using CNN

Traffic signs are an important element in maintaining smoothness and safety on the road. However, there are still many drivers who violate them, causing various negative impacts. Traffic Sign Recognition (TSR) is a technology that has the ability to detect and identify various types of traffic signs by utilizing artificial intelligence in the computer vision domain. TSR has been applied in various vehicle applications, such as Advance Driver Assistance System (ADAS) and Autonomous Driving System (ADS). This system is made by integrating camera sensors with the YOLOv8 algorithm which has high accuracy and fast data processing. The data used were 2093 images and annotated through Roboflow. Then the data is trained through Google Collaboratory with a mAP evaluation result of 95.5% which shows that the system can detect objects accurately. The level of precision and success of the model in detecting objects is 93.5% and the success is 93.3%. The results of system testing can use images, videos, and through cameras in real time.

Advanced driver assistance systems (ADASs) and autonomous vehicles are expected to increase safety, lower energy and fuel consumption, and lower pollutants from road traffic. The advanced driver assistance system’s major features include lane detection and tracking. Finding color line marks on the road is the technique of lane detection. The process of lane tracking aims to help the vehicle continue traveling along a predetermined course. Hence, automatic detection of lanes using convolutional neural networks (CNNs) models has gained popularity in the current economic development. This paper also aims at detecting various objects using convolutional neural networks. In this work, we offer object classification and detection, a demanding topic in computer vision and image processing. As a result, we deployed convolutional neural networks on the Keras platform with TensorFlow support. The experimental results illustrate the amount of time needed to train, test, and generate the model using a constrained computing environment. Here, we trained the system for about 80 images which have taken a couple of seconds to detect with better accuracy. Traffic sign recognition is carried out, which is a significant area of research in ADAS. It is crucial for driverless vehicles and is frequently used to read stationary or moving road signs along the side of the road. A comprehensive recognition system is made up of traffic sign detection (TSD) and categorization (TSC). The paper also aimed at traffic sign recognition, which is crucial to consider, because traffic sign recognition is typically applied to portable devices. The model’s detection accuracy is ensured as long as the speed is maintained. The model developed in this study is 99.89% accurate.

Deep learning has developed rapidly and made unprecedented achievements especially in the field of image cognition, since Alex et al. proposed AlexNet in 2012. This paper focuses on the mainstream research methods of traffic sign detection and recognition, including the traditional feature-based image processing method and the target detection method based on deep learning. The traffic sign detection and recognition method based on deep learning is divided into two categories for discussion and analysis, namely, the Anchor based and Anchor-Free neural network architectures. Finally, the paper makes a brief summary and prospects the future development.

research-article Research on Traffic Sign Detection and Recognition Algorithm Based on Convolutional Neural Network Share on Authors: GuiHua Yang Guilin University of Technology, China Guilin University of Technology, ChinaView Profile , JiaLe Wei Guilin University of Technology, China Guilin University of Technology, ChinaView Profile Authors Info & Claims ICIIP 2021: 2021 6th International Conference on Intelligent Information ProcessingJuly 2021 Pages 291–298https://doi.org/10.1145/3480571.3480624Online:29 October 2021Publication History 0citation22DownloadsMetricsTotal Citations0Total Downloads22Last 12 Months22Last 6 weeks10 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

In this paper, we propose a traffic sign recognition algorithm based on support vector machine (SVM) and convolutional neural network (CNN) for the traffic sign recognition of intelligent transportation and unmanned vehicle. In the detection of traffic signs, by using color features, firstly we convert the RGB color space to HSV color space, which can get the regions of interest (ROI). Then extract the Histogram of Oriented Gradient (HOG) features, and determine whether it is traffic sign by support vector machine (SVM). This algorithm can successfully detect traffic signs with a high detecting rate. The following is the classification of the detected traffic signs, by using a kind of convolutional neural network, which fuse the RGB information of a picture. In the end, the `German traffic signs' dataset is used to verify the accuracy. Experimental results show that the proposed algorithm can effectively recognize traffic signs, achieving high accuracy and the algorithm complexity is lower.

Modern cars utilise Advanced Driver Assistance Systems (ADAS) in several ways. In ADAS, the use of multiple sensors to gauge the environment surrounding the ego-vehicle offers numerous advantages, as fusing information from more than one sensor helps to provide highly reliable and error-free data. The fused data is typically then fed to a tracker algorithm, which helps to reduce noise and compensate for situations when received sensor data is temporarily absent or spurious, or to counter the offhand false positives and negatives. The performances of these constituent algorithms vary vastly under different scenarios. In this paper, we focus on the variation in the performance of tracker algorithms in sensor fusion due to the alteration in external conditions in different scenarios, and on the methods for countering that variation. We introduce a sensor fusion architecture, where the tracking algorithm is spontaneously switched to achieve the utmost performance under all scenarios. By employing a Real-time Traffic Density Estimation (RTDE) technique, we may understand whether the ego-vehicle is currently in dense or sparse traffic conditions. A highly dense traffic (or congested traffic) condition would mean that external circumstances are non-linear; similarly, sparse traffic conditions would mean that the probability of linear external conditions would be higher. We also employ a Traffic Sign Recognition (TSR) algorithm, which is able to monitor for construction zones, junctions, schools, and pedestrian crossings, thereby identifying areas which have a high probability of spontaneous, on-road occurrences. Based on the results received from the RTDE and TSR algorithms, we construct a logic which switches the tracker of the fusion architecture between an Extended Kalman Filter (for linear external scenarios) and an Unscented Kalman Filter (for non-linear scenarios). This ensures that the fusion model always uses the tracker that is best suited for its current needs, thereby yielding consistent accuracy across multiple external scenarios, compared to the fusion models that employ a fixed single tracker.

The transportation system has become a fascinating and active research topic due to its multiple problems; most prior research has focused on traffic forecasting, the advanced driver assistant system (ADAS), and self-driving vehicles. Traffic sign recognition (TSR) is an essential sub-system in ADAS that helps a driver better understand the surrounding environment (obstacles, frost, pedestrians). Automatic recognition of traffic signs is a real-world computer vision challenge and pattern recognition problem. Recently, deep architecture neural networks have shown robust solutions in many areas (health care, agriculture, transportation) due to their ability to handle large amounts of data and excel in complex systems. Therefore, a convolutional neural network (CNN) has been adopted, one of the best deep learning approaches in pattern recognition and image classification for TSR. The proposed architecture has been trained and tested on the German traffic sign recognition benchmark dataset (GTSRB). The results reported accuracy of 99.43% that outperformed human accuracy.KeywordsTraffic sign recognition (TSR)Advanced driver assistant system (ADAS)Deep learningConvolutional neural network (CNN)

Few-shot traffic sign recognition with clustering inductive bias and random neural network

Coronavirus disease 2019 (COVID‐19) has a significant impact on human life. The novel pandemic forced humans to change their lifestyles. Scientists have broken through the vaccine in many countries, but the face mask is the only protection for public interaction. In this study, deep neural networks (DNN) have been employed to determine the persons wearing masks correctly. The faster region‐based convolutional neural networks (RCNN) model has been used to train the data using graphics processing unit (GPU) device. To achieve our goals, we used a multiphase detection model: first, to label the face mask, and second to detect the edge and compute edge projection for the chosen face region within the face mask. The current findings revealed that faster RCNN was efficient and precise, giving 97% accuracy. The overall loss after 200,000 epochs is 0.0503, with a trend to decrease. While the loss is falling, we are getting more accurate results. As a result, the faster RCNN technique effectively identifies whether a person is wearing face masks or not, and the training period was decreased with better accuracy. In the future, Deep Neural Network (DNN) might be used first to train the data and then compress the dimensions of the input to run it on low‐powered devices, resulting in a lower computational cost. Our proposed system can achieve high face detection accuracy and coarsely obtain face posture estimation based on the specified rule. The faster RCNN learning algorithm returns high precision, and the model’s lower computational cost is achieved on GPU. We use the “label‐image” application to label the photographs extracted from the dataset and apply Inception V2 of faster RCNN for face mask detection and classification.

Nowadays, the number of road accident in Malaysia is increasing expeditiously. One of the ways to reduce the number of road accident is through the development of the advanced driving assistance system (ADAS) by professional engineers. Several ADAS system has been proposed by taking into consideration the delay tolerance and the accuracy of the system itself. In this work, a traffic sign recognition system has been developed to increase the safety of the road users by installing the system inside the car for driver’s awareness. TensorFlow algorithm has been considered in this work for object recognition through machine learning due to its high accuracy. The algorithm is embedded in the Raspberry Pi 3 for processing and analysis to detect the traffic sign from the real-time video recording from Raspberry Pi camera NoIR. This work aims to study the accuracy, delay and reliability of the developed system using a Raspberry Pi 3 processor considering several scenarios related to the state of the environment and the condition of the traffic signs. A real-time testbed implementation has been conducted considering twenty different traffic signs and the results show that the system has more than 90% accuracy and is reliable with an acceptable delay.

The transportation sector is being transformed by the arrival of autonomous driving and advanced driver assistance systems (ADAS). The correct function of many of these systems relies heavily on detecting traffic signs which can be a life saver. In this article, different theoretical approaches to the detection and recognition of traffic signs are addressed. It covers the classical image processing methods, machine learning-based methods, and the state-of-the-art deep learning models. It also documents the difficulties which are encountered by systems in real world and gives the solution to increase the system potential to make it more robust and accurate. Keywords: traffic signs, driver assistance systems, technique, equalization.

Worldwide, traffic safety is a strong concern as traffic accidents are one of the leading causes of death. In this context, advanced driver assistance systems (ADAS) and autonomous vehicles are traffic management measures aimed at improving road safety and flow. Automatic detection and recognition of traffic signs are important for intelligent vehicles and ADAS systems. This work proposes a pipeline of digital image processing (DIP) techniques, machine learning (ML), and temporal coherence to perform the detection and recognition of Brazilian traffic signs in videos aiming an application for real-time systems to help in traffic safety and to reduce the number of fatal accidents. We are mainly interested in recognizing signs of speed limit group, no overtaking and obligatory passage, thus our detection considers the traffic sign with a circular shape and red border. For detection, the red color segmentation and the Hough transform are used to find circular regions that will be classified through the SVM algorithm in sign and not sign. For recognition of these signs, the support vector machines (SVM) are used. For speed limit signs the thresholding and contours are used to segment the digits for later classification. Our proposed method achieved an accuracy of 0.82 in detection, an increase of 18% in the number of recognized frames and 0.96 in the recognition stage using temporal coherence.

The YOLOv8 model has high detection efficiency and classification accuracy in detecting commutator surface defects, aimed at the problem of low working efficiency of a commutator, caused by commutator surface defects. First, the theoretical framework of Region-based Convolutional Neural Networks (R-CNN), spatial pyramid pooling (SPP)-net, Fast R-CNN, and Faster R-CNN is introduced, and the detection principle and process are described in detail. Secondly, the principle of the YOLOv8 network structure, head structure, neck structure, and C2f module are explained, and the loss function is described. The average precision of the proposed algorithm for detecting cracks and small points is more than 98%, and the frames per second (FPS) is 27. The detection results are mapped to the original image, and the visualization of the commutator surface defect detection is obtained, which has a higher robustness, accuracy, and real-time performance than the R-CNN, SPP-net, Fast R-CNN, and Faster R-CNN algorithms.

In the past few years, automatic building detection in aerial images has become an emerging field in computer vision. Detecting the specific types of houses will provide information in urbanization, change detection, and urban monitoring that play increasingly important roles in modern city planning and natural hazard preparedness. In this paper, we demonstrate the effectiveness of detecting various types of houses in aerial imagery using Faster Region-based Convolutional Neural Network (Faster-RCNN). After formulating the dataset and extracting bounding-box information, pre-trained ResNet50 is used to get the feature maps. The fully convolutional Region Proposal Network (RPN) first predicts the bounds and objectness score of objects (in this case house) from the feature maps. Then, the Region of Interest (RoI) pooling layer extracts interested regions to detect objects that are present in the images. To the best of our knowledge, this is the first attempt at detecting houses using Faster R-CNN that has achieved satisfactory results. This experiment opens a new path to conduct and extent the works not only for civil and environmental domain but also other applied science disciplines.

Locating roadworks sites via detecting change in lateral positions of traffic signs measured relative to the ego-car