Joint color space enhancement and vision transformer optimization for traffic sign classification

Traffic sign recognition systems based on the traditional deep learning technologies typically follow the complete data-driven mode, resulting in their unstable performances and significant security risks when applied to the real-world open scenarios. To alleviate this problem, a novel method is proposed by constructing the semantic data set based on road traffic sign design standards and using the zero-shot learning (ZSL) mechanism to develop a general TSR framework with reasoning and interpretation capabilities. This method can effectively overcome the problems of dynamic update of road traffic signs and classes missing in practice. Furthermore, the national standard for road traffic signs is used to abstract the general attributes of all classes and then the information is injected into the training process of traditional data-driven model as domain knowledge. With the help of domain knowledge, the proposed ZSL-based TSR method can recognize traffic signs that have not been seen in the training stage more accurately than random prediction and traditional deep learning models. Experimental results on the Chinese traffic sign database (CTSDB) and the German traffic sign recognition benchmark (GTSRB) demonstrate that our method, which trains a semantic auto-encoder model, can significantly improve the accuracy in traditional zero-shot learning settings. Specifically, when identifying previously unseen traffic signs in the training set, our approach achieves an improvement in accuracy of at least 29.96% and 24.25% on CTSDB and GTSRB, respectively, compared to random prediction. The study verifies the feasibility and effectiveness of the proposed scheme.

With the notion of smart cities transforming cities into digital societies and making people's lives easier in every way, Intelligent Transportation Systems have become an integral element among all. The Intelligent Transportation System (ITS) attempts to improve traffic efficiency by reducing congestion and ensuring the safety and comfort of commuters in real time. Traffic sign detection and recognition is one of the multifaceted conjunctive fields of research in ITS. In this paper, we address the issue of the TSR (traffic sign recognition) problem, i.e., classification of traffic signs along the roadside which plays a crucial role in developing advanced driver assistance and autonomous driving systems. CNN's network design has a huge impact on its performance and convergence. As a result, we use the Genetic Algorithm (GA) to automate the task of selecting a high-performance CNN (Convolutional Neural Network) Architecture for the GTSRB (German Traffic Sign Recognition Benchmark) dataset. The model is optimized through GA using multiple network configurations in the search space. Our model takes into account the limitations of the dataset, and we use certain data augmentation approaches to address the issues. We were able to attain an average accuracy of 98.2% which demonstrates the state-of-the-art performance on the publicly available dataset.KeywordsConvolutional neural networkGenetic algorithmMulticlass classificationDeep learningModel optimization

The legibility of traffic signs has been considered from the beginning of design, and traffic signs are easy to identify for humans. For computer systems, however, identifying traffic signs still poses a challenging problem. Both image‐processing and machine‐learning algorithms are constantly improving, aimed at better solving this problem. However, with a dramatic increase in the number of traffic signs, labelling a large amount of training data means high cost. Therefore, how to use a small number of labelled traffic sign data reasonably to build an efficient and high‐quality traffic sign recognition (TSR) model in the Internet‐of‐things–based (IOT‐based) transport system has been an urgent research goal. Here, the authors propose a novel semi‐supervised learning approach combining global and local features for TSR in an IOT‐based transport system. In their approach, histograms of oriented gradient, colour histograms (CH), and edge features (EF) are used to build different feature spaces. Meanwhile, on the unlabelled samples, a fusion feature space is found to alleviate the differences between different feature spaces. Extensive evaluations on a collection of signs from the German Traffic Sign Recognition Benchmark (GTSRB) dataset shows that the proposed approach outperforms the others and provides a potential solution for practical applications.

The correct and robust recognition of traffic signs is indispensable to self-driving vehicles and driver-assistant systems. In this work, we propose and evaluate two network architectures for multi-expert decision systems that we test on a challenging Traffic Sign Recognition Benchmark dataset. The decision systems implement individual experts in the form of deep convolutional neural networks (CNNs). A gating network CNN acts as final decision unit and learns which individual expert CNNs are likely to contribute to an overall meaningful classification of a traffic sign. The gating network then selects the outputs of those individual expert CNNs to be fused to form the final decision. In this work we study the advantages and challenges of the proposed multi-expert architectures that in comparison to other network architectures allow for parallel training of individual experts with reduced datasets. Under the challenging conditions introduced by the benchmark dataset, the demonstrated multi-expert decision systems achieve a recognition performance that is superior to those of humans: with an accuracy of 99.10%, when training experts with the complete dataset and 98.94%, when individual experts are only trained with 36% of the training samples. Overall, our approach ranked fourth on the list of the applied approaches proposed for the German traffic sign Recognition Benchmark (GTSRB) dataset.

To better understand the road condition and make correct driving decisions, traffic sign recognition becomes a crucial component commonly equipped in the vision system of modern autonomous cars. The state-of-the-art traffic sign recognition models are designed with the backbones of deep neural networks (DNNs) since DNNs are powerful to extract more effective visual features that benefit recognition performance. As the recent studies on adversarial attacks have shown that DNNs are easy to be fooled by perturbed images and lead to misclassification, in this article, we explore the vulnerability of the DNN-based traffic sign recognition model. Most existing adversarial attack methods limitedly focus on the white-box attack on the recognition models whose underlying configurations (e.g., network architectures and parameters) are accessible. Differently, we propose a novel attacking method dubbed adaptive square attack (ASA) that can accomplish the black-box attack, i.e., bypassing the access the configurations of the recognition models. Specifically, the proposed ASA method employs an efficient sampling strategy that can generate perturbations for traffic sign images with fewer query times. Extensive experiments on the benchmark data set German traffic sign recognition benchmark with large-scale traffic sign images for autonomous cars show that our proposed ASA method is advanced to perform the black-box attack with high efficiency. Although the generated adversarial traffic sign images by the proposed ASA method are visually similar to the raw images with almost imperceptible differences, they can successfully lead to the misclassification of the state-of-the-art recognition model.

To avoid road accidents and for safe driving, a proper traffic sign recognition and classification is necessary. It is also an important part of intelligent transport systems and driverless vehicles. This article outlines the different ways to recognize and classify traffic signs. Various types of algorithms are used to recognize text-based, shape-based and color-based traffic signs. With the development of Artificial Intelligence, deep learning models are becoming more popular. CNN models are used for both detection and classification. Self-driving cars must learn to obey road signs in order to drive safely and smoothly. A transfer learning-based approach to traffic sign recognition and classification is used to reduce data costs. This survey analyses different machine learning and deep learning based methods for traffic sign recognition. The traffic sign recognition and classifications are applicable in intelligent transport system, driving autonomous vehicle, conducting road surveys, improving road safety and infrastructure.

The ability of autonomous driving systems to recognize traffic signs in a variety of environmental conditions is crucial to their reliability. This study uses convolutional neural networks (CNNs) to provide a novel method for improving the accuracy of traffic sign recognition systems under challenging weather situations. The research focuses on developing a CNN-based model that is trained using the augmented German Traffic Sign Recognition Benchmark (GTSRB) dataset, which contains over 50,000 labeled images of road signs across 43 categories. To attempt to overcome the limitations of traditional CNN models under adverse environmental conditions, this work presents adaptive feature extraction layers that are especially made to reduce visibility problems brought on by rain, fog, and snow. By taking a comprehensive approach, the model uses advanced data augmentation methods to simulate different weather scenarios, greatly increasing the diversity of the training dataset. Through an analysis of theoretical and practical aspects, the study demonstrates how CNNs enhance the accuracy and efficiency of road sign detection systems in a different weather condition. Research evaluates the model's effectiveness using metrics such as precision, recall, and F1-score, proving its capability to reduce false positives and accurately detect relevant road sign instances. Additionally, the paper highlights the importance of careful dataset preparation and augmentation, model optimization, and training enhancements to improve the performance of road sign detection systems. The results of this research offer benefits for intelligent transport systems, autonomous driving, and road safety, pointing towards further advancements in precise and dependable road sign recognition technology.

Deep neural network for traffic sign recognition systems: An analysis of spatial transformers and stochastic optimisation methods

The transportation system has become a fascinating and active research topic due to its multiple problems; most prior research has focused on traffic forecasting, the advanced driver assistant system (ADAS), and self-driving vehicles. Traffic sign recognition (TSR) is an essential sub-system in ADAS that helps a driver better understand the surrounding environment (obstacles, frost, pedestrians). Automatic recognition of traffic signs is a real-world computer vision challenge and pattern recognition problem. Recently, deep architecture neural networks have shown robust solutions in many areas (health care, agriculture, transportation) due to their ability to handle large amounts of data and excel in complex systems. Therefore, a convolutional neural network (CNN) has been adopted, one of the best deep learning approaches in pattern recognition and image classification for TSR. The proposed architecture has been trained and tested on the German traffic sign recognition benchmark dataset (GTSRB). The results reported accuracy of 99.43% that outperformed human accuracy.KeywordsTraffic sign recognition (TSR)Advanced driver assistant system (ADAS)Deep learningConvolutional neural network (CNN)

There are many ideas to enhance the safety riding. Advanced Driver Assistance System (ADAS) is a system to help the driver more safety. ADAS has a purpose to assist and direct the driver in order to improve traffic safety. Traffic sign recognition is one important part of ADAS. Traffic sign is a warning sign which placed at the side or above the road to provide detail road information to the driver. In this study, we propose an unsupervised approach for traffic sign recognition based on bag-of-visual-word model. Unsupervised approach does not require label data and training process for traffic sign recognition. It helps when we have many data without label. Our experiment was conducted with dataset from German Traffic Sign Recognition Benchmark (GTSRB). It is a public dataset for traffic sign recognition. The results show that, large number of visual word enable the proposed method produce high accuracy and good quality cluster. Although the accuracy in this study is still very low. The reason for that is each image only produces 3–4 number of keypoints. Small size of the images affect the small number of keypoints.

This paper proposes the application of a swarm intelligence algorithm called Artificial Bee Colony (ABC) for the feature selection to feed a Random Forest (RF) classifier aiming to recognise Traffic Signs. In this paper, the authors define and assess several fitness functions for the feature selection stage. The idea is to minimise the correlation and maximise the entropy of a set of masks to be used for feature extraction results in a higher information gain and allows to reach recognition accuracies comparable with other state-of-art algorithms. The RF comprises as a committee based on decision trees, which allows handling large datasets and features with high performance, enabling a Traffic Sign Recognition (TSR) system oriented for real-time implementations. The German Traffic Sign Recognition Benchmark (GTSRB) was used for experiments, serving as a real basis for comparison of performance for the authors' proposal.

Considering that most convolutional neural network (CNN) models designed for traffic sign recognition (TSR) have sacrificed more resources and complicated network model development while pursuing higher performance, LeNet-5 shallow CNN with low complexity has been selected for improvement. Increasing the number of convolution kernel in the first convolution layer (C1 layer) and the third convolution layer (C3 layer) while reducing the size of the convolution kernel in C3 layer. Introducing Rectified Linear Unit (ReLU) function with better performance. The maximum pooling is introduced instead of mean pooling. Besides, the output layer employs support vector machine (SVM) to shorten the operation time. The research results demonstrate that the improved LeNet-5 network has an identification accuracy rate of 98.12% and the identification time is 0.154s for traffic signs in German Traffic Sign Recognition Benchmark (GTSRB), which could guarantee the real-time performance of the system and effectively reduce the complexity of the system on the basis of a high recognition rate.

Traffic sign detection and recognition systems include a variety of applications like autonomous driving, road sign inventory, and driver support systems. Machine learning algorithms provide useful tools for traffic sign identification tasks. However, classification algorithms depend on the preprocessing stage to obtain high accuracy rates. This paper proposes a road sign characterization method based on oriented gradient maps and the Karhunen-Loeve transform in order to improve classification performance. Dimensionality reduction may be important for portable applications on resource constrained devices like FPGAs; therefore, our approach focuses on achieving a good classification accuracy by using a reduced amount of attributes compared to some state-of-the-art methods. The proposed method was tested using German Traffic Sign Recognition Benchmark, reaching a dimensionality reduction of 99.3% and a classification accuracy of 95.9% with a Multi-Layer Perceptron.

Autonomous driving cars are booming these days and the demand for a robust traffic sign recognition system that assures safety by recognizing traffic signs accurately and fast is increasing. We all must have heard about self-driving cars in which the passenger can fully depend on the car for traveling. But to achieve level 5 autonomy, it is necessary for all the vehicles to understand and follow the traffic rules. In the global world of Artificial Intelligence (AI) and advancement in technologies, many researchers and big companies like Tesla, Uber, Google, Mercedes-Benz, Toyota, Ford, Audi, etc are working on autonomous vehicles and self-driving cars Here in this paper we planned to use CNN (convolution_neural_network) algorithm is a part of a deep learning model to classify the images present in the dataset into different categories. It can classify 43 different signs of traffic from the German Traffic Sign Recognition benchmark dataset.

An accident is the cry of a lifetime. The role of traffic signs is most important in preventing or mitigating accidents. In many cases, while driving, traffic signs are not visible in the conventional approach; if traffic sign detection and recognition can alert the driver of important sign guidance ahead, it will help in accident mitigation. Traffic sign recognition plays a monumental role in expert systems, such as traffic assistance driving systems and automatic driving systems. The prime purpose of this paper is to design and identify a computer-based system that can spontaneously detect the direction of a road sign. For this research work, we have created our own dataset, which is called the Bangladeshi Traffic Sign Recognition Benchmark (BTSRB) dataset. The dataset, BTSRB, was created by capturing images from different angles and under different parameters and conditions. A total of 7320 images were collected to create this comprehensive database. This dataset called BTSRB all the images collected from Bangladesh. In this paper, we used five different types of models (CNN, Inception V3, MobileNetV2, ResNet50, and VGG16), which are pre-trained on the ImageNet dataset. Later, we finetuned the pre-trained model and used transfer learning. The main challenge of this research is collecting datasets from a country like Bangladesh, where no recognized dataset is available. When compared to another model, the accuracy of this model is greater than 91%. This paper emphasizes the significance of traffic sign recognition in expert systems and the necessity for a well-established dataset in nations where such resources are not readily available.