A Deep Learning-based Framework for Vehicle License Plate Detection

Due to the impact of pollution, environment and so on in actual scene, it is difficult for the traditional single feature recognition model to obtain a higher accuracy of the license plate recognition. The paper proposed a new license plate image recognition model. First, the structural features and gray level features of the license plate, such as the contour and stroke order are extracted. Then, the principal component analysis is used to carry out the fusion, dimensionality reduction and redundancy removal processing for the two kinds of features, and a fuzzy fusion model for differentiated features is introduced to ensure minimal loss for the feature in fusion. Finally, the final result of the license plate image recognition is achieved in accordance with high degree of confidence criterion when the slope interference of the license plate is considered fully. Simulation results show that the license plate image recognition model based on multi-feature combination can solve the problem of the single feature recognition model, improve the accuracy of license plate recognition which is up to 99%. Moreover, the model has a faster recognition speed and can be applied to the actual license plate recognition. DOI : http://dx.doi.org/10.11591/telkomnika.v12i4.4307

The paper is devoted to the problem of automatic detection and recognition of license plates, the solution of which has many potential applications, from security to traffic management. The purpose of this work was to compare the methods of finding and recognizing car number plates, based on the application of deep learning algorithms, which takes into account different regional standards of car number plates, video quality, different speeds of vehicles, the location of the camera in relation to the vehicle license plate, defects of the car number plate (pollution , deformation), as well as changes in external lighting conditions. The advantages and disadvantages of localization and segmentation of car number plates on cars using image binarization, Viola–Jones and Harr methods are given. It was determined that adaptive approaches are better due to the possibility of compensating the impact of obstacles on different areas of the image, for example, the distribution of shadows due to the heterogeneity of illumination. It was determined that many methods in real algorithms rely directly or indirectly on the presence of number limits. Even if the limits are not used when the number is determined, they have the possibility to be used for further analysis. The methods of templates, image histograms, and contour analysis were compared to identify familiar features in the image (segmentation). It is shown that an effective approach for recognition of car license plates can be based on the application of the methods of Viola-Jones, Harr, the analysis of brightness histograms and the SVM method. Formulated conclusions on the effectiveness of the implementation of each of the procedures were confirmed as a result of conducting experiments with the developed software in the python 3 language using the cv2 computer vision library. The described approach makes it possible to obtain a fairly high recognition accuracy at different angles of rotation of the license plate relative to the camera. Keywords: automatic recognition, license plates, localization, normalization, segmentation, character recognition.

The license plate angle is unfixed, the vehicle position is ununiform, and the picture is not sufficiently illuminated which leads to the decrease of license plate recognition accuracy. In order to improve the accuracy of license plate recognition, a deep learning-based license plate recognition method is proposed. For license plate location problem, YOLOv3 algorithm is used. The algorithm is more capable of recognizing small targets and is suitable for license plate location recognition that requires precise positioning. For the problem of license plate character recognition, the CNN plus multitask recognition method is proposed for recognition. The experimental results show that the accuracy of the license plate recognition method proposed in this paper reaches 96%, and the intelligent license plate recognition is realized.

CIS Multilingual License Plate Detection and Recognition Based on Convolutional and Transformer Neural Networks

Advances in both parallel processing capabilities because of graphical processing units (GPUs) and computer vision algorithms have led to the development of deep neural networks (DNN) and their utilization in real-world applications. Starting from the LeNet-5 architecture of the 1990s, modern deep neural networks may have tens to hundreds of layers to solve complex problems such as license plate detection or recognition tasks. In this manuscript, we present a review of the state-of-the-art methods related to automatic license plate recognition. Since deep networks have demonstrated a remarkable ability to outperform other machine learning techniques, we focus only on neural network based license plate recognition methods. We highlight the particular types of networks, i.e., convolutional, residual recurrent, or long-short-term-memory, used for the specific tasks of license plate detection, extraction, or recognition in different existing works. The presented summary also highlights some of the most widely used data sets for comparison and shares the results reported in the reviewed papers. We also give an overview of the effects of fog, motion, or the use of synthetic data on license plate recognition. Finally, promising directions for future research in this domain are presented.

Background: Most previous studies in automatic license plate recognition (ALPR) focused on recognizing license plate (LP) in constrained environment where cameras are installed in front of LPs and other conditions such as lighting, weather, and image quality are satisfied. Besides, recent studies on ALPR in Vietnam have conducted in small datasets and have not covered various cases of Vietnamese LPs.Aim: To develop a model for ALPR that is effective in unconstrained environment in Vietnam.Method: We propose two improvements: We apply the idea of the key-point detection problem for LP detection part, and use a segmentation free approach based on encoder decoder network for the LP optical character recognition (OCR) part. We train and evaluate models in a large dataset collected from unconstrained environment.Results: Our results show improvements in LP detection accuracy with mean IOU mIOU = 95.01% and precision P <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">75</inf> = 99, 5%. The accuracy in LP OCR was up to Acc <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">seq</inf> = 99.28% at sequence level and Acc <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">char</inf> = 99.7% at character level.Conclusion: We provide a large dataset of Vietnamese LP images that can be effectively used to evaluate ALPR systems in Vietnam, and proposes improvement techniques to tackle problems of ALPR in unconstrained environment in Vietnam.

Almost every vehicle has currently installed black box since the stored images by black box can be used to investigate the exact cause of the accident. One of the most important aspects in an accident investigation is the license plate detection and recognition as the license plate has information about the driver and car. This paper presents a novel algorithm for license plate detection and recognition using black box image. The proposed license plate recognition system is divided into three stages: license plate detection, individual number and character extraction, and number and character recognition. The Gaussian blur filter is used to remove noise in the image and then we detect the license plate edge using modified Canny algorithm. Second, we determine license plate candidate image using morphology and support vector machine. Finally, we recognize the numbers and characters using k-nearest neighbor classifier. The experimental study results indicate that the license plate detection and recognition algorithm has been successfully implemented.

Traditional license plate recognition technology mostly uses traditional image processing methods to find out the characteristics of the license plate, and then crop and recognize the characters. The process needs to be modified due to the different environments, scenes and conditions. In recent years, many studies have implemented license plate and character recognition by using deep learning algorithms. Although it has a good recognition accuracy, the calculation speed still cannot reach the level of real-time recognition. This research proposes a real-time license plate recognition system based on YOLOv3, which uses deep learning model to realize the vehicle license plate recognition, lane identification and vehicle trajectory tracking. In this study, a web-based platform is established to present the result of license plate recognition and trajectory, and the streaming roadside video in the campus. In the platform, license plates of driving vehicles can be identified in real-time, and the user can search and track specific vehicle intuitively. In the experiment, the average accuracy of the system performs 84.3% in real-time license plate recognition, and 100% in lane identification. The system can process in 40 FPS, which can meet the level of real-time system. In the future, the system can cooperate with traffic access control in campus or community to improve the efficiency of traffic control.

This paper presents an efficient method for license plate detection and recognition that will aid in the development of an intelligent transport system. To significantly accelerate license plate localization a simple image pre-processing method is first used without reducing detection performance compared with that obtained using original image. Line density filter approach is used to extract the license plate regions, there by significantly reducing area to be analysed for license plate localization. In license plate recognition, the characters are recognized from these detected license plates by using optical character recognition and the owner details are displayed. The aim of this paper is to serve the purpose of accurately localizing vehicle license plates from complex scenes in real time that would help motor vehicle department in various ways.

The intent of this research is to design a license plate recognition (LPR) system in the domain of Bangla language for smart vehicle management. The proposed system is designed on the basis of computer vision tools and deep supervised machine learning model. The system has three modules: license plate detection, character segmentation and recognition of the characters of the License Plate (LP). The goal of detection is to localize the plate area from the vehicle image and to crop region of interest (LP). It is executed by applying following process: preprocessing the image, conversion to binary image, contour detection and filtering the contours to get the LP's character contours, tilt correction and cropping the plate area from the image. Then, the cropped LP is segmented to extract the characters from the plate. Finally, the recognition step classifies the characters by means of deep convolution neural network where the features of the character are crafted and learned by the convolution layers of the networks. The system is implemented in Python OpenCV environment for offline car license plates images which are taken in different illuminations, road scenarios and colored cars. The system performance is evaluated in terms of detection rate, segmentation rate, recognition rate and execution time. The results illustrate that the performance of the system is remarkable.

Automated reading of license plate and its detection is a crucial component of the competent transportation system. Toll payment and parking management e-payment systems may benefit from this software’s features. License plate detection and identification algorithms abound, and each has its own set of strengths and weaknesses. Computer vision has advanced rapidly in terms of new breakthroughs and techniques thanks to the emergence and proliferation of deep learning principles across several branches of AI. The practice of automating the monitoring process in traffic management, parking management, and police surveillance has become much more effective thanks to the development of Automatic License Plate Recognition (ALPR). Even though license plate recognition (LPR) is a technology that is extensively utilized and has been developed, there is still a significant amount of work to be done before it can achieve its full potential. In the last several years, there have been substantial advancements in both the scientific community’s methodology and its level of efficiency. In this era of deep learning, there have been numerous developments and techniques established for LPR, and the purpose of this research is to review and examine those developments and approaches. In light of this, the authors of this study suggest a four-stage technique to automated license plate detection and identification (ALPDR), which includes, image pre-processing, license plate extraction, character segmentation, and character recognition. And the first three phases are known as “extraction,” “pre-processing,” and “segmentation,” and each of these processes has been shown to benefit from its own unique technique. In light of the fact that character recognition is an essential component of license plate identification and detection, the Convolution Neural Network (CNN), MobileNet, Inception V3, and ResNet 50 have all been put through their paces in this regard.

In urban environments, the issue of unauthorized parking in designated no-parking zones persists, leading to traffic congestion and safety hazards. inaccurate license plate recognition, License plate (LP) detection is a crucial task for Automatic License Plate Recognition (ALPR) systems. Most existing LP detection networks can detect License plates, but their accuracy suffers when license plates (LPs) are tilted or deformed due to perspective distortion. This leading to difficulties in identifying vehicle owners. To address this challenge, this project present TraceMe, a predictive system utilizing advanced machine learning algorithms. The system employs YOLOv8 for efficient object detection, focusing on identifying vehicles in no-parking zones, and Tesseract OCR for accurate license plate recognition. The extracted license plate information is then processed by a machine learning model trained to predict the owner of the vehicle. The proposed system involves collecting and annotating a diverse dataset, training YOLOv8 and LPRNet model for vehicle number plate detection, utilizing Tesseract OCR for license plate extraction, and implementing a machine learning model for owner identification. Real-time processing and integration with surveillance systems allow for immediate identification of unauthorized parking incidents. The system generates alerts or notifications, aiding law enforcement in enforcing parking regulations.TraceMe not only provides a technological solution to mitigate unauthorized parking but also contributes to improved traffic management and public safety.

Automatic License Plate Recognition (ALPR) has been the focus of many\nresearches in the past years. In general, ALPR is divided into the following\nproblems: detection of on-track vehicles, license plates detection, segmention\nof license plate characters and optical character recognition (OCR). Even\nthough commercial solutions are available for controlled acquisition\nconditions, e.g., the entrance of a parking lot, ALPR is still an open problem\nwhen dealing with data acquired from uncontrolled environments, such as roads\nand highways when relying only on imaging sensors. Due to the multiple\norientations and scales of the license plates captured by the camera, a very\nchallenging task of the ALPR is the License Plate Character Segmentation (LPCS)\nstep, which effectiveness is required to be (near) optimal to achieve a high\nrecognition rate by the OCR. To tackle the LPCS problem, this work proposes a\nnovel benchmark composed of a dataset designed to focus specifically on the\ncharacter segmentation step of the ALPR within an evaluation protocol.\nFurthermore, we propose the Jaccard-Centroid coefficient, a new evaluation\nmeasure more suitable than the Jaccard coefficient regarding the location of\nthe bounding box within the ground-truth annotation. The dataset is composed of\n2,000 Brazilian license plates consisting of 14,000 alphanumeric symbols and\ntheir corresponding bounding box annotations. We also present a new\nstraightforward approach to perform LPCS efficiently. Finally, we provide an\nexperimental evaluation for the dataset based on four LPCS approaches and\ndemonstrate the importance of character segmentation for achieving an accurate\nOCR.\n

Automatic license plate recognition (ALPR) is a process of identification of the license plate from an image taken at any signal stop or parking station. The Identified information or the number plate can be used for keeping a check on signal stops or for monetary settlements at parking lots or toll stations. It can also be used around the world for law and administrative works like checking a vehicle if it is registered or not. It also finds its use in safety supervision system. The ALPR can be used upon various types of pictures like color images, black and white images and etc. ALPR may fail a number of times if the quality of the picture is not up to the mark. So, ALPR depend a lot in the image quality, and hence the challenges in its real-life application. It may be used both indoors and outdoors but it must be able to process the images both quickly and successfully in all sorts of environments, be it daytime or night time, sunny or rainy. Our proposed method mainly has three modules: 1) Detection of license plate 2) Segmentation of Characters 3) Text Box Generation. The number plates sometimes may be unclear for the cameras. It may sometimes have dirt and scratches on it and thus increasing the complexities of the ALPR system. Today nationwide ALPR has been adopted by several law and governmental agencies for its efficiency and usefulness. Public safety agencies are using the ALPR system to gather and store relevant information about people and to keep a check on the vehicular activities. It is becoming a significant tool for the Law Enforcement Agencies.

License plate recognition is a crucial mission in computer vision, and deep learning has significantly improved its performance. A representative license plate recognition system involves five components: license plate image preprocessing, image acquisition, license plate detection, character recognition, and character segmentation. This paper will explore the methods commonly used in each stage of the recognition process and analyze some of the current challenges and future trends of license plate recognition. This discussion will consider real-world factors such as lighting and weather conditions that can affect recognition accuracy. Ultimately, it is hoped that these insights will contribute to the development of intelligent transportation systems.