Segmentation of characters on car license plates

Automatic License Plate Recognition (ALPR) has been the focus of many\nresearches in the past years. In general, ALPR is divided into the following\nproblems: detection of on-track vehicles, license plates detection, segmention\nof license plate characters and optical character recognition (OCR). Even\nthough commercial solutions are available for controlled acquisition\nconditions, e.g., the entrance of a parking lot, ALPR is still an open problem\nwhen dealing with data acquired from uncontrolled environments, such as roads\nand highways when relying only on imaging sensors. Due to the multiple\norientations and scales of the license plates captured by the camera, a very\nchallenging task of the ALPR is the License Plate Character Segmentation (LPCS)\nstep, which effectiveness is required to be (near) optimal to achieve a high\nrecognition rate by the OCR. To tackle the LPCS problem, this work proposes a\nnovel benchmark composed of a dataset designed to focus specifically on the\ncharacter segmentation step of the ALPR within an evaluation protocol.\nFurthermore, we propose the Jaccard-Centroid coefficient, a new evaluation\nmeasure more suitable than the Jaccard coefficient regarding the location of\nthe bounding box within the ground-truth annotation. The dataset is composed of\n2,000 Brazilian license plates consisting of 14,000 alphanumeric symbols and\ntheir corresponding bounding box annotations. We also present a new\nstraightforward approach to perform LPCS efficiently. Finally, we provide an\nexperimental evaluation for the dataset based on four LPCS approaches and\ndemonstrate the importance of character segmentation for achieving an accurate\nOCR.\n

License plate recognition is currently used in various situations, such as parking lot vehicle management and the tracking of wanted vehicles. These applications require recognition from all possible camera angles. Therefore, we propose a method for license plate recognition in images captured from various camera angles. First, the license plate area is detected from the input image using the YOLOv5 object detection method. The subsequent process can be performed in two manners: by rotating the license plate to the front using projective transformation and trapezoidal correction, or by using graph matching. The first method performs Hough transforms or linear approximations as preprocessing, and then calculates the rectangle surrounding the license plate from the YOLOv5 output. After performing trapezoidal correction, the maximally stable extremal regions (MSER) are used to detect character candidates, and characters are recognized using 3D rotated character recognition. The second method performs character candidate detection and recognition without trapezoidal correction, followed by graph matching. These methods are versatile because they do not depend on the layout of license plates, which varies among countries and regions. Two types of datasets were used: a set of images containing Japanese license plates collected by ourselves, and a set of publicly available images containing Taiwanese license plates. Two recognition rates were evaluated: the license plate character recognition rate and license plate recognition rate in which all characters in one plate are recognized. The license plate character recognition rates using graph matching were 91.9% for the Japanese license plates and 89.3% for the Taiwanese license plates. The license plate recognition rates were 84.0% and 84.5%, respectively.

Traditional license plate recognition technology mostly uses traditional image processing methods to find out the characteristics of the license plate, and then crop and recognize the characters. The process needs to be modified due to the different environments, scenes and conditions. In recent years, many studies have implemented license plate and character recognition by using deep learning algorithms. Although it has a good recognition accuracy, the calculation speed still cannot reach the level of real-time recognition. This research proposes a real-time license plate recognition system based on YOLOv3, which uses deep learning model to realize the vehicle license plate recognition, lane identification and vehicle trajectory tracking. In this study, a web-based platform is established to present the result of license plate recognition and trajectory, and the streaming roadside video in the campus. In the platform, license plates of driving vehicles can be identified in real-time, and the user can search and track specific vehicle intuitively. In the experiment, the average accuracy of the system performs 84.3% in real-time license plate recognition, and 100% in lane identification. The system can process in 40 FPS, which can meet the level of real-time system. In the future, the system can cooperate with traffic access control in campus or community to improve the efficiency of traffic control.

Background: Most previous studies in automatic license plate recognition (ALPR) focused on recognizing license plate (LP) in constrained environment where cameras are installed in front of LPs and other conditions such as lighting, weather, and image quality are satisfied. Besides, recent studies on ALPR in Vietnam have conducted in small datasets and have not covered various cases of Vietnamese LPs.Aim: To develop a model for ALPR that is effective in unconstrained environment in Vietnam.Method: We propose two improvements: We apply the idea of the key-point detection problem for LP detection part, and use a segmentation free approach based on encoder decoder network for the LP optical character recognition (OCR) part. We train and evaluate models in a large dataset collected from unconstrained environment.Results: Our results show improvements in LP detection accuracy with mean IOU mIOU = 95.01% and precision P <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">75</inf> = 99, 5%. The accuracy in LP OCR was up to Acc <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">seq</inf> = 99.28% at sequence level and Acc <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">char</inf> = 99.7% at character level.Conclusion: We provide a large dataset of Vietnamese LP images that can be effectively used to evaluate ALPR systems in Vietnam, and proposes improvement techniques to tackle problems of ALPR in unconstrained environment in Vietnam.

Automated reading of license plate and its detection is a crucial component of the competent transportation system. Toll payment and parking management e-payment systems may benefit from this software’s features. License plate detection and identification algorithms abound, and each has its own set of strengths and weaknesses. Computer vision has advanced rapidly in terms of new breakthroughs and techniques thanks to the emergence and proliferation of deep learning principles across several branches of AI. The practice of automating the monitoring process in traffic management, parking management, and police surveillance has become much more effective thanks to the development of Automatic License Plate Recognition (ALPR). Even though license plate recognition (LPR) is a technology that is extensively utilized and has been developed, there is still a significant amount of work to be done before it can achieve its full potential. In the last several years, there have been substantial advancements in both the scientific community’s methodology and its level of efficiency. In this era of deep learning, there have been numerous developments and techniques established for LPR, and the purpose of this research is to review and examine those developments and approaches. In light of this, the authors of this study suggest a four-stage technique to automated license plate detection and identification (ALPDR), which includes, image pre-processing, license plate extraction, character segmentation, and character recognition. And the first three phases are known as “extraction,” “pre-processing,” and “segmentation,” and each of these processes has been shown to benefit from its own unique technique. In light of the fact that character recognition is an essential component of license plate identification and detection, the Convolution Neural Network (CNN), MobileNet, Inception V3, and ResNet 50 have all been put through their paces in this regard.

With the increasing advancement of science and technology, the popularity of automobiles in my country has gradually increased. Among them, license plate positioning and license plate recognition technology are very important key technologies in the license plate recognition system. Through the license plate positioning technology, the position information, centroid and other data information of the license plate can be obtained, so as to realize the positioning of the license plate. The license plate recognition technology can extract the uniqueness of the vehicle. Identifying the license plate number, so the design and implementation of vehicle recognition and license plate recognition technology based on embedded devices have practical significance and practical application value to promote the technological progress of intelligent transportation and vehicle recognition systems. This design is a license plate recognition system, an embedded character segmentation recognition processing platform with ARM Cortex-A9 as the core, and the method of cross-compiling OpenCV, Qt, BootLoader in the Linux operating system, and transplanting related drivers to the ARM Cortex-A9 platform; Based on the classic algorithm, the OpenCV library function is used to realize the segmentation and recognition of the license plate image characters. The experimental results show that the design has achieved the expected goal.

The paper is devoted to the problem of automatic detection and recognition of license plates, the solution of which has many potential applications, from security to traffic management. The purpose of this work was to compare the methods of finding and recognizing car number plates, based on the application of deep learning algorithms, which takes into account different regional standards of car number plates, video quality, different speeds of vehicles, the location of the camera in relation to the vehicle license plate, defects of the car number plate (pollution , deformation), as well as changes in external lighting conditions. The advantages and disadvantages of localization and segmentation of car number plates on cars using image binarization, Viola–Jones and Harr methods are given. It was determined that adaptive approaches are better due to the possibility of compensating the impact of obstacles on different areas of the image, for example, the distribution of shadows due to the heterogeneity of illumination. It was determined that many methods in real algorithms rely directly or indirectly on the presence of number limits. Even if the limits are not used when the number is determined, they have the possibility to be used for further analysis. The methods of templates, image histograms, and contour analysis were compared to identify familiar features in the image (segmentation). It is shown that an effective approach for recognition of car license plates can be based on the application of the methods of Viola-Jones, Harr, the analysis of brightness histograms and the SVM method. Formulated conclusions on the effectiveness of the implementation of each of the procedures were confirmed as a result of conducting experiments with the developed software in the python 3 language using the cv2 computer vision library. The described approach makes it possible to obtain a fairly high recognition accuracy at different angles of rotation of the license plate relative to the camera. Keywords: automatic recognition, license plates, localization, normalization, segmentation, character recognition.

This paper presents a robust real time feature based algorithm for localization and recognition of multiple color and font style license plates. The algorithm uses digitized license plate images for robust detection and recognition. The resolution of the captured image is adjusted and the brightness and contrast are set to appropriate levels. An optimal threshold is applied to detect white regions of the enhanced image. The algorithm uses segmentation and component labeling to create candidate regions intelligently. For localization of the license plate, features of each region are extracted and analyzed by rectangularity percentage of the automobile's license plate. The use of color filter renders the algorithm more robust on license plate localization. Moreover, we use HSV color space to find the specific color regions. After localization of license plate in small sized image, the proposed algorithm uses rapid intelligent method for localization of license plate form the original image. The localized license plate image is cropped and processed by the recognition algorithm. Each character's region is identified by using segmentation algorithm based on the profile which includes character dilation and resizing for subsequent operations. In this paper, correlation optical character recognition and multi-layer perception neural networks techniques are used for recognizing the characters. The performance of the proposed algorithm is acceptable even in low-quality or bad light images.

Smart cities must have all the important characteristics to achieve their intended goals. Proper traffic management and controlling, increased surveillance and safety, and enhanced management and avoidance of incidents must be the priorities of smart cities. Meanwhile, license plate recognition (LPR) has become the most debatable topic in the research community due to various real-time applications, such as “law enforcement, toll-free processing, access control, and traffic surveillance.” Automated LPR is a technique based on computer vision to recognize vehicles with their number plates. This study discusses various “Deep Learning based LPR” techniques to detect and identify “alphanumeric characters” in number plate. The projected model works on “license based detection” and “character recognition.” This technique uses “Optical Character Recognition (OCR)” technology to detect and extract the alphanumerical numbers from the license plate. This study is based on secondary data collected from various studies conducted on Licence Plate Recognition using various Deep Learning models published in databases like Google Scholar, Science Direct, NCBI, etc. Deep learning has been used widely in applications related to computer vision in recent years with great perfection. It is a great solution for modern and traditional image processing, object detection, and feature extraction issues. It has been widely used in different stages of LPR like character segmentation, license plate recognition, and OCR.

The city's efforts to improve traffic make a big step forward when license plates can be read. It explains how an intelligent transportation system should work and what steps should be taken for it to be successful. Because the number of cars is growing so quickly, ANPR is a must-have for managing traffic control. Automatic number plate recognition (ANPR) is mostly used to keep an eye on traffic and keep people safe. Number plate recognition uses image processing and the most recent advances in technology to automatically read the characters on a vehicle's license plate. In the last few years, there have been a number of technological advances in the field of studying how to read license plates. Image processing techniques like OCR make it possible for traffic surveillance to solve a wide range of problems that come up during criminal investigations, the collection of tolls, the monitoring of traffic, the regulation of speed, and the management of parking, among other things. If you want to control traffic and keep an eye on a large number of people in a transportation system, you need an ANPR system. Image processing techniques and the collection of photos of vehicles for use in the dataset have made it possible to keep an eye on traffic on a large scale. Automatic License Plate Reader (ANPR) is a way to take the steps needed to run a good intelligent transportation network. Traffic control has become an absolute must because the number of cars has grown so quickly. The main goal of ANPR is to keep an eye on and record traffic for defense purposes. To read the text on license plates, number plate recognition uses image processing, optical character recognition (OCR), and edge detection technology. The model is made up of three different parts called, respectively, the module for car detection, the module for license plate segmentation, and the module for recognition. Image processing made us more determined to stop a wide range of illegal activities, such as armed robberies of cars, breaking traffic rules, and the way law enforcement is handled. This review study looked at all of the different designs for reading license plates that have been put into use so far.

This paper presents an efficient method for license plate detection and recognition that will aid in the development of an intelligent transport system. To significantly accelerate license plate localization a simple image pre-processing method is first used without reducing detection performance compared with that obtained using original image. Line density filter approach is used to extract the license plate regions, there by significantly reducing area to be analysed for license plate localization. In license plate recognition, the characters are recognized from these detected license plates by using optical character recognition and the owner details are displayed. The aim of this paper is to serve the purpose of accurately localizing vehicle license plates from complex scenes in real time that would help motor vehicle department in various ways.

The intent of this research is to design a license plate recognition (LPR) system in the domain of Bangla language for smart vehicle management. The proposed system is designed on the basis of computer vision tools and deep supervised machine learning model. The system has three modules: license plate detection, character segmentation and recognition of the characters of the License Plate (LP). The goal of detection is to localize the plate area from the vehicle image and to crop region of interest (LP). It is executed by applying following process: preprocessing the image, conversion to binary image, contour detection and filtering the contours to get the LP's character contours, tilt correction and cropping the plate area from the image. Then, the cropped LP is segmented to extract the characters from the plate. Finally, the recognition step classifies the characters by means of deep convolution neural network where the features of the character are crafted and learned by the convolution layers of the networks. The system is implemented in Python OpenCV environment for offline car license plates images which are taken in different illuminations, road scenarios and colored cars. The system performance is evaluated in terms of detection rate, segmentation rate, recognition rate and execution time. The results illustrate that the performance of the system is remarkable.

Development of high quality license plate recognition system is a challenging task, not fully solved nowadays. License plate recognition process consists of the following steps: license plate detection, individual characters segmentation and recognition. This paper contains methods, connected with license plate allocation, segmentation and characters recognition. The noise on the plate and its angular inclination are main problems raised during developing such systems. In this article a new method of license plate recognition is presented. The proposed method includes preliminary image filtering, connected component method for segmentation and hierarchical temporal memory model for recognition. Image prefiltering improves the efficiency of subsequent binarization. Generally, license plate segmentation is provided by the histogram method, with different angles of inclination of the registration plate. As a result the rotation of the plate reduces the image quality. The connected component method eliminates rotation from this process, and provides no loss of image quality. Separate symbols can be represented under a small angle after such segmentation, which could complicate their identification. However, the application of the hierarchical temporal memory model for character recognition, previously trained at the sloping characters images, gives positive results. The proposed algorithms can also be used for distorted text segmentation and recognition.

In this paper, we present a new design flow for robust license plate localization and recognition. The algorithm consists of three stages: 1) license plate localization; 2) character segmentation; and 3) feature extraction and character recognition. The algorithm uses Mexican hat operator for edge detection and Euler number of a binary image for identifying the license plate region. A pre-processing step using median filter and contrast enhancement is employed to improve the character segmentation performance in case of low resolution and blur images. A unique feature vector comprised of region properties, projection data and reflection symmetry coefficient has been proposed. Back propagation artificial neural network classifier has been used to train and test the neural network based on the extracted feature. A thorough testing of algorithm is performed on a database with varying test cases in terms of illumination and different plate conditions. Practical considerations like existence of another text block in an image, presence of dirt or shadow on or near license plate region, license plate with rows of characters and sensitivity to license plate dimensions have been addressed. The results are encouraging with success rate of 98.10% for license plate localization and 97.05% for character recognition.

Automatic License Plate Recognition (ALPR) is a growing research area as with the increase in the number of vehicles, requirements for high accuracy ALPR systems are increasing as it has been extensively used for automatic road tax collection, monitor unlike activities etc. Character segmentation is a major step in the ALPR system. This paper includes the use of image pre-processing techniques, K-means clustering, Otsu and Niblack method and Connected Component Analysis (CCA) to perform character segmentation. Unlike existing works which are based on license plates of other countries and therefore may not perform well on Indian license plates, in this work we have dealt with Indian license plates. Many of the existing works are based on license plates that are captured from a straight angle and good illumination and hence may not perform well if the images of license plates have noises or are captured at different angles. Therefore, in this work we have used license plates which are at different angles with different lighting conditions.