Video-Based License Plate Recognition Using Single Shot Detector and Recurrent Neural Network

With the increasing advancement of science and technology, the popularity of automobiles in my country has gradually increased. Among them, license plate positioning and license plate recognition technology are very important key technologies in the license plate recognition system. Through the license plate positioning technology, the position information, centroid and other data information of the license plate can be obtained, so as to realize the positioning of the license plate. The license plate recognition technology can extract the uniqueness of the vehicle. Identifying the license plate number, so the design and implementation of vehicle recognition and license plate recognition technology based on embedded devices have practical significance and practical application value to promote the technological progress of intelligent transportation and vehicle recognition systems. This design is a license plate recognition system, an embedded character segmentation recognition processing platform with ARM Cortex-A9 as the core, and the method of cross-compiling OpenCV, Qt, BootLoader in the Linux operating system, and transplanting related drivers to the ARM Cortex-A9 platform; Based on the classic algorithm, the OpenCV library function is used to realize the segmentation and recognition of the license plate image characters. The experimental results show that the design has achieved the expected goal.

The intent of this research is to design a license plate recognition (LPR) system in the domain of Bangla language for smart vehicle management. The proposed system is designed on the basis of computer vision tools and deep supervised machine learning model. The system has three modules: license plate detection, character segmentation and recognition of the characters of the License Plate (LP). The goal of detection is to localize the plate area from the vehicle image and to crop region of interest (LP). It is executed by applying following process: preprocessing the image, conversion to binary image, contour detection and filtering the contours to get the LP's character contours, tilt correction and cropping the plate area from the image. Then, the cropped LP is segmented to extract the characters from the plate. Finally, the recognition step classifies the characters by means of deep convolution neural network where the features of the character are crafted and learned by the convolution layers of the networks. The system is implemented in Python OpenCV environment for offline car license plates images which are taken in different illuminations, road scenarios and colored cars. The system performance is evaluated in terms of detection rate, segmentation rate, recognition rate and execution time. The results illustrate that the performance of the system is remarkable.

Automatic License Plate Recognition (ALPR) is a growing research area as with the increase in the number of vehicles, requirements for high accuracy ALPR systems are increasing as it has been extensively used for automatic road tax collection, monitor unlike activities etc. Character segmentation is a major step in the ALPR system. This paper includes the use of image pre-processing techniques, K-means clustering, Otsu and Niblack method and Connected Component Analysis (CCA) to perform character segmentation. Unlike existing works which are based on license plates of other countries and therefore may not perform well on Indian license plates, in this work we have dealt with Indian license plates. Many of the existing works are based on license plates that are captured from a straight angle and good illumination and hence may not perform well if the images of license plates have noises or are captured at different angles. Therefore, in this work we have used license plates which are at different angles with different lighting conditions.

The license plate recognition technology is an important part of the construction of an intelligent traffic management system. This paper mainly researches the image preprocessing, license plate location, and character segmentation in the license plate recognition system. In the preprocessing part of the image, the edge detection method based on convolutional neural network (CNN) is used for edge detection. In the design of the license plate location, this paper proposes a location method based on a combination of mathematical morphology and statistical jump points. First, the license plate area is initially located using mathematical morphology-related operations and then the location of the license plate is accurately located using statistical jump points. Finally, the plate with tilt is corrected. In the process of character segmentation, the border and delimiter are first removed, then the character vertical projection method and the character boundary are used to segment the character for actually using cases.

Automatic License Plate Recognition (ALPR) has been the focus of many\nresearches in the past years. In general, ALPR is divided into the following\nproblems: detection of on-track vehicles, license plates detection, segmention\nof license plate characters and optical character recognition (OCR). Even\nthough commercial solutions are available for controlled acquisition\nconditions, e.g., the entrance of a parking lot, ALPR is still an open problem\nwhen dealing with data acquired from uncontrolled environments, such as roads\nand highways when relying only on imaging sensors. Due to the multiple\norientations and scales of the license plates captured by the camera, a very\nchallenging task of the ALPR is the License Plate Character Segmentation (LPCS)\nstep, which effectiveness is required to be (near) optimal to achieve a high\nrecognition rate by the OCR. To tackle the LPCS problem, this work proposes a\nnovel benchmark composed of a dataset designed to focus specifically on the\ncharacter segmentation step of the ALPR within an evaluation protocol.\nFurthermore, we propose the Jaccard-Centroid coefficient, a new evaluation\nmeasure more suitable than the Jaccard coefficient regarding the location of\nthe bounding box within the ground-truth annotation. The dataset is composed of\n2,000 Brazilian license plates consisting of 14,000 alphanumeric symbols and\ntheir corresponding bounding box annotations. We also present a new\nstraightforward approach to perform LPCS efficiently. Finally, we provide an\nexperimental evaluation for the dataset based on four LPCS approaches and\ndemonstrate the importance of character segmentation for achieving an accurate\nOCR.\n

On the streets of Taiwan, many roadside tollers are often seen riding motorcycles in one hand, and the other hand holding mobile devices to issue payment notices for cars and motorcycles parked on the roadsides. The work of roadside tollers is very dangerous. First, they must first park their motorcycles next to the roadside cars and motorcycles. They then use their eyes to confirm the license plate number, enter the license plate number into the mobile device, and finally place the bill on the car’s windows or attach the bill to the motorcycles. Our idea is to implement an automated license plate recognition system in mobile devices to increase the efficiency of roadside tollers and reduce their time on the road. Recently, license plate recognition systems have been widely used in various aspects of life, such as parking lot toll systems, access management systems, and traffic management systems. However, existing license plate recognition systems must have good recognition rates under a number of constraints, such as fixed angles and fixed light sources. Moreover, due to the insufficient computing resources of the general mobile device, the application cannot have a good recognition rate in the complex environment or skewed angle in the license plate recognition. Therefore, this paper proposes a lightweight and high-performance multi-angle license plate character recognition model, which reduces the complexity and computational complexity of traditional license plate recognition. This paper also collects a large number of license plate images from different environments, angles and sizes as training data. Finally, we propose an optimized deep learning model to identify the characters on license plates. The experimental results show that the proposed model can recognize the license plate with a tilt of 0~60 degrees, and the overall recall rate is 84.5%. Compared with Tiny-YOLOv2, the computation of the proposed model is reduced by 61% with a little penalty of recall.

This paper presents an efficient method for license plate detection and recognition that will aid in the development of an intelligent transport system. To significantly accelerate license plate localization a simple image pre-processing method is first used without reducing detection performance compared with that obtained using original image. Line density filter approach is used to extract the license plate regions, there by significantly reducing area to be analysed for license plate localization. In license plate recognition, the characters are recognized from these detected license plates by using optical character recognition and the owner details are displayed. The aim of this paper is to serve the purpose of accurately localizing vehicle license plates from complex scenes in real time that would help motor vehicle department in various ways.

Globally and locally, the number of vehicles is on the rise. It is becoming more and more challenging for authorities to track down specific vehicles. Automatic License Plate Recognition becomes an addition to transportation systems automation. Where the extraction of the vehicle license plate is done without human intervention. Identifying the precise place of a vehicle through its license plate number from moving images of the vehicle image is among the crucial activities for vehicle plate discovery systems. Artificial intelligence systems are connecting the gap between the physical world and digital world of automatic license plate detection. The proposed research uses machine learning to recognizing Arabic license plate numbers. An image of the vehicle number plate is captured and the detection is done by image processing, character segmentation which locates Arabic numeric characters on a number plate. The system recognizes the license plate number area and extracts the plate area from the vehicle image. The background color of the number plate identifies the vehicle types: (1) White color for private vehicle; (2) red color for bus and taxi; (3) blue color for governmental vehicle; (4) yellow color for trucks, tractors, and cranes; (5) black color for temporary license; and (6) green color for army. The recognition of Arabic numbers from license plates is achieved by two methods as (1) Google Tesseract OCR based recognition and (2) Machine Learning-based training and testing Arabic number character as K-nearest neighbors (kNN). The system has been tested on 90 images downloaded from the internet and captured from CCTV. Empirical outcomes show that the proposed system finds plate numbers as well as recognizes background color and Arabic number characters successfully. The overall success rates of plate localization and background color detection have been done. The overall success rate of plate localization and background color detection is 97.78%, and Arabic number detection in OCR is 45.56 % as well as in KNN is 92.22%.

License plate recognition usually contains three steps, namely license plate detection/localization, character segmentation and character recognition. When reading characters on a license plate one by one after license plate detection step, it is crucial to accurately segment the characters. The segmentation step may be affected by many factors such as license plate boundaries (frames). The recognition accuracy will be significantly reduced if the characters are not properly segmented. This paper presents an efficient algorithm for character segmentation on a license plate. The algorithm follows the step that detects the license plates using an AdaBoost algorithm. It is based on an efficient and accurate skew and slant correction of license plates, and works together with boundary (frame) removal of license plates. The algorithm is efficient and can be applied in real-time applications. The experiments are performed to show the accuracy of segmentation.

In today's world automatic license plate recognition play an important role in monitoring and organizing vehicles. In this paper, we propose a method of detecting and recognizing the license plates of vehicles in an automatic way in our country. The system can be used to collect toll, in car parking and find stolen vehicles. We have used different image processing techniques like resizing image, image binarization, connected component analysis, image enhancement and noise filtering. Our system is composed of four main modules, such as detection of the license plate area, extraction of license plate. Then, segmentation of characters and words and finally recognition of the characters and words. As Bangladesh Road Transport Authority (BRTA) imposed a common standard for vehicle license plate, the size and aspect ratio of all license plates are same. We have used a threshold value to detect and extract the license plate based on our analysis. Afterward, for character segmentation, we used connected components. Later, we used deep learning tool ‘the Convolutional Neural Network’ for character recognition. Due to the lack of a standard data set, we have developed a customized dataset of Bangladeshi number plate for the implementation of our method. The accuracy of our proposed system is 95.42%.

In this paper, we present a new design flow for robust license plate localization and recognition. The algorithm consists of three stages: 1) license plate localization; 2) character segmentation; and 3) feature extraction and character recognition. The algorithm uses Mexican hat operator for edge detection and Euler number of a binary image for identifying the license plate region. A pre-processing step using median filter and contrast enhancement is employed to improve the character segmentation performance in case of low resolution and blur images. A unique feature vector comprised of region properties, projection data and reflection symmetry coefficient has been proposed. Back propagation artificial neural network classifier has been used to train and test the neural network based on the extracted feature. A thorough testing of algorithm is performed on a database with varying test cases in terms of illumination and different plate conditions. Practical considerations like existence of another text block in an image, presence of dirt or shadow on or near license plate region, license plate with rows of characters and sensitivity to license plate dimensions have been addressed. The results are encouraging with success rate of 98.10% for license plate localization and 97.05% for character recognition.

CIS Multilingual License Plate Detection and Recognition Based on Convolutional and Transformer Neural Networks

Automatic license plate recognition (LPR) plays an important role in numerous applications and a number of techniques have been proposed. However, most of them worked under restricted conditions, such as fixed illumination, limited vehicle speed, designated routes, and stationary backgrounds. In this study, as few constraints as possible on the working environment are considered. The proposed LPR technique consists of two main modules: a license plate locating module and a license number identification module. The former characterized by fuzzy disciplines attempts to extract license plates from an input image, while the latter conceptualized in terms of neural subjects aims to identify the number present in a license plate. Experiments have been conducted for the respective modules. In the experiment on locating license plates, 1088 images taken from various scenes and under different conditions were employed. Of which, 23 images have been failed to locate the license plates present in the images; the license plate location rate of success is 97.9%. In the experiment on identifying license number, 1065 images, from which license plates have been successfully located, were used. Of which, 47 images have been failed to identify the numbers of the license plates located in the images; the identification rate of success is 95.6%. Combining the above two rates, the overall rate of success for our LPR algorithm is 93.7%.

License plate segmentation is a key technology in the process of license plate location and recognition. How to realize automatic segmentation of license plate image under complex illumination conditions has been a hot issue in intelligent transportation system (ITS). This paper deals with license plate image segmentation under a variety of lighting conditions. Based on the adaptive segmentation of license plate images by the Pulse Coupled Neural Network (PCNN), the relationship between the license plate image contrast and the PCNN iteration entropy is analyzed. An adaptive segmentation algorithm for license plate image using Deep Neural Network (DNN) to select the optimal result is proposed, and the selected segmentation image is filtered by the connected domain, which lays a foundation for subsequent license plate location, character segmentation and recognition. Simulation experiments show that the proposed algorithm performs better license plate segmentation and optimal selection for license plate images under various lighting conditions.

Automatic License Plate Recognition (ALPR) is a very widely used system in applications such as parking management, theft detection, traffic control and management etc. Most of the existing ALPR systems fail to showcase acceptable performance on real time images/video scenes. This work proposes and demonstrates implementation of a deep learning-based approach to locate license plates of four wheeler vehicles thereby enabling optical character recognition (OCR) to recognize the characters and numbers on the located plates in real time. The proposed system is decomposed into three sub-blocks viz. Vehicle image/video acquisition, License plate localization and OCR. A simple setup using a reasonable resolution webcam has been designed to capture images/videos of vehicles at some entry point. We propose to utilize Single Shot Detector (SSD) based Mobilenet V1 architecture to localize the license plates. The hyper parameters of this architecture are selected with rigorous experimentation so as to avoid over-fitting. We have compared performance of two OCRs viz. Tesseract OCR, Easy OCR and found the superiority of Easy OCR since it utilizes deep learning approach for character recognition. NVIDIA Jetson Nano and Raspberry Pi 3B hardware platforms have been used to implement the entire system. The parameters of these three sub-blocks have been optimized to yield real time performance of ALPR with acceptable accuracy. The proposed and implemented system on Jetson Nano allows processing of videos for ALPR having accuracy more than 95%.