Writing Style Adversarial Network for Handwritten Chinese Character Recognition

Handwritten Chinese character recognition (HCCR) is an important research field of pattern recognition, which has attracted extensive studies during the past decades. Recently convolutional neural network (CNN) based methods have achieved the state-of-the-art performance for handwritten Chinese character recognition. Nevertheless, handwritten Chinese character recognition is still limited to be effectively used in the actual environment due to the large-scale vocabulary and great diversity of handwriting style. In this paper, we constructed a handwritten Chinese character recognition service based on convolutional neural network, which tries to make effective use of handwritten based printed fonts and existing handwritten database. At the same time, the service can effectively collect more handwritten data to expand the training dataset, which makes it easy to adapt to the new handwriting styles. Meanwhile, We propose a multi-level recognition theory applied to online handwritten Chinese character recognition, which may improve the accuracy of handwritten Chinese character recognition and break the limitations of handwritten Chinese character recognition by identifying the structure of Chinese characters and possible stroke orders firstly. Furthermore, we try to apply the method of online character recognition to the offline character recognition based on the basic writing rules.

The task of handwritten Chinese character recognition is one of the most challenging areas of human handwriting classification. The main reason for this is related to the writing system itself which encompasses thousands of characters, coupled with high levels of diversity in personal writing styles and attributes. Much of the existing work for both online and off-line handwritten Chinese character recognition has focused on methods which employ feature extraction and segmentation steps. The preprocessed data from these steps form the basis for the subsequent classification and recognition phases. This paper proposes an approach for handwritten Chinese character recognition and classification using only an image alignment technique and does not require the aforementioned steps. Rather than extracting features from the image, which often means building models from very large training data, the proposed method instead uses the mean image transformations as a basis for model building. The use of an image-only model means that no subjective tuning of the feature extraction is required. In addition by employing a fuzzy-entropy-based metric, the work also entails improved ability to model different types of uncertainty. The classifier is a simple distance-based nearest neighbour classification system based on template matching. The approach is applied to a publicly available real-world database of handwritten Chinese characters and demonstrates that it can achieve high classification accuracy and is robust in the presence of noise.

Recognition of handwritten Chinese characters by elastic matching

In handwritten Chinese character recognition, the performance of a system is largely dependent on the character normalization method. In this paper, a visual word density-based nonlinear normalization method is proposed for handwritten Chinese character recognition. The underlying rationality is that the density for each image pixel should be determined by the visual word around this pixel. Visual vocabulary is used for mapping from a visual word to a density value. The mapping vocabulary is learned to maximize the ratio of the between-class variation and the within-class variation. Feature extraction is involved in the optimization stage, hence the proposed normalization method is beneficial for the following feature extraction. Furthermore, the proposed method can be applied to some other image classification problems in which scene character recognition is tried in this paper. Experimental results on one constrained handwriting database (CASIA) and one unconstrained handwriting database (CASIA-HWDB1.1) demonstrate that the proposed method outperforms the start-of-the-art methods. Experiments on scene character databases chars74k and ICDAR03-CH show that the proposed method is promising for some image classification problems.

Due to the various individual handwriting styles and diverse structures of Chinese characters, it is rather intricate to recognize handwritten Chinese characters precisely. In this paper, a muti-stage system that combines a Differentiable Binarization Network (DBNet) for text detection and Scene Text Recognition with a Single Visual Model (SVTR) for effective character recognition is developed, aiming to offer a potential solution for correct identification of handwritten Chinese characters in real-world scenarios. More specifically, the proposed system utilized the CASIA-HWDB2.x dataset from the Institute of Automation of the Chinese Academy of Sciences to train text detection and recognition models. For the detection, the Differentiable Binarization method in the Head Network applies a dynamic threshold map for text-background differentiation. On top of the SVTR employed as a recognition module, this research proposed a performance-optimized PP-LCNet architecture and the Guided Training of Continuous Time-Series Classifiers (GTC) with TextConAug, which is a data augmentation strategy to accommodate real-world scenarios. Briefly, DBNet and SVTR are integrated to form an end-to-end system. The output of DBNet after undergoing cropping and direction classifier, guides SVTR for a comprehensive system, ensuring seamless detection and recognition of handwritten Chinese characters. Experimental results indicate that this system achieves a promising performance and can provide accurate information on handwritten Chinese characters.

This paper proposes a hidden Markov mesh random field (HMMRF)-based stochastic model for off-line handwritten Chinese characters recognition using statistical observation sequences embedded in the strokes of a character. Due to the great amount of Chinese characters and many different writing styles or variations, the recognition of handwritten Chinese characters becomes more difficult and challenging than any other character recognition. In our approach, a new framework based on HMMRF model is put forward at first. The estimation of model parameters and state sequence decoding algorithms are also discussed later. Besides the mathematical model and corresponding issues, nonlinear shape normalization scheme that modifies the distortion and adjusts the correlation of strokes is applied. Two types of stroke-based features are extracted for the rough classification and observation sequence respectively. Experimental results on isolated handwritten Chinese characters demonstrate the effectiveness of our approach.

Chinese characters are constructed by basic strokes based on structural rules. In handwritten characters, the shapes of the strokes may vary to some extent, but the spatial relations and geometric configurations of the strokes are usually maintained. Therefore these spatial relations and configurations could be regarded as invariant features and could be used in the recognition of handwritten Chinese characters. In this paper, we investigate the structural knowledge in Chinese characters and propose the stroke spatial relationship representation (SSRR) to describe Chinese characters. An On-Line Chinese Character Recognition (OLCCR) method using the SSRR is also presented. With SSRR, each character is processed and is represented by an attribute graph. The process of character recognition is thereby transformed into a graph matching problem. After careful analysis, the basic spatial relationship between strokes can be characterized into five classes. A bitwise representation is adopted in the design of the data structure to reduce storage requirements and to speed up character matching. The strategy of hierarchical search in the preclassification improves the recognition speed. Basically, the attribute graph model is a generalized character representation that provides a useful and convenient representation for newly added characters in an OLCCR system with automatic learning capability. The significance of the structural approach of character recognition using spatial relationships is analyzed and is proved by experiments. Realistic testing is provided to show the effectiveness of the proposed method.

Self-generation Voting Based Method for Handwritten Chinese Character Recognition

Hierarchical attributed graph representation and recognition of handwritten chinese characters

Offline handwritten chinese character recognition (HCCR) is one of means for quick text input and it has a great demand in the area of file recognition, form processing, machine translation and office automation. However it still is a difficult task for handwritten chinese character recognition to put into practical use because of its large stroke change, writing anomaly, and no stroke ranking information can get, etc. al. An efficient classifier occupies very important position for increasing offline HCCR ratio. Support vector machines offer a theoretically well-founded approach to automated learning of pattern classifiers for mining labeled data sets. But as we know, the performance of SVMs largely depend on the kernel function, different kernel function will produce different SVMs, and may result in different performance. However, there are no theories concerning how to choose good kernel functions based on practical using problem. In this paper we make use of the basic properties of Mercer kernel to construct a hybrid kernel from the existing common kernel, and to find the unknown parameters of the hybrid kernel in data-dependent way by minimizing the upper bound of the VC dimension of the set of functions. Our experiment results show that the proposed method is efficient compared with other classifier for handwritten Chinese character recognition.

A key property of Chinese characters is that they are composed of fundamental parts called radicals. In this paper, a method to recognise (offline) the radicals of handwritten Chinese characters is proposed that is an extension of the authors' previous work based on active shape modelling. Three stages are involved: a set of example radicals is first described by landmarks using (mostly) automatic landmark labelling, then radicals are modelled as active shapes using kernel principal component analysis, and finally unseen radicals are matched to the reference models using a genetic algorithm to search for the optimal shape parameters. Experiments are conducted on a 430,800 character subset of the freely-available HITPU database, a collection of 751,000 loosely-constrained handwritten Chinese characters. Results show that this new method outperforms existing representative radical approaches, including the authors' own earlier work. Improvements on the previous work are made in two aspects: automatic landmark labelling, which renders this methodology more practical, and the use of a genetic algorithm which finds the optimal shape parameters more effectively, leading to the best results so far reported on this dataset.

A network integration method suitable for Chinese character recognition which combines traditional statistical method and artificial neural network is proposed to deal with the problems in machine recognition of handwritten Chinese characters which have the properties of large vocabulary, complex structure, lots of similar characters and variations of character shape due to handwriting. Four different classifiers for handwritten Chinese character recognition are integrated by the proposed method. The experimental results show that the method has a fast learning speed as well as high accuracy and can greatly improve the system performance.

This paper proposes an on-line handwritten Chinese character recognition system based on stroke-sequence feature extraction. The character to be recognized can be stroke-order and stroke-number free, tolerance for combined strokes, size flexible, but within the constraint of normal hand-writing. Firstly, the recognizer, using the finite state matching mechanism, is used to extract primitive strokes, represented as stroke string, from the input character. Secondly, the recognizer, using a modified dynamic programming matching method, is employed to perform recognition processes with the stroke-string features. Reference patterns have been generated 2500 Chinese characters with stroke-numbers ranging from 1 to 29. The recognition results are based upon the 1800 handwritten characters by 10 people. The obtained recognition rate is 94.5%, and the cumulative classification rate of choosing fourth most similar characters is up to 98.7%. In the last part, a secondary recognition mechanism is used to further tell apart the candidates involved. The final recognition rate may be promoted up to 99%.

Recognition of printed and handwritten text (characters and digits) has been a challenge for many researchers in the field of Document Image Analysis for almost thirty years. Many existing pattern recognition methods have been used and new ones have been proposed. Despite the satisfactory results obtained in recognizing printed text, recognition of handwritten text is still an open research. This paper presents a method for off-line recognition of handwritten Chinese characters. Each character is described by six structural features extracted using the dominant point method. The goodness of each feature is determined by a method called stroke probability. The classification was performed by the Fuzzy ARTMAP neural network within the context of the one-class problem approach. Evaluation of the proposed method was determined using database of 900 characters (an average of 40 samples/character). The average mean recognition rate was approximately 94%.

This paper presents QuickStroke: a system for the incremental recognition of handwritten Chinese characters. Only a few strokes of an ideogram need to be entered in order for a character to be successfully recognized. Incremental recognition is a new approach for on-line recognition of ideographic characters. It allows a user to enter characters a factor of 2 times faster than systems that require entry of full characters. Incremental recognition is performed by a two-stage system which utilizes 68 neural networks with more than 5 million free parameters. To enable incremental recognition, we use specialized time-delay neural networks (TDNNs) that are trained to recognize partial characters. To boost the recognition accuracy of complete characters, we also use standard fully-connected neural networks. Quickstroke is 97.3% accurate for the incremental writer-independent recognition of 4400 simplified GB Chinese ideograms.