Template-Instance Loss for Offline Handwritten Chinese Character Recognition

Handwritten Chinese character recognition (HCCR) is an important research field of pattern recognition, which has attracted extensive studies during the past decades. Recently convolutional neural network (CNN) based methods have achieved the state-of-the-art performance for handwritten Chinese character recognition. Nevertheless, handwritten Chinese character recognition is still limited to be effectively used in the actual environment due to the large-scale vocabulary and great diversity of handwriting style. In this paper, we constructed a handwritten Chinese character recognition service based on convolutional neural network, which tries to make effective use of handwritten based printed fonts and existing handwritten database. At the same time, the service can effectively collect more handwritten data to expand the training dataset, which makes it easy to adapt to the new handwriting styles. Meanwhile, We propose a multi-level recognition theory applied to online handwritten Chinese character recognition, which may improve the accuracy of handwritten Chinese character recognition and break the limitations of handwritten Chinese character recognition by identifying the structure of Chinese characters and possible stroke orders firstly. Furthermore, we try to apply the method of online character recognition to the offline character recognition based on the basic writing rules.

Due to the various individual handwriting styles and diverse structures of Chinese characters, it is rather intricate to recognize handwritten Chinese characters precisely. In this paper, a muti-stage system that combines a Differentiable Binarization Network (DBNet) for text detection and Scene Text Recognition with a Single Visual Model (SVTR) for effective character recognition is developed, aiming to offer a potential solution for correct identification of handwritten Chinese characters in real-world scenarios. More specifically, the proposed system utilized the CASIA-HWDB2.x dataset from the Institute of Automation of the Chinese Academy of Sciences to train text detection and recognition models. For the detection, the Differentiable Binarization method in the Head Network applies a dynamic threshold map for text-background differentiation. On top of the SVTR employed as a recognition module, this research proposed a performance-optimized PP-LCNet architecture and the Guided Training of Continuous Time-Series Classifiers (GTC) with TextConAug, which is a data augmentation strategy to accommodate real-world scenarios. Briefly, DBNet and SVTR are integrated to form an end-to-end system. The output of DBNet after undergoing cropping and direction classifier, guides SVTR for a comprehensive system, ensuring seamless detection and recognition of handwritten Chinese characters. Experimental results indicate that this system achieves a promising performance and can provide accurate information on handwritten Chinese characters.

This paper proposes a hidden Markov mesh random field (HMMRF)-based stochastic model for off-line handwritten Chinese characters recognition using statistical observation sequences embedded in the strokes of a character. Due to the great amount of Chinese characters and many different writing styles or variations, the recognition of handwritten Chinese characters becomes more difficult and challenging than any other character recognition. In our approach, a new framework based on HMMRF model is put forward at first. The estimation of model parameters and state sequence decoding algorithms are also discussed later. Besides the mathematical model and corresponding issues, nonlinear shape normalization scheme that modifies the distortion and adjusts the correlation of strokes is applied. Two types of stroke-based features are extracted for the rough classification and observation sequence respectively. Experimental results on isolated handwritten Chinese characters demonstrate the effectiveness of our approach.

Chinese characters are constructed by basic strokes based on structural rules. In handwritten characters, the shapes of the strokes may vary to some extent, but the spatial relations and geometric configurations of the strokes are usually maintained. Therefore these spatial relations and configurations could be regarded as invariant features and could be used in the recognition of handwritten Chinese characters. In this paper, we investigate the structural knowledge in Chinese characters and propose the stroke spatial relationship representation (SSRR) to describe Chinese characters. An On-Line Chinese Character Recognition (OLCCR) method using the SSRR is also presented. With SSRR, each character is processed and is represented by an attribute graph. The process of character recognition is thereby transformed into a graph matching problem. After careful analysis, the basic spatial relationship between strokes can be characterized into five classes. A bitwise representation is adopted in the design of the data structure to reduce storage requirements and to speed up character matching. The strategy of hierarchical search in the preclassification improves the recognition speed. Basically, the attribute graph model is a generalized character representation that provides a useful and convenient representation for newly added characters in an OLCCR system with automatic learning capability. The significance of the structural approach of character recognition using spatial relationships is analyzed and is proved by experiments. Realistic testing is provided to show the effectiveness of the proposed method.

The task of handwritten Chinese character recognition is one of the most challenging areas of human handwriting classification. The main reason for this is related to the writing system itself which encompasses thousands of characters, coupled with high levels of diversity in personal writing styles and attributes. Much of the existing work for both online and off-line handwritten Chinese character recognition has focused on methods which employ feature extraction and segmentation steps. The preprocessed data from these steps form the basis for the subsequent classification and recognition phases. This paper proposes an approach for handwritten Chinese character recognition and classification using only an image alignment technique and does not require the aforementioned steps. Rather than extracting features from the image, which often means building models from very large training data, the proposed method instead uses the mean image transformations as a basis for model building. The use of an image-only model means that no subjective tuning of the feature extraction is required. In addition by employing a fuzzy-entropy-based metric, the work also entails improved ability to model different types of uncertainty. The classifier is a simple distance-based nearest neighbour classification system based on template matching. The approach is applied to a publicly available real-world database of handwritten Chinese characters and demonstrates that it can achieve high classification accuracy and is robust in the presence of noise.

Recognition of handwritten Chinese characters by elastic matching

A key property of Chinese characters is that they are composed of fundamental parts called radicals. In this paper, a method to recognise (offline) the radicals of handwritten Chinese characters is proposed that is an extension of the authors' previous work based on active shape modelling. Three stages are involved: a set of example radicals is first described by landmarks using (mostly) automatic landmark labelling, then radicals are modelled as active shapes using kernel principal component analysis, and finally unseen radicals are matched to the reference models using a genetic algorithm to search for the optimal shape parameters. Experiments are conducted on a 430,800 character subset of the freely-available HITPU database, a collection of 751,000 loosely-constrained handwritten Chinese characters. Results show that this new method outperforms existing representative radical approaches, including the authors' own earlier work. Improvements on the previous work are made in two aspects: automatic landmark labelling, which renders this methodology more practical, and the use of a genetic algorithm which finds the optimal shape parameters more effectively, leading to the best results so far reported on this dataset.

Hierarchical attributed graph representation and recognition of handwritten chinese characters

A network integration method suitable for Chinese character recognition which combines traditional statistical method and artificial neural network is proposed to deal with the problems in machine recognition of handwritten Chinese characters which have the properties of large vocabulary, complex structure, lots of similar characters and variations of character shape due to handwriting. Four different classifiers for handwritten Chinese character recognition are integrated by the proposed method. The experimental results show that the method has a fast learning speed as well as high accuracy and can greatly improve the system performance.

This paper proposes an on-line handwritten Chinese character recognition system based on stroke-sequence feature extraction. The character to be recognized can be stroke-order and stroke-number free, tolerance for combined strokes, size flexible, but within the constraint of normal hand-writing. Firstly, the recognizer, using the finite state matching mechanism, is used to extract primitive strokes, represented as stroke string, from the input character. Secondly, the recognizer, using a modified dynamic programming matching method, is employed to perform recognition processes with the stroke-string features. Reference patterns have been generated 2500 Chinese characters with stroke-numbers ranging from 1 to 29. The recognition results are based upon the 1800 handwritten characters by 10 people. The obtained recognition rate is 94.5%, and the cumulative classification rate of choosing fourth most similar characters is up to 98.7%. In the last part, a secondary recognition mechanism is used to further tell apart the candidates involved. The final recognition rate may be promoted up to 99%.

In this paper, the off-line Chinese character image is transformed into ellipse shape of basic Chinese characters strokes in different position. The stroke "turning" and joint or crossover of strokes is combined by basic strokes. The neural network for extracting Chinese character has been build up. The research on off-line Chinese character image is transformed into the research on double weights elliptical neural network based on biomimetic pattern. By extracting fault-tolerant features of the 4 kinds of basic stroke, 13 kinds of "turning" stroke and 7 kinds of consistency and intersection of strokes, the data-knowledge table of features is constructed. The method of bionic recognition gives the machine the ability of cognizing features of stroke type and number, features of stroke location and features of topology structural. The simple and complex handwritten Chinese characters are used to carry out simulation experiment in SCUT-IRAC-HCCLIB. The experiment results show that the algorithm exhibits a strong ability of cognizing handwritten Chinese characters.

Amongst all the methods of machine learning, learning from examples is considered as a key to acquire knowledge automatically. Learning from examples is to obtain a general cover through induction from a given set of positive and negative examples of a concept, which may describe all the positive examples, but reject all the negative examples of that concept. Extension matrix theory, a branch of learning from examples, presents the training examples as two matrices which consist of positive and negative examples respectively, and then finds a path satisfied with a positive example against the background of negative examples. Obviously, such a path is a conjunction of conditions that is satisfied by the positive example. However, most of all of pattern recognition problems, such as handwritten Chinese character recognition, have an overlay area. It is necessary to solve the problem of nonlinear boundaries among different classes when machine learning is applied to acquire the recognition rules. An advanced extension matrix algorithm is proposed in this paper, in which a heuristic search based on the average entropy is used to get the approximate solutions of the minimal complex. A potential function is used to estimate the probability density function of the overlay area between positive and negative examples, so that the nonlinear interfaces of the interclass areas may be obtained. This algorithm is applied to supervised learning for Chinese character recognition to acquire recognition rules, and the implementations upon 751,000 loosely-constrained handwritten Chinese characters indicate that these methodologies can be applied to a practical recognition system with promising results.

Similar characters existed in Chinese character affect much on enhancing the handwritten Chinese character recognition rate. An improved method is presented in this paper, which combines structural and statistical features for similar handwritten Chinese character recognition,. Four-corner code feature that based on stroke structure is used to get the similar character set. According to the different strokes on the four corners, four-corner code feature can dispatch some characters which are similar in shape into different similar sets. Statistical hierarchy contour features are extracted from the characters in the same similar set, then support vector machine (SVM) is adopted as classifier to recognize the similar characters. This method reduces the complexity of recognizing similar characters, and the experiment results on common used 500 Chinese characters show the effectiveness.

Applied Biomimetic Pattern Recognition to replace “differentiation” of characteristic sample by machine “cognition”, a novel method of handwritten Chinese characters recognition is presented. A double weights elliptical neuron is used to cover four basic kinds of handwritten Chinese characters stroke segment. The topological property among the stroke segment neurons is analyzed. Nine style of Chinese characters stroke with fault tolerance are combined. Imitated typing methods of human Chinese characters font code, the style and number of stroke neurons which have redundant fault tolerant shapes are counted. A kind of characteristic knowledge data-base table of handwritten Chinese characters and the sample data-base of standard printed Chinese characters and fault tolerant matching rules are built. Simple and more complex handwritten Chinese characters in SCUT-IRAC database are tested. The method is proved to be close to human fault tolerance and veracity.

Self-generation Voting Based Method for Handwritten Chinese Character Recognition