Handwritten Chinese character recognition using fuzzy image alignment

Offline handwritten chinese character recognition (HCCR) is one of means for quick text input and it has a great demand in the area of file recognition, form processing, machine translation and office automation. However it still is a difficult task for handwritten chinese character recognition to put into practical use because of its large stroke change, writing anomaly, and no stroke ranking information can get, etc. al. An efficient classifier occupies very important position for increasing offline HCCR ratio. Support vector machines offer a theoretically well-founded approach to automated learning of pattern classifiers for mining labeled data sets. But as we know, the performance of SVMs largely depend on the kernel function, different kernel function will produce different SVMs, and may result in different performance. However, there are no theories concerning how to choose good kernel functions based on practical using problem. In this paper we make use of the basic properties of Mercer kernel to construct a hybrid kernel from the existing common kernel, and to find the unknown parameters of the hybrid kernel in data-dependent way by minimizing the upper bound of the VC dimension of the set of functions. Our experiment results show that the proposed method is efficient compared with other classifier for handwritten Chinese character recognition.

Handwritten Chinese character recognition (HCCR) is an important research field of pattern recognition, which has attracted extensive studies during the past decades. Recently convolutional neural network (CNN) based methods have achieved the state-of-the-art performance for handwritten Chinese character recognition. Nevertheless, handwritten Chinese character recognition is still limited to be effectively used in the actual environment due to the large-scale vocabulary and great diversity of handwriting style. In this paper, we constructed a handwritten Chinese character recognition service based on convolutional neural network, which tries to make effective use of handwritten based printed fonts and existing handwritten database. At the same time, the service can effectively collect more handwritten data to expand the training dataset, which makes it easy to adapt to the new handwriting styles. Meanwhile, We propose a multi-level recognition theory applied to online handwritten Chinese character recognition, which may improve the accuracy of handwritten Chinese character recognition and break the limitations of handwritten Chinese character recognition by identifying the structure of Chinese characters and possible stroke orders firstly. Furthermore, we try to apply the method of online character recognition to the offline character recognition based on the basic writing rules.

Recognition of printed and handwritten text (characters and digits) has been a challenge for many researchers in the field of Document Image Analysis for almost thirty years. Many existing pattern recognition methods have been used and new ones have been proposed. Despite the satisfactory results obtained in recognizing printed text, recognition of handwritten text is still an open research. This paper presents a method for off-line recognition of handwritten Chinese characters. Each character is described by six structural features extracted using the dominant point method. The goodness of each feature is determined by a method called stroke probability. The classification was performed by the Fuzzy ARTMAP neural network within the context of the one-class problem approach. Evaluation of the proposed method was determined using database of 900 characters (an average of 40 samples/character). The average mean recognition rate was approximately 94%.

This paper presents a methodology for off-line handwritten Chinese character recognition based on mergence of consecutive segments of adaptive duration. The handwritten Chinese character string is partitioned into a sequence of consecutive segments, which are combined to implement dissimilarity evaluation within a sliding window whose durations are determined adaptively by the integration of shapes and context of evaluations. The average stroke width is estimated for the handwritten Chinese character string, and a set of candidate character segmentation boundaries is found by using the integration of pixel and stroke features. The final decisions on segmentation and recognition are made under minimal arithmetical mean dissimilarities. Experiments proved that the proposed approach of adaptive duration outperforms the method of fixed duration, and is very effective for the recognition of overlapped, broken, touched, loosely configured Chinese characters.

Deep convolutional neural networks (DNNs) have achieved outstanding performance in this field. Meanwhile, handwritten Chinese character recognition (HCCR) is a challenging area of research in the field of computer vision. DNNs require a large number of parameters and high memory consumption. To address these issues, this paper proposes an approach based on an attention mechanism and knowledge distillation. The attention mechanism improves the feature extraction and the knowledge distillation reduces the number of parameters. The experimental results show that ResNet18 achieves a recognition accuracy of 97.63% on the HCCR dataset with 11.25 million parameters. Compared with other methods, this study improves the performance for HCCR.

Recognition of handwritten Chinese characters by elastic matching

Due to the various individual handwriting styles and diverse structures of Chinese characters, it is rather intricate to recognize handwritten Chinese characters precisely. In this paper, a muti-stage system that combines a Differentiable Binarization Network (DBNet) for text detection and Scene Text Recognition with a Single Visual Model (SVTR) for effective character recognition is developed, aiming to offer a potential solution for correct identification of handwritten Chinese characters in real-world scenarios. More specifically, the proposed system utilized the CASIA-HWDB2.x dataset from the Institute of Automation of the Chinese Academy of Sciences to train text detection and recognition models. For the detection, the Differentiable Binarization method in the Head Network applies a dynamic threshold map for text-background differentiation. On top of the SVTR employed as a recognition module, this research proposed a performance-optimized PP-LCNet architecture and the Guided Training of Continuous Time-Series Classifiers (GTC) with TextConAug, which is a data augmentation strategy to accommodate real-world scenarios. Briefly, DBNet and SVTR are integrated to form an end-to-end system. The output of DBNet after undergoing cropping and direction classifier, guides SVTR for a comprehensive system, ensuring seamless detection and recognition of handwritten Chinese characters. Experimental results indicate that this system achieves a promising performance and can provide accurate information on handwritten Chinese characters.

Hierarchical attributed graph representation and recognition of handwritten chinese characters

This paper proposes a hidden Markov mesh random field (HMMRF)-based stochastic model for off-line handwritten Chinese characters recognition using statistical observation sequences embedded in the strokes of a character. Due to the great amount of Chinese characters and many different writing styles or variations, the recognition of handwritten Chinese characters becomes more difficult and challenging than any other character recognition. In our approach, a new framework based on HMMRF model is put forward at first. The estimation of model parameters and state sequence decoding algorithms are also discussed later. Besides the mathematical model and corresponding issues, nonlinear shape normalization scheme that modifies the distortion and adjusts the correlation of strokes is applied. Two types of stroke-based features are extracted for the rough classification and observation sequence respectively. Experimental results on isolated handwritten Chinese characters demonstrate the effectiveness of our approach.

Self-generation Voting Based Method for Handwritten Chinese Character Recognition

A key property of Chinese characters is that they are composed of fundamental parts called radicals. In this paper, a method to recognise (offline) the radicals of handwritten Chinese characters is proposed that is an extension of the authors' previous work based on active shape modelling. Three stages are involved: a set of example radicals is first described by landmarks using (mostly) automatic landmark labelling, then radicals are modelled as active shapes using kernel principal component analysis, and finally unseen radicals are matched to the reference models using a genetic algorithm to search for the optimal shape parameters. Experiments are conducted on a 430,800 character subset of the freely-available HITPU database, a collection of 751,000 loosely-constrained handwritten Chinese characters. Results show that this new method outperforms existing representative radical approaches, including the authors' own earlier work. Improvements on the previous work are made in two aspects: automatic landmark labelling, which renders this methodology more practical, and the use of a genetic algorithm which finds the optimal shape parameters more effectively, leading to the best results so far reported on this dataset.

The long-standing challenges for offline handwritten Chinese character recognition (HCCR) are twofold: Chinese characters can be very diverse and complicated while similarly looking, and cursive handwriting (due to increased writing speed and infrequent pen lifting) makes strokes and even characters connected together in a flowing manner. In this paper, we propose the template and instance loss functions for the relevant machine learning tasks in offline handwritten Chinese character recognition. First, the character template is designed to deal with the intrinsic similarities among Chinese characters. Second, the instance loss can reduce category variance according to classification difficulty, giving a large penalty to the outlier instance of handwritten Chinese character. Trained with the new loss functions using our deep network architecture HCCR14Layer model consisting of simple layers, our extensive experiments show that it yields state-of-the-art performance and beyond for offline HCCR.

Based on the rough set theory and variable granular theorem, a kind of decision information system of off-line handwritten Chinese character recognition is constructed. The performance index entropy in this decision information system is defined in this paper. According to the definition of attribute relative significance, the feature attributes are classified, that the representation of feature attributes in single layer and single granularity become multiple layers and multiple granularities, and a hierarchical reduction approach is designed. The weak points of the single granularity that fixed and reduction is not fine are made up. Based on the D-S evidence theory, the decision rules after reduction are fused, so that the recognition rate can be improved. The experiment results show that the method is feasible and effective.

Chinese characters are constructed by basic strokes based on structural rules. In handwritten characters, the shapes of the strokes may vary to some extent, but the spatial relations and geometric configurations of the strokes are usually maintained. Therefore these spatial relations and configurations could be regarded as invariant features and could be used in the recognition of handwritten Chinese characters. In this paper, we investigate the structural knowledge in Chinese characters and propose the stroke spatial relationship representation (SSRR) to describe Chinese characters. An On-Line Chinese Character Recognition (OLCCR) method using the SSRR is also presented. With SSRR, each character is processed and is represented by an attribute graph. The process of character recognition is thereby transformed into a graph matching problem. After careful analysis, the basic spatial relationship between strokes can be characterized into five classes. A bitwise representation is adopted in the design of the data structure to reduce storage requirements and to speed up character matching. The strategy of hierarchical search in the preclassification improves the recognition speed. Basically, the attribute graph model is a generalized character representation that provides a useful and convenient representation for newly added characters in an OLCCR system with automatic learning capability. The significance of the structural approach of character recognition using spatial relationships is analyzed and is proved by experiments. Realistic testing is provided to show the effectiveness of the proposed method.

This paper proposes an on-line handwritten Chinese character recognition system based on stroke-sequence feature extraction. The character to be recognized can be stroke-order and stroke-number free, tolerance for combined strokes, size flexible, but within the constraint of normal hand-writing. Firstly, the recognizer, using the finite state matching mechanism, is used to extract primitive strokes, represented as stroke string, from the input character. Secondly, the recognizer, using a modified dynamic programming matching method, is employed to perform recognition processes with the stroke-string features. Reference patterns have been generated 2500 Chinese characters with stroke-numbers ranging from 1 to 29. The recognition results are based upon the 1800 handwritten characters by 10 people. The obtained recognition rate is 94.5%, and the cumulative classification rate of choosing fourth most similar characters is up to 98.7%. In the last part, a secondary recognition mechanism is used to further tell apart the candidates involved. The final recognition rate may be promoted up to 99%.