Combining multiple classifiers based on statistical method for handwritten Chinese character recognition

This paper presents a new linguistic decoding method for online handwritten Chinese character recognition. The method employs a hybrid language model which combinesN-gram and linguistic rules by rule quantification technique. The linguistic decoding algorithm consists of three stages: word lattice construction, the optimal sentence hypothesis search and self-adaptive learning mechanism. The technique has been applied to palmtop computer’s online handwritten Chinese character recognition. Samples containing millions of characters were used to test the linguistic decoder. In the open experiment, accuracy rate up to 92% is achieved, and the error rate is reduced by 68%.

Handwritten Chinese character recognition (HCCR) is an important research field of pattern recognition, which has attracted extensive studies during the past decades. Recently convolutional neural network (CNN) based methods have achieved the state-of-the-art performance for handwritten Chinese character recognition. Nevertheless, handwritten Chinese character recognition is still limited to be effectively used in the actual environment due to the large-scale vocabulary and great diversity of handwriting style. In this paper, we constructed a handwritten Chinese character recognition service based on convolutional neural network, which tries to make effective use of handwritten based printed fonts and existing handwritten database. At the same time, the service can effectively collect more handwritten data to expand the training dataset, which makes it easy to adapt to the new handwriting styles. Meanwhile, We propose a multi-level recognition theory applied to online handwritten Chinese character recognition, which may improve the accuracy of handwritten Chinese character recognition and break the limitations of handwritten Chinese character recognition by identifying the structure of Chinese characters and possible stroke orders firstly. Furthermore, we try to apply the method of online character recognition to the offline character recognition based on the basic writing rules.

This paper proposes an on-line handwritten Chinese character recognition system based on stroke-sequence feature extraction. The character to be recognized can be stroke-order and stroke-number free, tolerance for combined strokes, size flexible, but within the constraint of normal hand-writing. Firstly, the recognizer, using the finite state matching mechanism, is used to extract primitive strokes, represented as stroke string, from the input character. Secondly, the recognizer, using a modified dynamic programming matching method, is employed to perform recognition processes with the stroke-string features. Reference patterns have been generated 2500 Chinese characters with stroke-numbers ranging from 1 to 29. The recognition results are based upon the 1800 handwritten characters by 10 people. The obtained recognition rate is 94.5%, and the cumulative classification rate of choosing fourth most similar characters is up to 98.7%. In the last part, a secondary recognition mechanism is used to further tell apart the candidates involved. The final recognition rate may be promoted up to 99%.

Self-generation Voting Based Method for Handwritten Chinese Character Recognition

In handwritten Chinese character recognition, the performance of a system is largely dependent on the character normalization method. In this paper, a visual word density-based nonlinear normalization method is proposed for handwritten Chinese character recognition. The underlying rationality is that the density for each image pixel should be determined by the visual word around this pixel. Visual vocabulary is used for mapping from a visual word to a density value. The mapping vocabulary is learned to maximize the ratio of the between-class variation and the within-class variation. Feature extraction is involved in the optimization stage, hence the proposed normalization method is beneficial for the following feature extraction. Furthermore, the proposed method can be applied to some other image classification problems in which scene character recognition is tried in this paper. Experimental results on one constrained handwriting database (CASIA) and one unconstrained handwriting database (CASIA-HWDB1.1) demonstrate that the proposed method outperforms the start-of-the-art methods. Experiments on scene character databases chars74k and ICDAR03-CH show that the proposed method is promising for some image classification problems.

Model-based stroke extraction and matching for handwritten Chinese character recognition

A novel post-processing system for a handwritten Chinese character recognition system based on a neural network classifier is presented. The recognition results for input character images, namely candidate characters and their confidence scores, as the observed features of the recognizer are classified into the most probable characters. The confusing character set is established by analyzing large-scale recognition experimental results, and the statistical characteristics for a recognizer are expressed as confusing character sets. 3755 character categories in the GB2312-80 character-set are clustered into several hundreds of groups through searching the transitive closure of the similarity matrix associated with the confusing characters of each character category. A group of neural networks for these category groups is established and trained to be a classifier in the post-processing to recover the unrecognized characters and adjust confidence scores of the candidate characters when a candidate sequence for each individual character image is given. The experimental results show that an average accuracy rate improvement of 5.6% and 3.8% for an online and an offline handwritten Chinese character recognition system are achieved respectively.

This paper presents a new approach to large-vocabulary online handwritten Chinese character recognition based on semi-tied covariance (STC) modeling. Detailed procedures are described for estimating the STC model parameters under both maximum likelihood (ML) and minimum classification error (MCE) criteria. Compared with the state-of-the-art modified quadratic discriminant function (MQDF) based classifiers, STC-based classifiers can achieve a better memory-accuracy trade-off, thus provide more flexibility in designing compact online handwritten Chinese character recognizers. Its usefulness has been confirmed and demonstrated by comparative experiments on popular Nakayosi and Kuchibue Japanese character databases.

Chinese characters are constructed by basic strokes based on structural rules. In handwritten characters, the shapes of the strokes may vary to some extent, but the spatial relations and geometric configurations of the strokes are usually maintained. Therefore these spatial relations and configurations could be regarded as invariant features and could be used in the recognition of handwritten Chinese characters. In this paper, we investigate the structural knowledge in Chinese characters and propose the stroke spatial relationship representation (SSRR) to describe Chinese characters. An On-Line Chinese Character Recognition (OLCCR) method using the SSRR is also presented. With SSRR, each character is processed and is represented by an attribute graph. The process of character recognition is thereby transformed into a graph matching problem. After careful analysis, the basic spatial relationship between strokes can be characterized into five classes. A bitwise representation is adopted in the design of the data structure to reduce storage requirements and to speed up character matching. The strategy of hierarchical search in the preclassification improves the recognition speed. Basically, the attribute graph model is a generalized character representation that provides a useful and convenient representation for newly added characters in an OLCCR system with automatic learning capability. The significance of the structural approach of character recognition using spatial relationships is analyzed and is proved by experiments. Realistic testing is provided to show the effectiveness of the proposed method.

Similar characters existed in Chinese character affect much on enhancing the handwritten Chinese character recognition rate. An improved method is presented in this paper, which combines structural and statistical features for similar handwritten Chinese character recognition,. Four-corner code feature that based on stroke structure is used to get the similar character set. According to the different strokes on the four corners, four-corner code feature can dispatch some characters which are similar in shape into different similar sets. Statistical hierarchy contour features are extracted from the characters in the same similar set, then support vector machine (SVM) is adopted as classifier to recognize the similar characters. This method reduces the complexity of recognizing similar characters, and the experiment results on common used 500 Chinese characters show the effectiveness.

This paper presents a novel approach to writer adaptation using bottleneck features and discriminative linear regression for the recognition of online handwritten Chinese characters. First, bottleneck features extracted from a bottleneck layer of a deep neural network representing a nonlinear and discriminative transformation of the input features are verified to be much more effective in adaptation of writing styles than the conventional features after linear discriminant analysis transformation. Second, discriminative linear regression via a so-called sample separation margin based minimum classification error criterion is adopted for writer adaptation. The experiments on an in-house developed online Chinese handwriting corpus with a vocabulary of 15,167 characters and testing data collected from user inputs of Smartphones show that our proposed approach can achieve very significant improvements of recognition accuracy compared with a state-of-the-art adaptation approach for writer adaptation.

The metasynthetic approach for solving complicated problems was proposed in 1990.1 And the characteristics of metasynthetic approach can be summarized as human-machine cooperation and integration. Directed by the idea of metasynthesis, the design of two kinds of handwritten Chinese character recognition systems are given in this article. All the designs focus on incorporating human knowledge into multiple classifier combination, which is different from conventional integration. The first one is multi-stage adaptive weighted multiple classifier combination, in which a neural network for coefficient predicting is trained by supervised learning to provide weights suitable for the input pattern. And the second scheme is based on totally parallel combination, in which human intelligence and computer capabilities are combined together through multi-step supervised learning. The experimental results demonstrate substantial improvement in overall performance for handwritten Chinese character recognition with thousands of classes that must be discriminated.

Multi-stroke relaxation matching method for handwritten chinese character recognition

The hierarchical nature of Chinese characters has inspired radical-based recognition, but radical segmentation from characters remains a challenge. We previously proposed a radical-based approach for on-line handwritten Chinese character recognition, which incorporates character structure knowledge into integrated radical segmentation and recognition, and performs well on characters of left-right and up-down structures (non-special structures). In this paper, we propose a statistical-classification-based method for detecting special radicals from special-structure characters. We design 19 binary classifiers for classifying candidate radicals (groups of strokes) hypothesized from the input character. Characters with special radicals detected are recognized using special-structure models, while those without special radicals are recognized using the models for non-special structures. We applied the recognition framework to 6,763 character classes, and achieved promising recognition performance in experiments.

Automating handwritten character recognition (HCR) for Sinhalese is still an emerging field, as Sri Lanka is the only country in the world that uses Sinhala as the national language. The Sinhala alphabet includes 60 characters that appear to be fairly complex when compared to many other languages. Although approximately 25 research studies have been conducted since 1990s to recognize handwritten Sinhala characters, there is still a large room for improvement. We have investigated two different methods for handwritten Sinhala character recognition: (i) total pixel length-based method which was newly derived by assuming the differences among characters in pixel length and (ii) Convolution Neural Networks (CNN) based classification, to overcome the limitations in the primitive methods. Multiple preprocessing techniques were used in the pixel length-based method while only a resizing technique was used in the CNN based method. The total pixel length and CNN based methods were tested using a dataset of 55 characters, each with 33 samples. The result of the pixel length method is imperfect as distinct characters may hold the same length. Therefore, we abode this method for further processing in future with more improvements. But the proposed CNN classification produces an accuracy of 85.71% and when compared to current studies, this can be considered as the best result achieved for 55 characters among total 60 characters, with nearly 10% of accuracy improvement.